[==========] Running 11 tests from 1 test case. [----------] Global test environment set-up. [----------] 11 tests from RemoteKsckTest [ RUN ] RemoteKsckTest.TestClusterOk WARNING: Logging before InitGoogleLogging() is written to STDERR I0401 16:41:32.397868 12160 test_util.cc:212] Using random seed: -1888430870 I0401 16:41:32.401453 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:58248,127.11.224.61:51035,127.11.224.60:60032 I0401 16:41:32.411993 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 836431us I0401 16:41:32.412670 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:32.412729 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:32.413005 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:32.413089 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:32.417237 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "6c091e7d3a92407c899173d47c5e9f2d" format_stamp: "Formatted at 2019-04-01 23:41:32 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:32.428709 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.011s user 0.005s sys 0.004s I0401 16:41:32.430126 12160 env_posix.cc:1676] Not raising this process' open files per process limit of 32768; it is already as high as it can go I0401 16:41:32.430780 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:32.434818 12160 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s I0401 16:41:32.434887 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-0-root uuid: "6c091e7d3a92407c899173d47c5e9f2d" format_stamp: "Formatted at 2019-04-01 23:41:32 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:32.435024 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:32.483273 12160 env_posix.cc:1671] Raising this process' running threads per effective uid limit from 32768 to 65536 I0401 16:41:32.523545 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:58248 I0401 16:41:32.525099 12160 webserver.cc:308] Webserver started at http://127.11.224.62:51522/ using document root and password file I0401 16:41:32.529189 12219 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:32.529991 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 836431us I0401 16:41:32.530194 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:32.530315 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:32.530454 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:32.530532 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:32.531252 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "a8bb772d23844fb38e2f7ac70789393c" format_stamp: "Formatted at 2019-04-01 23:41:32 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:32.537164 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s I0401 16:41:32.539193 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:32.542663 12160 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s I0401 16:41:32.542769 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-1-root uuid: "a8bb772d23844fb38e2f7ac70789393c" format_stamp: "Formatted at 2019-04-01 23:41:32 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:32.543232 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:32.546526 12219 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:32.577932 12219 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:32.578920 12219 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:51035: Network error: Client connection negotiation failed: client connection to 127.11.224.61:51035: connect: Connection refused (error 111) I0401 16:41:32.605269 12219 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } attempt: 1 W0401 16:41:32.606313 12219 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:51035: Network error: Client connection negotiation failed: client connection to 127.11.224.61:51035: connect: Connection refused (error 111) I0401 16:41:32.651266 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:51035 I0401 16:41:32.652695 12160 webserver.cc:308] Webserver started at http://127.11.224.61:38458/ using document root and password file I0401 16:41:32.655120 12276 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:32.657541 12276 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:32.657671 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 836431us I0401 16:41:32.657882 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:32.657979 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:32.658224 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:32.658316 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:32.659263 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" format_stamp: "Formatted at 2019-04-01 23:41:32 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:32.666667 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.007s user 0.003s sys 0.002s I0401 16:41:32.667599 12276 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:32.668292 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:32.671826 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:32.671929 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-2-root uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" format_stamp: "Formatted at 2019-04-01 23:41:32 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:32.672049 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:32.678584 12276 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:32.679548 12276 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:60032: Network error: Client connection negotiation failed: client connection to 127.11.224.60:60032: connect: Connection refused (error 111) I0401 16:41:32.686533 12219 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } attempt: 2 I0401 16:41:32.691119 12219 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:32.691906 12219 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:60032: Network error: Client connection negotiation failed: client connection to 127.11.224.60:60032: connect: Connection refused (error 111) I0401 16:41:32.703793 12276 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } attempt: 1 W0401 16:41:32.704805 12276 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:60032: Network error: Client connection negotiation failed: client connection to 127.11.224.60:60032: connect: Connection refused (error 111) I0401 16:41:32.739395 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:60032 I0401 16:41:32.740178 12160 webserver.cc:308] Webserver started at http://127.11.224.60:33416/ using document root and password file I0401 16:41:32.741647 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:32.742364 12333 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:32.744473 12333 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:32.750080 12333 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:32.750993 12276 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } attempt: 2 I0401 16:41:32.756906 12333 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:32.757177 12219 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } attempt: 1 I0401 16:41:32.765700 12276 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c: Bootstrap starting. I0401 16:41:32.768558 12333 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89: Bootstrap starting. I0401 16:41:32.770015 12219 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d: Bootstrap starting. I0401 16:41:32.771221 12333 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89: No blocks or log segments found. Creating new log. I0401 16:41:32.771229 12276 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c: No blocks or log segments found. Creating new log. I0401 16:41:32.772047 12219 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d: No blocks or log segments found. Creating new log. I0401 16:41:32.773489 12219 log.cc:525] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d: Log is configured to *not* fsync() on all Append() calls I0401 16:41:32.778753 12276 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c: No bootstrap required, opened a new log I0401 16:41:32.778753 12333 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89: No bootstrap required, opened a new log I0401 16:41:32.778923 12219 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d: No bootstrap required, opened a new log I0401 16:41:32.790997 12219 raft_consensus.cc:340] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.791093 12276 raft_consensus.cc:340] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.791474 12276 raft_consensus.cc:366] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:32.791471 12219 raft_consensus.cc:366] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:32.791093 12333 raft_consensus.cc:340] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.791723 12219 raft_consensus.cc:705] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c091e7d3a92407c899173d47c5e9f2d, State: Initialized, Role: FOLLOWER I0401 16:41:32.791775 12333 raft_consensus.cc:366] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:32.791775 12276 raft_consensus.cc:705] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8bb772d23844fb38e2f7ac70789393c, State: Initialized, Role: FOLLOWER I0401 16:41:32.791916 12333 raft_consensus.cc:705] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 997fe12c9d23427eaf9f8c2e6a18eb89, State: Initialized, Role: FOLLOWER I0401 16:41:32.792726 12333 consensus_queue.cc:229] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.792726 12219 consensus_queue.cc:229] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.792732 12276 consensus_queue.cc:229] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.795965 12219 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.795962 12276 sys_catalog.cc:337] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.796324 12219 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:32.797667 12276 sys_catalog.cc:340] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:32.797668 12333 sys_catalog.cc:337] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.797286 12341 sys_catalog.cc:337] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.799226 12333 sys_catalog.cc:340] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:32.799392 12341 sys_catalog.cc:340] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:32.799392 12340 sys_catalog.cc:337] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.801192 12340 sys_catalog.cc:340] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:32.801476 12276 sys_catalog.cc:424] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:32.801367 12333 sys_catalog.cc:424] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:32.798441 12342 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.801775 12219 sys_catalog.cc:424] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:32.802816 12342 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:32.801916 12340 raft_consensus.cc:472] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:32.803874 12340 raft_consensus.cc:494] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.808346 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:41:32.808406 12253 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8bb772d23844fb38e2f7ac70789393c" is_pre_election: true I0401 16:41:32.807639 12340 leader_election.cc:296] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c091e7d3a92407c899173d47c5e9f2d (127.11.224.62:58248), a8bb772d23844fb38e2f7ac70789393c (127.11.224.61:51035) I0401 16:41:32.808676 12196 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c091e7d3a92407c899173d47c5e9f2d" is_pre_election: true I0401 16:41:32.810595 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 I0401 16:41:32.810593 12253 raft_consensus.cc:2346] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 997fe12c9d23427eaf9f8c2e6a18eb89 in term 0. I0401 16:41:32.810597 12196 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 997fe12c9d23427eaf9f8c2e6a18eb89 in term 0. I0401 16:41:32.811607 12282 leader_election.cc:310] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 997fe12c9d23427eaf9f8c2e6a18eb89, a8bb772d23844fb38e2f7ac70789393c; no voters: I0401 16:41:32.813022 12340 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:32.813292 12340 raft_consensus.cc:472] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:32.813729 12340 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 0 FOLLOWER]: Advancing to term 1 W0401 16:41:32.825052 12345 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:32.825053 12344 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:32.825211 12345 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0401 16:41:32.825335 12346 catalog_manager.cc:1113] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:32.825359 12344 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0401 16:41:32.825522 12346 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:32.826146 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 836431us I0401 16:41:32.826967 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:32.827065 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:32.827276 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:32.828330 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:32.829139 12340 raft_consensus.cc:494] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.829725 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "e6c51e0f80484ea1b328f8ba01762295" format_stamp: "Formatted at 2019-04-01 23:41:32 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:32.830703 12340 leader_election.cc:296] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [CANDIDATE]: Term 1 election: Requested vote from peers 6c091e7d3a92407c899173d47c5e9f2d (127.11.224.62:58248), a8bb772d23844fb38e2f7ac70789393c (127.11.224.61:51035) I0401 16:41:32.831687 12253 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a8bb772d23844fb38e2f7ac70789393c" I0401 16:41:32.831692 12196 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c091e7d3a92407c899173d47c5e9f2d" I0401 16:41:32.831938 12253 raft_consensus.cc:2886] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:32.831944 12196 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:32.837529 12196 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 997fe12c9d23427eaf9f8c2e6a18eb89 in term 1. I0401 16:41:32.837529 12253 raft_consensus.cc:2346] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 997fe12c9d23427eaf9f8c2e6a18eb89 in term 1. I0401 16:41:32.838256 12281 leader_election.cc:310] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c091e7d3a92407c899173d47c5e9f2d, 997fe12c9d23427eaf9f8c2e6a18eb89; no voters: I0401 16:41:32.839481 12340 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:32.839738 12340 raft_consensus.cc:667] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 1 LEADER]: Becoming Leader. State: Replica: 997fe12c9d23427eaf9f8c2e6a18eb89, State: Running, Role: LEADER I0401 16:41:32.840591 12340 consensus_queue.cc:206] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } I0401 16:41:32.840934 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.004s sys 0.004s I0401 16:41:32.844319 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:32.845268 12343 sys_catalog.cc:337] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 997fe12c9d23427eaf9f8c2e6a18eb89. Latest consensus state: current_term: 1 leader_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.846385 12343 sys_catalog.cc:340] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: This master's current role is: LEADER I0401 16:41:32.855224 12350 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:32.855836 12160 fs_manager.cc:419] Time spent opening block manager: real 0.008s user 0.000s sys 0.002s I0401 16:41:32.856070 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-0-root uuid: "e6c51e0f80484ea1b328f8ba01762295" format_stamp: "Formatted at 2019-04-01 23:41:32 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:32.856245 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:32.864323 12350 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... W0401 16:41:32.864431 12232 tablet.cc:1786] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c: Can't schedule compaction. Clean time has not been advanced past its initial value. I0401 16:41:32.886984 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:32.887100 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:32.938194 12196 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 1 FOLLOWER]: Refusing update from remote peer 997fe12c9d23427eaf9f8c2e6a18eb89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:32.938194 12253 raft_consensus.cc:1181] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 1 FOLLOWER]: Refusing update from remote peer 997fe12c9d23427eaf9f8c2e6a18eb89: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:32.939638 12343 consensus_queue.cc:984] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:32.941179 12340 consensus_queue.cc:984] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:32.975188 12342 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 997fe12c9d23427eaf9f8c2e6a18eb89. Latest consensus state: current_term: 1 leader_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.975188 12341 sys_catalog.cc:337] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 997fe12c9d23427eaf9f8c2e6a18eb89. Latest consensus state: current_term: 1 leader_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.975791 12342 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:32.975879 12341 sys_catalog.cc:340] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:32.981566 12374 mvcc.cc:203] Tried to move safe_time back from 6365847932655820800 to 6365847932279459840. Current Snapshot: MvccSnapshot[committed={T|T < 6365847932655820800}] I0401 16:41:32.983523 12343 sys_catalog.cc:337] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.984148 12343 sys_catalog.cc:340] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: This master's current role is: LEADER I0401 16:41:32.988680 12350 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:32.992496 12342 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.991922 12343 sys_catalog.cc:337] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:32.993777 12343 sys_catalog.cc:340] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [sys.catalog]: This master's current role is: LEADER I0401 16:41:32.997556 12350 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:32.997552 12342 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:33.006153 12341 sys_catalog.cc:337] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c091e7d3a92407c899173d47c5e9f2d" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 58248 } } peers { permanent_uuid: "a8bb772d23844fb38e2f7ac70789393c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 51035 } } peers { permanent_uuid: "997fe12c9d23427eaf9f8c2e6a18eb89" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 60032 } } } I0401 16:41:33.007148 12341 sys_catalog.cc:340] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:33.022426 12350 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89: Generated new TSK 0 I0401 16:41:33.050518 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:47680 I0401 16:41:33.052392 12160 webserver.cc:308] Webserver started at http://127.11.224.1:42394/ using document root and password file I0401 16:41:33.075410 12423 heartbeater.cc:345] Connected to a master server at 127.11.224.60:60032 I0401 16:41:33.075738 12423 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.076905 12423 heartbeater.cc:475] Master 127.11.224.60:60032 requested a full tablet report, sending... I0401 16:41:33.079623 12424 heartbeater.cc:345] Connected to a master server at 127.11.224.61:51035 I0401 16:41:33.079751 12424 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.080780 12424 heartbeater.cc:475] Master 127.11.224.61:51035 requested a full tablet report, sending... I0401 16:41:33.081640 12300 ts_manager.cc:159] Registered new tserver with Master: e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680) I0401 16:41:33.081807 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 836931us I0401 16:41:33.082231 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:33.083614 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:33.083559 12243 ts_manager.cc:159] Registered new tserver with Master: e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680) I0401 16:41:33.084525 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:33.084816 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:33.086329 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "691d7e738af946209181748f7c01636c" format_stamp: "Formatted at 2019-04-01 23:41:33 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:33.086753 12300 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:33512 I0401 16:41:33.086911 12426 heartbeater.cc:345] Connected to a master server at 127.11.224.62:58248 I0401 16:41:33.087091 12426 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.088106 12426 heartbeater.cc:475] Master 127.11.224.62:58248 requested a full tablet report, sending... I0401 16:41:33.091018 12186 ts_manager.cc:159] Registered new tserver with Master: e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680) I0401 16:41:33.093575 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.002s sys 0.002s I0401 16:41:33.094837 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:33.099030 12160 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s I0401 16:41:33.099120 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-1-root uuid: "691d7e738af946209181748f7c01636c" format_stamp: "Formatted at 2019-04-01 23:41:33 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:33.099228 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:33.100252 12423 heartbeater.cc:467] Master 127.11.224.60:60032 was elected leader, sending a full tablet report... I0401 16:41:33.141021 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:33.141211 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:33.230007 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:57495 I0401 16:41:33.232705 12160 webserver.cc:308] Webserver started at http://127.11.224.2:46653/ using document root and password file I0401 16:41:33.254897 12494 heartbeater.cc:345] Connected to a master server at 127.11.224.60:60032 I0401 16:41:33.255072 12494 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.258715 12494 heartbeater.cc:475] Master 127.11.224.60:60032 requested a full tablet report, sending... I0401 16:41:33.260268 12300 ts_manager.cc:159] Registered new tserver with Master: 691d7e738af946209181748f7c01636c (127.11.224.2:57495) I0401 16:41:33.261895 12300 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:33515 I0401 16:41:33.270592 12495 heartbeater.cc:345] Connected to a master server at 127.11.224.61:51035 I0401 16:41:33.270751 12495 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.271108 12495 heartbeater.cc:475] Master 127.11.224.61:51035 requested a full tablet report, sending... I0401 16:41:33.272610 12497 heartbeater.cc:345] Connected to a master server at 127.11.224.62:58248 I0401 16:41:33.272610 12243 ts_manager.cc:159] Registered new tserver with Master: 691d7e738af946209181748f7c01636c (127.11.224.2:57495) I0401 16:41:33.272766 12497 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.273067 12497 heartbeater.cc:475] Master 127.11.224.62:58248 requested a full tablet report, sending... I0401 16:41:33.273422 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 836931us I0401 16:41:33.273726 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:33.273838 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:33.274042 12494 heartbeater.cc:467] Master 127.11.224.60:60032 was elected leader, sending a full tablet report... I0401 16:41:33.274042 12186 ts_manager.cc:159] Registered new tserver with Master: 691d7e738af946209181748f7c01636c (127.11.224.2:57495) I0401 16:41:33.274153 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:33.274246 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:33.274973 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "ea22542beb2e4cf297a2b82c04c5485a" format_stamp: "Formatted at 2019-04-01 23:41:33 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:33.281728 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s I0401 16:41:33.283025 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:33.287341 12160 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s I0401 16:41:33.287492 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-2-root uuid: "ea22542beb2e4cf297a2b82c04c5485a" format_stamp: "Formatted at 2019-04-01 23:41:33 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:33.287638 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterOk.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:33.320127 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:33.320245 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:33.450018 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:41712 I0401 16:41:33.452756 12160 webserver.cc:308] Webserver started at http://127.11.224.3:40500/ using document root and password file I0401 16:41:33.479548 12565 heartbeater.cc:345] Connected to a master server at 127.11.224.61:51035 I0401 16:41:33.479703 12565 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.480670 12565 heartbeater.cc:475] Master 127.11.224.61:51035 requested a full tablet report, sending... I0401 16:41:33.482986 12564 heartbeater.cc:345] Connected to a master server at 127.11.224.60:60032 I0401 16:41:33.482987 12243 ts_manager.cc:159] Registered new tserver with Master: ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:33.483136 12564 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.483572 12564 heartbeater.cc:475] Master 127.11.224.60:60032 requested a full tablet report, sending... I0401 16:41:33.484521 12299 ts_manager.cc:159] Registered new tserver with Master: ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:33.485499 12566 heartbeater.cc:345] Connected to a master server at 127.11.224.62:58248 I0401 16:41:33.485664 12566 heartbeater.cc:426] Registering TS with master... I0401 16:41:33.486373 12566 heartbeater.cc:475] Master 127.11.224.62:58248 requested a full tablet report, sending... I0401 16:41:33.487395 12299 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:33518 I0401 16:41:33.489142 12186 ts_manager.cc:159] Registered new tserver with Master: ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:33.489642 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.024476404s I0401 16:41:33.500391 12564 heartbeater.cc:467] Master 127.11.224.60:60032 was elected leader, sending a full tablet report... I0401 16:41:33.542449 12298 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.60:33523: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:33.558712 12298 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:33.669268 12457 tablet_service.cc:1006] Processing CreateTablet for tablet 1d9ff322fafe44b49647e1d0a461a9a8 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:33.669800 12460 tablet_service.cc:1006] Processing CreateTablet for tablet 3a5a3eb985a1449a842c4cbc6b054d8c (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:33.672637 12461 tablet_service.cc:1006] Processing CreateTablet for tablet 9528934d3883467d973e249b3542e541 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:33.671743 12456 tablet_service.cc:1006] Processing CreateTablet for tablet 278fa1bb7726469ba58f4245848f1046 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:33.673941 12452 tablet_service.cc:1006] Processing CreateTablet for tablet 8a583f4e15144ad085e5373b90d24e01 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:33.673894 12458 tablet_service.cc:1006] Processing CreateTablet for tablet 58213f99590747369b50a74ed52178f4 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:33.675384 12459 tablet_service.cc:1006] Processing CreateTablet for tablet 179f7d444d934e97b7d1600583addb41 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:33.676203 12453 tablet_service.cc:1006] Processing CreateTablet for tablet cf2344da4a8848a79e815e6f1306547a (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:33.673979 12454 tablet_service.cc:1006] Processing CreateTablet for tablet 3f24ded7ec9b44c4b1f69713686999c7 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:33.677570 12452 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8a583f4e15144ad085e5373b90d24e01. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.676350 12455 tablet_service.cc:1006] Processing CreateTablet for tablet 19de4523dc8b4ed68f5e3ddab4128579 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:33.679183 12457 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1d9ff322fafe44b49647e1d0a461a9a8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.679934 12460 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3a5a3eb985a1449a842c4cbc6b054d8c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.681195 12456 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 278fa1bb7726469ba58f4245848f1046. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.681449 12454 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3f24ded7ec9b44c4b1f69713686999c7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.681967 12458 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 58213f99590747369b50a74ed52178f4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.682814 12455 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 19de4523dc8b4ed68f5e3ddab4128579. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.683651 12453 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet cf2344da4a8848a79e815e6f1306547a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.684628 12461 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9528934d3883467d973e249b3542e541. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.689666 12459 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 179f7d444d934e97b7d1600583addb41. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.690346 12382 tablet_service.cc:1006] Processing CreateTablet for tablet 9528934d3883467d973e249b3542e541 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:33.696290 12381 tablet_service.cc:1006] Processing CreateTablet for tablet 3a5a3eb985a1449a842c4cbc6b054d8c (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:33.697865 12376 tablet_service.cc:1006] Processing CreateTablet for tablet 19de4523dc8b4ed68f5e3ddab4128579 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:33.696679 12378 tablet_service.cc:1006] Processing CreateTablet for tablet 1d9ff322fafe44b49647e1d0a461a9a8 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:33.698056 12377 tablet_service.cc:1006] Processing CreateTablet for tablet 278fa1bb7726469ba58f4245848f1046 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:33.701429 12382 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9528934d3883467d973e249b3542e541. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.699440 12375 tablet_service.cc:1006] Processing CreateTablet for tablet 3f24ded7ec9b44c4b1f69713686999c7 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:33.698796 12379 tablet_service.cc:1006] Processing CreateTablet for tablet 58213f99590747369b50a74ed52178f4 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:33.700471 12373 tablet_service.cc:1006] Processing CreateTablet for tablet cf2344da4a8848a79e815e6f1306547a (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:33.701612 12372 tablet_service.cc:1006] Processing CreateTablet for tablet 8a583f4e15144ad085e5373b90d24e01 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:33.704625 12381 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3a5a3eb985a1449a842c4cbc6b054d8c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.702931 12380 tablet_service.cc:1006] Processing CreateTablet for tablet 179f7d444d934e97b7d1600583addb41 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:33.710156 12378 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1d9ff322fafe44b49647e1d0a461a9a8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.711825 12376 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 19de4523dc8b4ed68f5e3ddab4128579. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.713701 12373 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet cf2344da4a8848a79e815e6f1306547a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.714972 12380 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 179f7d444d934e97b7d1600583addb41. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.718914 12379 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 58213f99590747369b50a74ed52178f4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.722019 12372 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8a583f4e15144ad085e5373b90d24e01. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.729152 12375 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3f24ded7ec9b44c4b1f69713686999c7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.735822 12377 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 278fa1bb7726469ba58f4245848f1046. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.742102 12526 tablet_service.cc:1006] Processing CreateTablet for tablet 278fa1bb7726469ba58f4245848f1046 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:33.744436 12527 tablet_service.cc:1006] Processing CreateTablet for tablet 1d9ff322fafe44b49647e1d0a461a9a8 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:33.744489 12529 tablet_service.cc:1006] Processing CreateTablet for tablet 179f7d444d934e97b7d1600583addb41 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:33.746778 12531 tablet_service.cc:1006] Processing CreateTablet for tablet 9528934d3883467d973e249b3542e541 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:33.747290 12525 tablet_service.cc:1006] Processing CreateTablet for tablet 19de4523dc8b4ed68f5e3ddab4128579 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:33.750965 12530 tablet_service.cc:1006] Processing CreateTablet for tablet 3a5a3eb985a1449a842c4cbc6b054d8c (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:33.748313 12524 tablet_service.cc:1006] Processing CreateTablet for tablet 3f24ded7ec9b44c4b1f69713686999c7 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:33.749173 12523 tablet_service.cc:1006] Processing CreateTablet for tablet cf2344da4a8848a79e815e6f1306547a (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:33.752399 12522 tablet_service.cc:1006] Processing CreateTablet for tablet 8a583f4e15144ad085e5373b90d24e01 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:33.752815 12528 tablet_service.cc:1006] Processing CreateTablet for tablet 58213f99590747369b50a74ed52178f4 (table=ksck-test-table [id=aa5850acde2042b8b9b0e3c1d87c74af]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:33.759444 12526 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 278fa1bb7726469ba58f4245848f1046. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.762023 12527 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1d9ff322fafe44b49647e1d0a461a9a8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.763974 12529 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 179f7d444d934e97b7d1600583addb41. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.766027 12524 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3f24ded7ec9b44c4b1f69713686999c7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.767722 12523 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet cf2344da4a8848a79e815e6f1306547a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.770303 12522 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8a583f4e15144ad085e5373b90d24e01. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.775925 12525 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 19de4523dc8b4ed68f5e3ddab4128579. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.782829 12531 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9528934d3883467d973e249b3542e541. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.783301 12530 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3a5a3eb985a1449a842c4cbc6b054d8c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.784739 12528 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 58213f99590747369b50a74ed52178f4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:33.873095 12346 catalog_manager.cc:1111] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c: acquiring CA information for follower catalog manager: success I0401 16:41:33.875383 12345 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d: acquiring CA information for follower catalog manager: success I0401 16:41:33.891300 12592 tablet_bootstrap.cc:439] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:33.892987 12593 tablet_bootstrap.cc:439] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:33.907119 12345 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:33.914453 12346 catalog_manager.cc:1139] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:33.922909 12594 tablet_bootstrap.cc:439] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. I0401 16:41:33.933382 12593 tablet_bootstrap.cc:590] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:33.934459 12592 tablet_bootstrap.cc:590] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:33.944437 12593 tablet_bootstrap.cc:439] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:33.944571 12594 tablet_bootstrap.cc:590] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:33.945000 12593 ts_tablet_manager.cc:1053] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.058s user 0.002s sys 0.006s I0401 16:41:33.947350 12593 raft_consensus.cc:340] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:33.949970 12593 raft_consensus.cc:366] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:33.950062 12593 raft_consensus.cc:705] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:33.950281 12593 consensus_queue.cc:229] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:33.956903 12592 tablet_bootstrap.cc:439] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:33.960431 12592 ts_tablet_manager.cc:1053] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.075s user 0.002s sys 0.008s I0401 16:41:33.959363 12593 ts_tablet_manager.cc:1081] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.010s user 0.005s sys 0.001s I0401 16:41:33.961782 12593 tablet_bootstrap.cc:439] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:33.965658 12593 tablet_bootstrap.cc:590] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:33.965556 12592 raft_consensus.cc:340] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:33.966398 12592 raft_consensus.cc:366] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:33.966697 12592 raft_consensus.cc:705] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:33.967097 12594 tablet_bootstrap.cc:439] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:33.967100 12592 consensus_queue.cc:229] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:33.967341 12594 ts_tablet_manager.cc:1053] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.050s user 0.003s sys 0.009s I0401 16:41:33.980293 12594 raft_consensus.cc:340] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:33.981226 12592 ts_tablet_manager.cc:1081] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.019s user 0.004s sys 0.007s I0401 16:41:33.982110 12594 raft_consensus.cc:366] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:33.982488 12594 raft_consensus.cc:705] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:33.982810 12594 consensus_queue.cc:229] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:33.983592 12593 tablet_bootstrap.cc:439] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:33.983952 12592 tablet_bootstrap.cc:439] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:33.984695 12593 ts_tablet_manager.cc:1053] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.010s I0401 16:41:33.986985 12594 ts_tablet_manager.cc:1081] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.018s user 0.002s sys 0.002s I0401 16:41:33.987571 12594 tablet_bootstrap.cc:439] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. I0401 16:41:33.988078 12593 raft_consensus.cc:340] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:33.989749 12593 raft_consensus.cc:366] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:33.989923 12593 raft_consensus.cc:705] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:33.990460 12593 consensus_queue.cc:229] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:33.992969 12594 tablet_bootstrap.cc:590] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:33.994395 12593 ts_tablet_manager.cc:1081] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s I0401 16:41:33.995306 12592 tablet_bootstrap.cc:590] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:33.995826 12593 tablet_bootstrap.cc:439] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:34.000437 12594 tablet_bootstrap.cc:439] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.000694 12594 ts_tablet_manager.cc:1053] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s I0401 16:41:34.001065 12592 tablet_bootstrap.cc:439] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.001199 12593 tablet_bootstrap.cc:590] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:34.001691 12592 ts_tablet_manager.cc:1053] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.002s I0401 16:41:34.001686 12597 raft_consensus.cc:472] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.002068 12594 raft_consensus.cc:340] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.002146 12597 raft_consensus.cc:494] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.002844 12594 raft_consensus.cc:366] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.003011 12594 raft_consensus.cc:705] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.003587 12597 leader_election.cc:296] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.003420 12594 consensus_queue.cc:229] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.005213 12594 ts_tablet_manager.cc:1081] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:34.009244 12594 tablet_bootstrap.cc:439] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. I0401 16:41:34.013926 12592 raft_consensus.cc:340] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.017778 12592 raft_consensus.cc:366] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.020694 12594 tablet_bootstrap.cc:590] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:34.020979 12592 raft_consensus.cc:705] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.021417 12592 consensus_queue.cc:229] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.024502 12592 ts_tablet_manager.cc:1081] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.021s user 0.001s sys 0.002s I0401 16:41:34.029907 12592 tablet_bootstrap.cc:439] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:34.037931 12594 tablet_bootstrap.cc:439] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.038484 12594 ts_tablet_manager.cc:1053] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.006s I0401 16:41:34.039901 12594 raft_consensus.cc:340] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.040328 12594 raft_consensus.cc:366] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.040836 12594 raft_consensus.cc:705] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.040925 12593 tablet_bootstrap.cc:439] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:34.040925 12592 tablet_bootstrap.cc:590] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:34.045838 12593 ts_tablet_manager.cc:1053] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.013s I0401 16:41:34.046908 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3f24ded7ec9b44c4b1f69713686999c7" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.045226 12594 consensus_queue.cc:229] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.049285 12594 ts_tablet_manager.cc:1081] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.010s user 0.001s sys 0.002s I0401 16:41:34.049648 12594 tablet_bootstrap.cc:439] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. W0401 16:41:34.052007 12352 leader_election.cc:348] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.054577 12594 tablet_bootstrap.cc:590] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:34.055593 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3f24ded7ec9b44c4b1f69713686999c7" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.056622 12471 raft_consensus.cc:2346] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 0. I0401 16:41:34.054591 12593 raft_consensus.cc:340] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.057654 12592 tablet_bootstrap.cc:439] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.058141 12597 raft_consensus.cc:472] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.058974 12597 raft_consensus.cc:494] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.058128 12355 leader_election.cc:310] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691d7e738af946209181748f7c01636c, e6c51e0f80484ea1b328f8ba01762295; no voters: ea22542beb2e4cf297a2b82c04c5485a I0401 16:41:34.059803 12592 ts_tablet_manager.cc:1053] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.033s user 0.001s sys 0.006s I0401 16:41:34.059340 12593 raft_consensus.cc:366] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.062206 12593 raft_consensus.cc:705] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:34.062714 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d9ff322fafe44b49647e1d0a461a9a8" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.067199 12597 leader_election.cc:296] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.068696 12541 raft_consensus.cc:2346] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 0. I0401 16:41:34.069664 12352 leader_election.cc:310] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.070281 12597 raft_consensus.cc:2640] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.070401 12597 raft_consensus.cc:472] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.070840 12597 raft_consensus.cc:2886] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.069713 12593 consensus_queue.cc:229] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.073019 12594 tablet_bootstrap.cc:439] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.077036 12594 ts_tablet_manager.cc:1053] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.010s I0401 16:41:34.075379 12592 raft_consensus.cc:340] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.078876 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d9ff322fafe44b49647e1d0a461a9a8" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.079360 12610 raft_consensus.cc:2640] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.079506 12610 raft_consensus.cc:472] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.079910 12592 raft_consensus.cc:366] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.080448 12592 raft_consensus.cc:705] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.080847 12597 raft_consensus.cc:494] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.080456 12610 raft_consensus.cc:2886] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.081326 12593 ts_tablet_manager.cc:1081] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.034s user 0.002s sys 0.002s W0401 16:41:34.081321 12355 leader_election.cc:348] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691d7e738af946209181748f7c01636c (127.11.224.2:57495): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.080847 12592 consensus_queue.cc:229] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.082893 12597 leader_election.cc:296] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Requested vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.083112 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3f24ded7ec9b44c4b1f69713686999c7" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" I0401 16:41:34.083237 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3f24ded7ec9b44c4b1f69713686999c7" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.084904 12471 raft_consensus.cc:2886] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.087028 12593 tablet_bootstrap.cc:439] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:34.088551 12592 ts_tablet_manager.cc:1081] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.027s user 0.000s sys 0.003s W0401 16:41:34.091778 12352 leader_election.cc:348] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.091984 12592 tablet_bootstrap.cc:439] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:34.091928 12594 raft_consensus.cc:340] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.092762 12594 raft_consensus.cc:366] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.092993 12594 raft_consensus.cc:705] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.093825 12471 raft_consensus.cc:2346] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 1. I0401 16:41:34.095059 12355 leader_election.cc:310] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691d7e738af946209181748f7c01636c, e6c51e0f80484ea1b328f8ba01762295; no voters: ea22542beb2e4cf297a2b82c04c5485a I0401 16:41:34.093860 12594 consensus_queue.cc:229] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.096979 12611 raft_consensus.cc:2640] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.097012 12594 ts_tablet_manager.cc:1081] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.019s user 0.002s sys 0.000s I0401 16:41:34.099030 12611 raft_consensus.cc:667] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Becoming Leader. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Running, Role: LEADER I0401 16:41:34.099666 12611 consensus_queue.cc:206] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.100909 12593 tablet_bootstrap.cc:590] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:34.102252 12594 tablet_bootstrap.cc:439] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. I0401 16:41:34.099707 12610 raft_consensus.cc:494] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.104487 12610 leader_election.cc:296] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Requested vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.104554 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d9ff322fafe44b49647e1d0a461a9a8" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.104928 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d9ff322fafe44b49647e1d0a461a9a8" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" I0401 16:41:34.105953 12541 raft_consensus.cc:2886] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 W0401 16:41:34.106184 12355 leader_election.cc:348] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 691d7e738af946209181748f7c01636c (127.11.224.2:57495): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.106436 12592 tablet_bootstrap.cc:590] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:34.111193 12541 raft_consensus.cc:2346] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 1. I0401 16:41:34.113643 12352 leader_election.cc:310] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: 691d7e738af946209181748f7c01636c I0401 16:41:34.117805 12594 tablet_bootstrap.cc:590] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:34.119741 12611 raft_consensus.cc:2640] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.119932 12599 raft_consensus.cc:472] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.123706 12611 raft_consensus.cc:667] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Becoming Leader. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Running, Role: LEADER I0401 16:41:34.122586 12599 raft_consensus.cc:494] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.122772 12297 catalog_manager.cc:3977] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 reported cstate change: term changed from 0 to 1, leader changed from to e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "e6c51e0f80484ea1b328f8ba01762295" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: UNKNOWN } } } I0401 16:41:34.127738 12611 consensus_queue.cc:206] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.128870 12599 leader_election.cc:296] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.129163 12599 raft_consensus.cc:472] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.131570 12594 tablet_bootstrap.cc:439] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.131392 12599 raft_consensus.cc:494] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.136180 12599 leader_election.cc:296] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.136399 12594 ts_tablet_manager.cc:1053] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.005s I0401 16:41:34.138447 12610 raft_consensus.cc:472] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.138950 12610 raft_consensus.cc:494] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.139297 12592 tablet_bootstrap.cc:439] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.140658 12592 ts_tablet_manager.cc:1053] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.048s user 0.001s sys 0.012s I0401 16:41:34.141635 12593 tablet_bootstrap.cc:439] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:34.141894 12594 raft_consensus.cc:340] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.146762 12594 raft_consensus.cc:366] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.143600 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3a5a3eb985a1449a842c4cbc6b054d8c" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.147569 12610 leader_election.cc:296] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.147881 12593 ts_tablet_manager.cc:1053] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.060s user 0.003s sys 0.011s I0401 16:41:34.146839 12592 raft_consensus.cc:340] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.149670 12594 raft_consensus.cc:705] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.150025 12541 raft_consensus.cc:2346] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 0. I0401 16:41:34.155450 12592 raft_consensus.cc:366] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.157308 12352 leader_election.cc:310] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.156821 12594 consensus_queue.cc:229] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.158133 12592 raft_consensus.cc:705] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.158605 12610 raft_consensus.cc:2640] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.159168 12610 raft_consensus.cc:472] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.160413 12610 raft_consensus.cc:2886] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.163223 12594 ts_tablet_manager.cc:1081] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.023s user 0.001s sys 0.002s I0401 16:41:34.162165 12592 consensus_queue.cc:229] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.164405 12592 ts_tablet_manager.cc:1081] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.023s user 0.001s sys 0.001s I0401 16:41:34.165421 12592 tablet_bootstrap.cc:439] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:34.165416 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3a5a3eb985a1449a842c4cbc6b054d8c" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.166712 12594 tablet_bootstrap.cc:439] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. W0401 16:41:34.168542 12355 leader_election.cc:348] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 691d7e738af946209181748f7c01636c (127.11.224.2:57495): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.171196 12593 raft_consensus.cc:340] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.172089 12593 raft_consensus.cc:366] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.172322 12593 raft_consensus.cc:705] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:34.173249 12593 consensus_queue.cc:229] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.176542 12593 ts_tablet_manager.cc:1081] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.028s user 0.001s sys 0.001s I0401 16:41:34.176723 12610 raft_consensus.cc:494] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.178872 12594 tablet_bootstrap.cc:590] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:34.179028 12601 raft_consensus.cc:472] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.182191 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3a5a3eb985a1449a842c4cbc6b054d8c" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" I0401 16:41:34.182651 12610 leader_election.cc:296] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Requested vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.183153 12541 raft_consensus.cc:2886] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.186200 12593 tablet_bootstrap.cc:439] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:34.184739 12601 raft_consensus.cc:494] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.182971 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3a5a3eb985a1449a842c4cbc6b054d8c" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.193912 12601 leader_election.cc:296] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680) W0401 16:41:34.194262 12355 leader_election.cc:348] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 691d7e738af946209181748f7c01636c (127.11.224.2:57495): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.220187 12541 raft_consensus.cc:2346] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 1. I0401 16:41:34.221846 12592 tablet_bootstrap.cc:590] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:34.219018 12399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "278fa1bb7726469ba58f4245848f1046" candidate_uuid: "691d7e738af946209181748f7c01636c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" is_pre_election: true I0401 16:41:34.221213 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a583f4e15144ad085e5373b90d24e01" candidate_uuid: "691d7e738af946209181748f7c01636c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" is_pre_election: true W0401 16:41:34.228477 12432 leader_election.cc:348] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.230136 12352 leader_election.cc:310] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: 691d7e738af946209181748f7c01636c W0401 16:41:34.231974 12432 leader_election.cc:348] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.234338 12593 tablet_bootstrap.cc:590] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:34.234778 12610 raft_consensus.cc:2640] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.236357 12610 raft_consensus.cc:667] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Becoming Leader. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Running, Role: LEADER I0401 16:41:34.236742 12610 consensus_queue.cc:206] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.252785 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "278fa1bb7726469ba58f4245848f1046" candidate_uuid: "691d7e738af946209181748f7c01636c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.253301 12541 raft_consensus.cc:2346] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 691d7e738af946209181748f7c01636c in term 0. I0401 16:41:34.255229 12432 leader_election.cc:310] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691d7e738af946209181748f7c01636c, ea22542beb2e4cf297a2b82c04c5485a; no voters: e6c51e0f80484ea1b328f8ba01762295 I0401 16:41:34.255540 12540 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a583f4e15144ad085e5373b90d24e01" candidate_uuid: "691d7e738af946209181748f7c01636c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.262452 12616 raft_consensus.cc:2640] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.267675 12616 raft_consensus.cc:472] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.268561 12616 raft_consensus.cc:2886] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 W0401 16:41:34.269428 12432 leader_election.cc:348] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.272349 12432 leader_election.cc:310] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691d7e738af946209181748f7c01636c; no voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a I0401 16:41:34.274744 12599 raft_consensus.cc:2588] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:34.275904 12300 catalog_manager.cc:3977] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 reported cstate change: term changed from 0 to 1, leader changed from to e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "e6c51e0f80484ea1b328f8ba01762295" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: UNKNOWN } } } I0401 16:41:34.280333 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3f24ded7ec9b44c4b1f69713686999c7" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" is_pre_election: true I0401 16:41:34.282485 12398 raft_consensus.cc:2307] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate ea22542beb2e4cf297a2b82c04c5485a for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:34.277607 12300 catalog_manager.cc:3977] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 reported cstate change: term changed from 0 to 1, leader changed from to e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "e6c51e0f80484ea1b328f8ba01762295" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: UNKNOWN } } } I0401 16:41:34.291956 12594 tablet_bootstrap.cc:439] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.292515 12594 ts_tablet_manager.cc:1053] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.129s user 0.005s sys 0.018s I0401 16:41:34.294222 12594 raft_consensus.cc:340] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.295006 12594 raft_consensus.cc:366] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.295202 12593 tablet_bootstrap.cc:439] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:34.295887 12594 raft_consensus.cc:705] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.297138 12594 consensus_queue.cc:229] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.298094 12594 ts_tablet_manager.cc:1081] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s I0401 16:41:34.299098 12593 ts_tablet_manager.cc:1053] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.119s user 0.003s sys 0.009s I0401 16:41:34.299626 12594 tablet_bootstrap.cc:439] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. I0401 16:41:34.305023 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3f24ded7ec9b44c4b1f69713686999c7" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.305733 12471 raft_consensus.cc:2276] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ea22542beb2e4cf297a2b82c04c5485a in current term 1: Already voted for candidate e6c51e0f80484ea1b328f8ba01762295 in this term. I0401 16:41:34.304678 12593 raft_consensus.cc:340] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.306416 12593 raft_consensus.cc:366] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.304674 12616 raft_consensus.cc:494] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.307338 12592 tablet_bootstrap.cc:439] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.307464 12505 leader_election.cc:310] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ea22542beb2e4cf297a2b82c04c5485a; no voters: 691d7e738af946209181748f7c01636c, e6c51e0f80484ea1b328f8ba01762295 I0401 16:41:34.307548 12592 ts_tablet_manager.cc:1053] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.143s user 0.002s sys 0.023s I0401 16:41:34.307919 12593 raft_consensus.cc:705] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:34.308158 12616 leader_election.cc:296] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 election: Requested vote from peers e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.308267 12601 raft_consensus.cc:2886] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.308606 12540 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "278fa1bb7726469ba58f4245848f1046" candidate_uuid: "691d7e738af946209181748f7c01636c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" I0401 16:41:34.308605 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "278fa1bb7726469ba58f4245848f1046" candidate_uuid: "691d7e738af946209181748f7c01636c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" I0401 16:41:34.309144 12540 raft_consensus.cc:2886] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.309149 12593 consensus_queue.cc:229] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } W0401 16:41:34.310456 12432 leader_election.cc:348] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.314216 12593 ts_tablet_manager.cc:1081] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s I0401 16:41:34.315615 12593 tablet_bootstrap.cc:439] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:34.316557 12594 tablet_bootstrap.cc:590] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:34.316581 12592 raft_consensus.cc:340] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.317447 12592 raft_consensus.cc:366] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.317780 12592 raft_consensus.cc:705] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.319021 12601 raft_consensus.cc:2588] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:34.318243 12592 consensus_queue.cc:229] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.319617 12540 raft_consensus.cc:2346] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 691d7e738af946209181748f7c01636c in term 1. I0401 16:41:34.320499 12432 leader_election.cc:310] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691d7e738af946209181748f7c01636c, ea22542beb2e4cf297a2b82c04c5485a; no voters: e6c51e0f80484ea1b328f8ba01762295 I0401 16:41:34.321044 12592 ts_tablet_manager.cc:1081] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.012s user 0.001s sys 0.002s I0401 16:41:34.322033 12616 raft_consensus.cc:2640] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.322546 12592 tablet_bootstrap.cc:439] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:34.322515 12616 raft_consensus.cc:667] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 1 LEADER]: Becoming Leader. State: Replica: 691d7e738af946209181748f7c01636c, State: Running, Role: LEADER I0401 16:41:34.323143 12616 consensus_queue.cc:206] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.326392 12593 tablet_bootstrap.cc:590] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:34.332356 12297 catalog_manager.cc:3977] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c reported cstate change: term changed from 0 to 1, leader changed from to 691d7e738af946209181748f7c01636c (127.11.224.2). New cstate: current_term: 1 leader_uuid: "691d7e738af946209181748f7c01636c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: UNKNOWN } } } I0401 16:41:34.333832 12592 tablet_bootstrap.cc:590] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:34.343181 12594 tablet_bootstrap.cc:439] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.343487 12594 ts_tablet_manager.cc:1053] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.011s I0401 16:41:34.347251 12594 raft_consensus.cc:340] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.348060 12594 raft_consensus.cc:366] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.348363 12594 raft_consensus.cc:705] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.348626 12594 consensus_queue.cc:229] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.352815 12594 ts_tablet_manager.cc:1081] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s I0401 16:41:34.353242 12594 tablet_bootstrap.cc:439] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. I0401 16:41:34.354651 12593 tablet_bootstrap.cc:439] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:34.355257 12593 ts_tablet_manager.cc:1053] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.009s I0401 16:41:34.357642 12593 raft_consensus.cc:340] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.358187 12593 raft_consensus.cc:366] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.358309 12593 raft_consensus.cc:705] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:34.359576 12592 tablet_bootstrap.cc:439] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.359916 12592 ts_tablet_manager.cc:1053] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.009s I0401 16:41:34.359910 12593 consensus_queue.cc:229] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.361366 12594 tablet_bootstrap.cc:590] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:34.362362 12592 raft_consensus.cc:340] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.362855 12592 raft_consensus.cc:366] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.363263 12592 raft_consensus.cc:705] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.363334 12593 ts_tablet_manager.cc:1081] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s I0401 16:41:34.363833 12593 tablet_bootstrap.cc:439] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:34.364114 12592 consensus_queue.cc:229] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.369776 12593 tablet_bootstrap.cc:590] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:34.370694 12592 ts_tablet_manager.cc:1081] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s I0401 16:41:34.371222 12592 tablet_bootstrap.cc:439] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:34.375627 12592 tablet_bootstrap.cc:590] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:34.378610 12594 tablet_bootstrap.cc:439] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.379946 12594 ts_tablet_manager.cc:1053] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.027s user 0.005s sys 0.008s I0401 16:41:34.380136 12593 tablet_bootstrap.cc:439] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:34.380355 12593 ts_tablet_manager.cc:1053] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.007s I0401 16:41:34.383348 12593 raft_consensus.cc:340] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.383880 12592 tablet_bootstrap.cc:439] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.383882 12593 raft_consensus.cc:366] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.384176 12593 raft_consensus.cc:705] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:34.384246 12592 ts_tablet_manager.cc:1053] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.005s I0401 16:41:34.384572 12593 consensus_queue.cc:229] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.387220 12593 ts_tablet_manager.cc:1081] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s I0401 16:41:34.385448 12594 raft_consensus.cc:340] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.388495 12594 raft_consensus.cc:366] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.388940 12594 raft_consensus.cc:705] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.386550 12592 raft_consensus.cc:340] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.389827 12593 tablet_bootstrap.cc:439] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:34.390544 12592 raft_consensus.cc:366] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.391312 12592 raft_consensus.cc:705] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.391178 12594 consensus_queue.cc:229] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.395685 12594 ts_tablet_manager.cc:1081] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s I0401 16:41:34.396013 12592 consensus_queue.cc:229] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.396618 12594 tablet_bootstrap.cc:439] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. I0401 16:41:34.397419 12593 tablet_bootstrap.cc:590] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:34.397233 12592 ts_tablet_manager.cc:1081] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.013s user 0.002s sys 0.001s I0401 16:41:34.400291 12592 tablet_bootstrap.cc:439] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:34.402523 12594 tablet_bootstrap.cc:590] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:34.405107 12592 tablet_bootstrap.cc:590] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:34.407492 12593 tablet_bootstrap.cc:439] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:34.408037 12593 ts_tablet_manager.cc:1053] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.005s I0401 16:41:34.410746 12593 raft_consensus.cc:340] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.412658 12593 raft_consensus.cc:366] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.413044 12593 raft_consensus.cc:705] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:34.414275 12593 consensus_queue.cc:229] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.416059 12592 tablet_bootstrap.cc:439] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.416646 12592 ts_tablet_manager.cc:1053] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.018s user 0.002s sys 0.003s I0401 16:41:34.419323 12593 ts_tablet_manager.cc:1081] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s I0401 16:41:34.419853 12593 tablet_bootstrap.cc:439] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:34.421334 12592 raft_consensus.cc:340] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.422008 12610 raft_consensus.cc:472] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.422421 12592 raft_consensus.cc:366] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.422612 12592 raft_consensus.cc:705] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.422523 12610 raft_consensus.cc:494] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.423061 12592 consensus_queue.cc:229] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.423902 12610 leader_election.cc:296] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.424612 12540 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "19de4523dc8b4ed68f5e3ddab4128579" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.425238 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "19de4523dc8b4ed68f5e3ddab4128579" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true W0401 16:41:34.425292 12352 leader_election.cc:348] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.425694 12471 raft_consensus.cc:2346] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 0. I0401 16:41:34.427067 12355 leader_election.cc:310] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691d7e738af946209181748f7c01636c, e6c51e0f80484ea1b328f8ba01762295; no voters: ea22542beb2e4cf297a2b82c04c5485a I0401 16:41:34.427392 12610 raft_consensus.cc:2640] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.427825 12610 raft_consensus.cc:472] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.427983 12610 raft_consensus.cc:2886] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.427825 12592 ts_tablet_manager.cc:1081] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s I0401 16:41:34.430495 12593 tablet_bootstrap.cc:590] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:34.431221 12592 tablet_bootstrap.cc:439] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:34.431766 12594 tablet_bootstrap.cc:439] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.433130 12611 raft_consensus.cc:472] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.433269 12611 raft_consensus.cc:494] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.433723 12594 ts_tablet_manager.cc:1053] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.036s user 0.001s sys 0.012s I0401 16:41:34.434824 12610 raft_consensus.cc:494] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.435340 12611 leader_election.cc:296] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.434824 12540 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9528934d3883467d973e249b3542e541" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.435199 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9528934d3883467d973e249b3542e541" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.436026 12471 raft_consensus.cc:2346] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 0. W0401 16:41:34.436125 12352 leader_election.cc:348] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.436377 12355 leader_election.cc:310] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691d7e738af946209181748f7c01636c, e6c51e0f80484ea1b328f8ba01762295; no voters: ea22542beb2e4cf297a2b82c04c5485a I0401 16:41:34.436826 12611 raft_consensus.cc:2640] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.438910 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "19de4523dc8b4ed68f5e3ddab4128579" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.439060 12611 raft_consensus.cc:472] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.439128 12610 leader_election.cc:296] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Requested vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.440158 12471 raft_consensus.cc:2886] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.440155 12540 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "19de4523dc8b4ed68f5e3ddab4128579" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" I0401 16:41:34.440459 12611 raft_consensus.cc:2886] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.441062 12594 raft_consensus.cc:340] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.442498 12594 raft_consensus.cc:366] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.444617 12594 raft_consensus.cc:705] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.445307 12592 tablet_bootstrap.cc:590] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:34.446007 12593 tablet_bootstrap.cc:439] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:34.446385 12593 ts_tablet_manager.cc:1053] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.007s I0401 16:41:34.446385 12594 consensus_queue.cc:229] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.447022 12540 raft_consensus.cc:2886] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.447840 12593 raft_consensus.cc:340] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.454094 12593 raft_consensus.cc:366] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.448850 12611 raft_consensus.cc:494] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.456312 12601 raft_consensus.cc:472] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.461148 12593 raft_consensus.cc:705] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:34.461400 12601 raft_consensus.cc:494] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.465602 12611 leader_election.cc:296] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Requested vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.465628 12471 raft_consensus.cc:2346] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 1. I0401 16:41:34.466409 12593 consensus_queue.cc:229] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.469962 12601 leader_election.cc:296] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680) I0401 16:41:34.469998 12355 leader_election.cc:310] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691d7e738af946209181748f7c01636c, e6c51e0f80484ea1b328f8ba01762295; no voters: I0401 16:41:34.471277 12601 raft_consensus.cc:472] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.467703 12470 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9528934d3883467d973e249b3542e541" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.472878 12470 raft_consensus.cc:2886] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.472960 12601 raft_consensus.cc:494] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.474122 12592 tablet_bootstrap.cc:439] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.474220 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "179f7d444d934e97b7d1600583addb41" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" is_pre_election: true I0401 16:41:34.474438 12592 ts_tablet_manager.cc:1053] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.045s user 0.003s sys 0.008s I0401 16:41:34.474442 12398 raft_consensus.cc:2346] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 0. I0401 16:41:34.475632 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "179f7d444d934e97b7d1600583addb41" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.475870 12611 raft_consensus.cc:2640] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.476197 12502 leader_election.cc:310] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.477680 12601 leader_election.cc:296] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680), 691d7e738af946209181748f7c01636c (127.11.224.2:57495) I0401 16:41:34.477764 12471 raft_consensus.cc:2346] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 0. I0401 16:41:34.477948 12593 ts_tablet_manager.cc:1081] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.024s user 0.001s sys 0.002s I0401 16:41:34.478508 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "cf2344da4a8848a79e815e6f1306547a" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" is_pre_election: true I0401 16:41:34.479027 12611 raft_consensus.cc:667] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Becoming Leader. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Running, Role: LEADER I0401 16:41:34.480203 12398 raft_consensus.cc:2346] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 0. I0401 16:41:34.480790 12601 raft_consensus.cc:2640] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.480862 12593 tablet_bootstrap.cc:439] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295: Bootstrap starting. I0401 16:41:34.481317 12611 consensus_queue.cc:206] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.478505 12469 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "cf2344da4a8848a79e815e6f1306547a" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.481988 12502 leader_election.cc:310] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.483886 12540 raft_consensus.cc:2346] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 1. I0401 16:41:34.484014 12601 raft_consensus.cc:472] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.484174 12601 raft_consensus.cc:2886] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.484397 12469 raft_consensus.cc:2346] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 0. I0401 16:41:34.487897 12592 raft_consensus.cc:340] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.488334 12592 raft_consensus.cc:366] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.488932 12592 raft_consensus.cc:705] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.488930 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9528934d3883467d973e249b3542e541" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" W0401 16:41:34.489955 12352 leader_election.cc:348] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:34.494529 12470 raft_consensus.cc:2346] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 1. I0401 16:41:34.490295 12592 consensus_queue.cc:229] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.493971 12601 raft_consensus.cc:494] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.495748 12355 leader_election.cc:310] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 691d7e738af946209181748f7c01636c, e6c51e0f80484ea1b328f8ba01762295; no voters: ea22542beb2e4cf297a2b82c04c5485a I0401 16:41:34.499511 12610 raft_consensus.cc:2640] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.499691 12601 leader_election.cc:296] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 election: Requested vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680) I0401 16:41:34.501521 12470 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "179f7d444d934e97b7d1600583addb41" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.501627 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "179f7d444d934e97b7d1600583addb41" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" I0401 16:41:34.498405 12646 raft_consensus.cc:2640] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.503355 12610 raft_consensus.cc:667] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Becoming Leader. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Running, Role: LEADER I0401 16:41:34.503799 12594 ts_tablet_manager.cc:1081] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.065s user 0.003s sys 0.005s I0401 16:41:34.504380 12592 ts_tablet_manager.cc:1081] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.025s user 0.002s sys 0.002s I0401 16:41:34.504735 12398 raft_consensus.cc:2886] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.505475 12470 raft_consensus.cc:2886] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.506089 12610 consensus_queue.cc:206] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.502843 12648 raft_consensus.cc:472] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.507650 12592 tablet_bootstrap.cc:439] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c: Bootstrap starting. I0401 16:41:34.508177 12593 tablet_bootstrap.cc:590] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295: No blocks or log segments found. Creating new log. I0401 16:41:34.505136 12646 raft_consensus.cc:472] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.511884 12594 tablet_bootstrap.cc:439] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a: Bootstrap starting. I0401 16:41:34.513947 12298 catalog_manager.cc:3977] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 reported cstate change: term changed from 0 to 1, leader changed from to e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "e6c51e0f80484ea1b328f8ba01762295" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: UNKNOWN } } } I0401 16:41:34.516031 12611 raft_consensus.cc:472] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.516305 12646 raft_consensus.cc:2886] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.523983 12611 raft_consensus.cc:494] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.526621 12398 raft_consensus.cc:2346] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 1. I0401 16:41:34.515862 12648 raft_consensus.cc:494] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.527933 12469 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a583f4e15144ad085e5373b90d24e01" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.528154 12469 raft_consensus.cc:2346] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 0. I0401 16:41:34.527933 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a583f4e15144ad085e5373b90d24e01" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.529124 12300 catalog_manager.cc:3977] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 reported cstate change: term changed from 0 to 1, leader changed from to e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "e6c51e0f80484ea1b328f8ba01762295" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: UNKNOWN } } } I0401 16:41:34.530289 12611 leader_election.cc:296] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.531107 12541 raft_consensus.cc:2346] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 0. I0401 16:41:34.531971 12469 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "58213f99590747369b50a74ed52178f4" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" is_pre_election: true I0401 16:41:34.532143 12469 raft_consensus.cc:2346] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 0. I0401 16:41:34.531455 12355 leader_election.cc:310] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691d7e738af946209181748f7c01636c, e6c51e0f80484ea1b328f8ba01762295; no voters: I0401 16:41:34.532733 12502 leader_election.cc:310] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.534623 12505 leader_election.cc:310] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 691d7e738af946209181748f7c01636c, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.536284 12601 raft_consensus.cc:2640] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.542057 12611 raft_consensus.cc:2640] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.533677 12648 leader_election.cc:296] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680) I0401 16:41:34.543656 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "58213f99590747369b50a74ed52178f4" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" is_pre_election: true I0401 16:41:34.546456 12611 raft_consensus.cc:472] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.547708 12648 raft_consensus.cc:2640] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:34.548657 12648 raft_consensus.cc:472] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:34.548828 12648 raft_consensus.cc:2886] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.549089 12470 raft_consensus.cc:2346] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 1. I0401 16:41:34.549407 12398 raft_consensus.cc:2346] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 0. I0401 16:41:34.552633 12611 raft_consensus.cc:2886] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.558362 12594 tablet_bootstrap.cc:590] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a: No blocks or log segments found. Creating new log. I0401 16:41:34.560005 12601 raft_consensus.cc:667] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 1 LEADER]: Becoming Leader. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Running, Role: LEADER I0401 16:41:34.561177 12592 tablet_bootstrap.cc:590] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c: No blocks or log segments found. Creating new log. I0401 16:41:34.563127 12601 consensus_queue.cc:206] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.564579 12648 raft_consensus.cc:494] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.566344 12648 leader_election.cc:296] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 election: Requested vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680) I0401 16:41:34.566586 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "58213f99590747369b50a74ed52178f4" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" I0401 16:41:34.568166 12398 raft_consensus.cc:2886] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.569514 12470 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "58213f99590747369b50a74ed52178f4" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.570010 12470 raft_consensus.cc:2886] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.573570 12593 tablet_bootstrap.cc:439] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295: No bootstrap required, opened a new log I0401 16:41:34.576900 12593 ts_tablet_manager.cc:1053] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295: Time spent bootstrapping tablet: real 0.096s user 0.003s sys 0.006s I0401 16:41:34.579144 12594 tablet_bootstrap.cc:439] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a: No bootstrap required, opened a new log I0401 16:41:34.579787 12594 ts_tablet_manager.cc:1053] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.007s I0401 16:41:34.583274 12398 raft_consensus.cc:2346] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 1. I0401 16:41:34.583665 12502 leader_election.cc:310] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.585747 12648 raft_consensus.cc:2640] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.586158 12648 raft_consensus.cc:667] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 1 LEADER]: Becoming Leader. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Running, Role: LEADER I0401 16:41:34.587839 12593 raft_consensus.cc:340] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.588449 12593 raft_consensus.cc:366] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.580832 12646 raft_consensus.cc:494] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.590618 12470 raft_consensus.cc:2346] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 1. I0401 16:41:34.590879 12593 raft_consensus.cc:705] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Initialized, Role: FOLLOWER I0401 16:41:34.588572 12648 consensus_queue.cc:206] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.594352 12593 consensus_queue.cc:229] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.595825 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "cf2344da4a8848a79e815e6f1306547a" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" I0401 16:41:34.600597 12646 leader_election.cc:296] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 election: Requested vote from peers e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680), 691d7e738af946209181748f7c01636c (127.11.224.2:57495) I0401 16:41:34.597128 12470 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "cf2344da4a8848a79e815e6f1306547a" candidate_uuid: "ea22542beb2e4cf297a2b82c04c5485a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.600977 12398 raft_consensus.cc:2886] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.603987 12470 raft_consensus.cc:2886] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.604593 12541 raft_consensus.cc:1181] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.605307 12597 consensus_queue.cc:984] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:34.606534 12593 ts_tablet_manager.cc:1081] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295: Time spent starting tablet: real 0.026s user 0.002s sys 0.001s I0401 16:41:34.606525 12594 raft_consensus.cc:340] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.606525 12469 raft_consensus.cc:1181] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.607627 12594 raft_consensus.cc:366] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.607772 12594 raft_consensus.cc:705] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Initialized, Role: FOLLOWER I0401 16:41:34.608750 12592 tablet_bootstrap.cc:439] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c: No bootstrap required, opened a new log I0401 16:41:34.609105 12611 raft_consensus.cc:494] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.607898 12300 catalog_manager.cc:3977] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a reported cstate change: term changed from 0 to 1, leader changed from to ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3). New cstate: current_term: 1 leader_uuid: "ea22542beb2e4cf297a2b82c04c5485a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: HEALTHY } } } I0401 16:41:34.610688 12594 consensus_queue.cc:229] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.612972 12540 raft_consensus.cc:1181] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.613359 12610 consensus_queue.cc:984] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s I0401 16:41:34.615705 12592 ts_tablet_manager.cc:1053] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c: Time spent bootstrapping tablet: real 0.104s user 0.008s sys 0.017s I0401 16:41:34.620424 12610 consensus_queue.cc:984] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s I0401 16:41:34.624183 12540 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a583f4e15144ad085e5373b90d24e01" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" I0401 16:41:34.624773 12611 leader_election.cc:296] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Requested vote from peers 691d7e738af946209181748f7c01636c (127.11.224.2:57495), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.625301 12540 raft_consensus.cc:2886] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.623355 12471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a583f4e15144ad085e5373b90d24e01" candidate_uuid: "e6c51e0f80484ea1b328f8ba01762295" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "691d7e738af946209181748f7c01636c" I0401 16:41:34.626857 12398 raft_consensus.cc:2346] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 1. I0401 16:41:34.627480 12594 ts_tablet_manager.cc:1081] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a: Time spent starting tablet: real 0.043s user 0.000s sys 0.003s I0401 16:41:34.629467 12471 raft_consensus.cc:2886] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.631705 12502 leader_election.cc:310] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.634475 12648 raft_consensus.cc:2640] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.635743 12648 raft_consensus.cc:667] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 1 LEADER]: Becoming Leader. State: Replica: ea22542beb2e4cf297a2b82c04c5485a, State: Running, Role: LEADER I0401 16:41:34.636202 12470 raft_consensus.cc:2346] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ea22542beb2e4cf297a2b82c04c5485a in term 1. I0401 16:41:34.636068 12648 consensus_queue.cc:206] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.638767 12592 raft_consensus.cc:340] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.646329 12538 raft_consensus.cc:1181] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.646749 12592 raft_consensus.cc:366] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:34.651345 12592 raft_consensus.cc:705] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 691d7e738af946209181748f7c01636c, State: Initialized, Role: FOLLOWER I0401 16:41:34.651199 12300 catalog_manager.cc:3977] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a reported cstate change: term changed from 0 to 1, leader changed from to ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3). New cstate: current_term: 1 leader_uuid: "ea22542beb2e4cf297a2b82c04c5485a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: HEALTHY } } } I0401 16:41:34.653349 12611 consensus_queue.cc:984] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s I0401 16:41:34.653959 12540 raft_consensus.cc:2346] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 1. I0401 16:41:34.655221 12592 consensus_queue.cc:229] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.656074 12471 raft_consensus.cc:2346] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e6c51e0f80484ea1b328f8ba01762295 in term 1. I0401 16:41:34.661038 12352 leader_election.cc:310] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a; no voters: I0401 16:41:34.667249 12611 raft_consensus.cc:2640] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:34.669797 12592 ts_tablet_manager.cc:1081] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c: Time spent starting tablet: real 0.050s user 0.002s sys 0.000s I0401 16:41:34.671710 12611 raft_consensus.cc:667] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Becoming Leader. State: Replica: e6c51e0f80484ea1b328f8ba01762295, State: Running, Role: LEADER I0401 16:41:34.675321 12611 consensus_queue.cc:206] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.722508 12298 catalog_manager.cc:3977] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a reported cstate change: term changed from 0 to 1, leader changed from to ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3). New cstate: current_term: 1 leader_uuid: "ea22542beb2e4cf297a2b82c04c5485a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: HEALTHY } } } I0401 16:41:34.728873 12469 raft_consensus.cc:2886] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.733548 12616 raft_consensus.cc:472] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:34.736670 12616 raft_consensus.cc:494] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } } peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } } I0401 16:41:34.740284 12616 leader_election.cc:296] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1:47680), ea22542beb2e4cf297a2b82c04c5485a (127.11.224.3:41712) I0401 16:41:34.740973 12541 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3a5a3eb985a1449a842c4cbc6b054d8c" candidate_uuid: "691d7e738af946209181748f7c01636c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ea22542beb2e4cf297a2b82c04c5485a" is_pre_election: true I0401 16:41:34.739893 12398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3a5a3eb985a1449a842c4cbc6b054d8c" candidate_uuid: "691d7e738af946209181748f7c01636c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e6c51e0f80484ea1b328f8ba01762295" is_pre_election: true I0401 16:41:34.742123 12398 raft_consensus.cc:2307] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 691d7e738af946209181748f7c01636c for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:34.744873 12541 raft_consensus.cc:2307] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 691d7e738af946209181748f7c01636c for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:34.745812 12471 raft_consensus.cc:2886] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.749344 12298 catalog_manager.cc:3977] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 reported cstate change: term changed from 0 to 1, leader changed from to e6c51e0f80484ea1b328f8ba01762295 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "e6c51e0f80484ea1b328f8ba01762295" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 } health_report { overall_health: UNKNOWN } } } I0401 16:41:34.750164 12432 leader_election.cc:310] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 691d7e738af946209181748f7c01636c; no voters: e6c51e0f80484ea1b328f8ba01762295, ea22542beb2e4cf297a2b82c04c5485a I0401 16:41:34.753617 12469 raft_consensus.cc:1181] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.754653 12671 consensus_queue.cc:984] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:34.757243 12471 raft_consensus.cc:1181] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.757449 12616 raft_consensus.cc:2588] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:34.758046 12671 consensus_queue.cc:984] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:34.825865 12398 raft_consensus.cc:2886] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.828974 12398 raft_consensus.cc:1181] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Refusing update from remote peer 691d7e738af946209181748f7c01636c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.829574 12616 consensus_queue.cc:984] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:34.837414 12539 raft_consensus.cc:1181] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Refusing update from remote peer 691d7e738af946209181748f7c01636c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.838706 12599 consensus_queue.cc:984] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:34.890812 12469 raft_consensus.cc:1181] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.891297 12671 consensus_queue.cc:984] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:34.897192 12539 raft_consensus.cc:1181] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.898933 12611 consensus_queue.cc:984] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:34.918735 12539 raft_consensus.cc:2886] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:34.920779 12539 raft_consensus.cc:1181] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.921727 12611 consensus_queue.cc:984] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:34.928041 12469 raft_consensus.cc:1181] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.928598 12669 consensus_queue.cc:984] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:34.995054 12469 raft_consensus.cc:1181] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer ea22542beb2e4cf297a2b82c04c5485a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:34.995543 12648 consensus_queue.cc:984] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:35.002784 12398 raft_consensus.cc:1181] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Refusing update from remote peer ea22542beb2e4cf297a2b82c04c5485a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:35.004595 12646 consensus_queue.cc:984] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:35.097612 12539 raft_consensus.cc:1181] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:35.098204 12669 consensus_queue.cc:984] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ea22542beb2e4cf297a2b82c04c5485a" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41712 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:35.102689 12398 raft_consensus.cc:1181] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Refusing update from remote peer ea22542beb2e4cf297a2b82c04c5485a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:35.103174 12648 consensus_queue.cc:984] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:35.124591 12469 raft_consensus.cc:1181] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer ea22542beb2e4cf297a2b82c04c5485a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:35.127157 12648 consensus_queue.cc:984] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:35.138624 12471 raft_consensus.cc:1181] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer e6c51e0f80484ea1b328f8ba01762295: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:35.140285 12671 consensus_queue.cc:984] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:35.210711 12471 raft_consensus.cc:1181] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Refusing update from remote peer ea22542beb2e4cf297a2b82c04c5485a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:35.211315 12648 consensus_queue.cc:984] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Connected to new peer: Peer: permanent_uuid: "691d7e738af946209181748f7c01636c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 57495 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:35.223580 12398 raft_consensus.cc:1181] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Refusing update from remote peer ea22542beb2e4cf297a2b82c04c5485a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:35.224656 12648 consensus_queue.cc:984] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [LEADER]: Connected to new peer: Peer: permanent_uuid: "e6c51e0f80484ea1b328f8ba01762295" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 47680 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:35.249172 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:35.276319 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:35.276595 12160 tablet_replica.cc:264] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.277022 12160 raft_consensus.cc:2143] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.277230 12160 raft_consensus.cc:2170] T 58213f99590747369b50a74ed52178f4 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.278705 12160 tablet_replica.cc:264] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.278822 12160 raft_consensus.cc:2143] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.279110 12160 raft_consensus.cc:2170] T 19de4523dc8b4ed68f5e3ddab4128579 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.279650 12160 tablet_replica.cc:264] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.279788 12160 raft_consensus.cc:2143] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.279929 12160 raft_consensus.cc:2170] T cf2344da4a8848a79e815e6f1306547a P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.280503 12160 tablet_replica.cc:264] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.280601 12160 raft_consensus.cc:2143] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.280768 12160 raft_consensus.cc:2170] T 9528934d3883467d973e249b3542e541 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.281522 12160 tablet_replica.cc:264] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.281630 12160 raft_consensus.cc:2143] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.281719 12160 raft_consensus.cc:2170] T 278fa1bb7726469ba58f4245848f1046 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.282433 12160 tablet_replica.cc:264] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.282596 12160 raft_consensus.cc:2143] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.282809 12160 raft_consensus.cc:2170] T 3a5a3eb985a1449a842c4cbc6b054d8c P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.283680 12160 tablet_replica.cc:264] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.283783 12160 raft_consensus.cc:2143] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.283969 12160 raft_consensus.cc:2170] T 8a583f4e15144ad085e5373b90d24e01 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.284765 12160 tablet_replica.cc:264] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.284960 12160 raft_consensus.cc:2143] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.285152 12160 raft_consensus.cc:2170] T 3f24ded7ec9b44c4b1f69713686999c7 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.285939 12160 tablet_replica.cc:264] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.286265 12160 raft_consensus.cc:2143] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.286461 12160 raft_consensus.cc:2170] T 179f7d444d934e97b7d1600583addb41 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.287544 12160 tablet_replica.cc:264] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295: stopping tablet replica I0401 16:41:35.287676 12160 raft_consensus.cc:2143] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.287899 12160 raft_consensus.cc:2170] T 1d9ff322fafe44b49647e1d0a461a9a8 P e6c51e0f80484ea1b328f8ba01762295 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.306694 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:35.306836 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:35.306990 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:35.313042 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:35.327958 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:35.328081 12160 tablet_replica.cc:264] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.328212 12160 raft_consensus.cc:2143] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.328336 12160 raft_consensus.cc:2170] T 9528934d3883467d973e249b3542e541 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.329212 12160 tablet_replica.cc:264] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.329320 12160 raft_consensus.cc:2143] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.329411 12160 raft_consensus.cc:2170] T cf2344da4a8848a79e815e6f1306547a P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.330004 12160 tablet_replica.cc:264] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.330104 12160 raft_consensus.cc:2143] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.330200 12160 raft_consensus.cc:2170] T 1d9ff322fafe44b49647e1d0a461a9a8 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.330790 12160 tablet_replica.cc:264] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.330899 12160 raft_consensus.cc:2143] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.330987 12160 raft_consensus.cc:2170] T 179f7d444d934e97b7d1600583addb41 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.331673 12160 tablet_replica.cc:264] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.331826 12160 raft_consensus.cc:2143] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.331959 12160 raft_consensus.cc:2170] T 58213f99590747369b50a74ed52178f4 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.333102 12160 tablet_replica.cc:264] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.333452 12160 raft_consensus.cc:2143] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.333572 12160 raft_consensus.cc:2170] T 19de4523dc8b4ed68f5e3ddab4128579 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.334300 12160 tablet_replica.cc:264] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.334396 12160 raft_consensus.cc:2143] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.334492 12160 raft_consensus.cc:2170] T 3a5a3eb985a1449a842c4cbc6b054d8c P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.335193 12160 tablet_replica.cc:264] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.335295 12160 raft_consensus.cc:2143] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.335484 12160 raft_consensus.cc:2170] T 278fa1bb7726469ba58f4245848f1046 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.336161 12160 tablet_replica.cc:264] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.336257 12160 raft_consensus.cc:2143] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.336351 12160 raft_consensus.cc:2170] T 3f24ded7ec9b44c4b1f69713686999c7 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.337052 12160 tablet_replica.cc:264] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c: stopping tablet replica I0401 16:41:35.337153 12160 raft_consensus.cc:2143] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.337242 12160 raft_consensus.cc:2170] T 8a583f4e15144ad085e5373b90d24e01 P 691d7e738af946209181748f7c01636c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.353693 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:35.353754 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:35.353947 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:35.358335 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:35.373159 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:35.373276 12160 tablet_replica.cc:264] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.373479 12160 raft_consensus.cc:2143] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.373605 12160 raft_consensus.cc:2170] T 9528934d3883467d973e249b3542e541 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.374387 12160 tablet_replica.cc:264] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.374475 12160 raft_consensus.cc:2143] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.374563 12160 raft_consensus.cc:2170] T 19de4523dc8b4ed68f5e3ddab4128579 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.375176 12160 tablet_replica.cc:264] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.375270 12160 raft_consensus.cc:2143] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.375458 12160 raft_consensus.cc:2170] T 58213f99590747369b50a74ed52178f4 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.376011 12160 tablet_replica.cc:264] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.376094 12160 raft_consensus.cc:2143] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.376250 12160 raft_consensus.cc:2170] T cf2344da4a8848a79e815e6f1306547a P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.376868 12160 tablet_replica.cc:264] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.376973 12160 raft_consensus.cc:2143] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.377058 12160 raft_consensus.cc:2170] T 8a583f4e15144ad085e5373b90d24e01 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.377739 12160 tablet_replica.cc:264] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.377822 12160 raft_consensus.cc:2143] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.377934 12160 raft_consensus.cc:2170] T 3f24ded7ec9b44c4b1f69713686999c7 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.378520 12160 tablet_replica.cc:264] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.378607 12160 raft_consensus.cc:2143] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.378684 12160 raft_consensus.cc:2170] T 278fa1bb7726469ba58f4245848f1046 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.379266 12160 tablet_replica.cc:264] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.379346 12160 raft_consensus.cc:2143] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.379432 12160 raft_consensus.cc:2170] T 3a5a3eb985a1449a842c4cbc6b054d8c P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.380084 12160 tablet_replica.cc:264] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.380169 12160 raft_consensus.cc:2143] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.380249 12160 raft_consensus.cc:2170] T 1d9ff322fafe44b49647e1d0a461a9a8 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.380779 12160 tablet_replica.cc:264] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a: stopping tablet replica I0401 16:41:35.380872 12160 raft_consensus.cc:2143] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.381043 12160 raft_consensus.cc:2170] T 179f7d444d934e97b7d1600583addb41 P ea22542beb2e4cf297a2b82c04c5485a [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.397019 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:35.397066 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:35.397202 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:35.400624 12160 master.cc:270] Master@127.11.224.62:58248 shutting down... I0401 16:41:35.410598 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.410734 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.410835 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 6c091e7d3a92407c899173d47c5e9f2d: stopping tablet replica I0401 16:41:35.424377 12160 master.cc:281] Master@127.11.224.62:58248 shutdown complete. I0401 16:41:35.427230 12160 master.cc:270] Master@127.11.224.61:51035 shutting down... I0401 16:41:35.437711 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:35.437871 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.437961 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P a8bb772d23844fb38e2f7ac70789393c: stopping tablet replica I0401 16:41:35.451525 12160 master.cc:281] Master@127.11.224.61:51035 shutdown complete. I0401 16:41:35.454243 12160 master.cc:270] Master@127.11.224.60:60032 shutting down... I0401 16:41:35.466743 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:35.467051 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:35.467134 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 997fe12c9d23427eaf9f8c2e6a18eb89: stopping tablet replica I0401 16:41:35.470759 12160 master.cc:281] Master@127.11.224.60:60032 shutdown complete. [ OK ] RemoteKsckTest.TestClusterOk (3096 ms) [ RUN ] RemoteKsckTest.TestCheckUnusualFlags I0401 16:41:35.490430 12160 test_util.cc:212] Using random seed: -1885338255 I0401 16:41:35.491017 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:47883,127.11.224.61:55560,127.11.224.60:50532 I0401 16:41:35.494258 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 837931us I0401 16:41:35.494418 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:35.494457 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:35.494542 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:35.494575 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:35.495121 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "d2204fb616014e5c944c1d7538ec0efc" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.499133 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s I0401 16:41:35.499822 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:35.501646 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:35.501703 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-0-root uuid: "d2204fb616014e5c944c1d7538ec0efc" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.501772 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:35.549705 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:47883 I0401 16:41:35.550456 12160 webserver.cc:308] Webserver started at http://127.11.224.62:59146/ using document root and password file I0401 16:41:35.551638 12773 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:35.553807 12773 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:35.554340 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 837931us I0401 16:41:35.554549 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:35.555240 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:35.555629 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:35.555999 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:35.556809 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "9e4b1b33f83944a09262a70c9b11c5d6" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.561058 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s I0401 16:41:35.561718 12773 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:35.562289 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 W0401 16:41:35.562734 12773 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:55560: Network error: Client connection negotiation failed: client connection to 127.11.224.61:55560: connect: Connection refused (error 111) I0401 16:41:35.564360 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:35.564412 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-1-root uuid: "9e4b1b33f83944a09262a70c9b11c5d6" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.564503 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:35.584967 12773 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } attempt: 1 W0401 16:41:35.586477 12773 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:55560: Network error: Client connection negotiation failed: client connection to 127.11.224.61:55560: connect: Connection refused (error 111) I0401 16:41:35.590134 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:55560 I0401 16:41:35.590900 12160 webserver.cc:308] Webserver started at http://127.11.224.61:56138/ using document root and password file I0401 16:41:35.592046 12830 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:35.594204 12830 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:35.595078 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 837931us I0401 16:41:35.595449 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:35.595568 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:35.595754 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:35.595866 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:35.596695 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "1f9ec791a501435eab0d7b2836d621cb" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.600705 12830 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:35.602362 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.001s sys 0.002s I0401 16:41:35.603722 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:35.606338 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:35.606456 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-2-root uuid: "1f9ec791a501435eab0d7b2836d621cb" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.606590 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:35.607756 12830 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:35.609463 12830 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:50532: Network error: Client connection negotiation failed: client connection to 127.11.224.60:50532: connect: Connection refused (error 111) I0401 16:41:35.636987 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:50532 I0401 16:41:35.637745 12160 webserver.cc:308] Webserver started at http://127.11.224.60:55679/ using document root and password file I0401 16:41:35.638137 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:35.638782 12887 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:35.640693 12887 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:35.645781 12887 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:35.649994 12887 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:35.656260 12887 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb: Bootstrap starting. I0401 16:41:35.657425 12887 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb: No blocks or log segments found. Creating new log. I0401 16:41:35.659215 12887 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb: No bootstrap required, opened a new log I0401 16:41:35.659833 12887 raft_consensus.cc:340] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.660023 12887 raft_consensus.cc:366] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:35.660091 12887 raft_consensus.cc:705] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f9ec791a501435eab0d7b2836d621cb, State: Initialized, Role: FOLLOWER I0401 16:41:35.660310 12887 consensus_queue.cc:229] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.660727 12830 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } attempt: 1 I0401 16:41:35.660835 12891 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.661206 12891 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.660853 12887 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.661414 12887 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.661980 12887 sys_catalog.cc:424] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:35.663763 12773 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } attempt: 2 W0401 16:41:35.664757 12892 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:35.664949 12892 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:35.668885 12830 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6: Bootstrap starting. I0401 16:41:35.669924 12830 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6: No blocks or log segments found. Creating new log. I0401 16:41:35.672015 12830 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6: No bootstrap required, opened a new log I0401 16:41:35.671991 12773 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:35.673055 12830 raft_consensus.cc:340] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.673342 12830 raft_consensus.cc:366] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:35.673451 12830 raft_consensus.cc:705] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e4b1b33f83944a09262a70c9b11c5d6, State: Initialized, Role: FOLLOWER I0401 16:41:35.673813 12830 consensus_queue.cc:229] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.674566 12830 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.674896 12830 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.674705 12894 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.675211 12894 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.675547 12830 sys_catalog.cc:424] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: configured and running, proceeding with master startup. W0401 16:41:35.677917 12895 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:35.678020 12895 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:35.679663 12773 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc: Bootstrap starting. I0401 16:41:35.680724 12773 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc: No blocks or log segments found. Creating new log. I0401 16:41:35.682212 12773 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc: No bootstrap required, opened a new log I0401 16:41:35.682768 12773 raft_consensus.cc:340] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.682941 12773 raft_consensus.cc:366] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:35.682991 12773 raft_consensus.cc:705] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2204fb616014e5c944c1d7538ec0efc, State: Initialized, Role: FOLLOWER I0401 16:41:35.683238 12773 consensus_queue.cc:229] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.683722 12773 sys_catalog.cc:337] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.683956 12773 sys_catalog.cc:340] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.683789 12897 sys_catalog.cc:337] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.684150 12897 sys_catalog.cc:340] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.684423 12773 sys_catalog.cc:424] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:35.684823 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:41:35.684916 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:35.686075 12898 catalog_manager.cc:1113] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:35.686169 12898 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:35.689291 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 837931us I0401 16:41:35.689481 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:35.689522 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:35.689618 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:35.689651 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:35.690165 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "46a1ffbde8cb4162990fb2785a682d2c" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.694226 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s I0401 16:41:35.694978 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:35.697332 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:35.697404 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-0-root uuid: "46a1ffbde8cb4162990fb2785a682d2c" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.697490 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:35.724370 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:35.724422 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:35.742626 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:60895 I0401 16:41:35.743438 12160 webserver.cc:308] Webserver started at http://127.11.224.1:58680/ using document root and password file I0401 16:41:35.765410 12963 heartbeater.cc:345] Connected to a master server at 127.11.224.60:50532 I0401 16:41:35.765544 12963 heartbeater.cc:426] Registering TS with master... I0401 16:41:35.766139 12963 heartbeater.cc:475] Master 127.11.224.60:50532 requested a full tablet report, sending... I0401 16:41:35.766746 12964 heartbeater.cc:345] Connected to a master server at 127.11.224.61:55560 I0401 16:41:35.766955 12964 heartbeater.cc:426] Registering TS with master... I0401 16:41:35.766953 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 837931us I0401 16:41:35.767416 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:35.767419 12964 heartbeater.cc:475] Master 127.11.224.61:55560 requested a full tablet report, sending... I0401 16:41:35.767623 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:35.767959 12854 ts_manager.cc:159] Registered new tserver with Master: 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895) I0401 16:41:35.768105 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:35.768537 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:35.768539 12965 heartbeater.cc:345] Connected to a master server at 127.11.224.62:47883 I0401 16:41:35.768695 12965 heartbeater.cc:426] Registering TS with master... I0401 16:41:35.769172 12965 heartbeater.cc:475] Master 127.11.224.62:47883 requested a full tablet report, sending... I0401 16:41:35.769287 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "d8dba20a0d5849dcb24e05863dc0a123" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.769295 12797 ts_manager.cc:159] Registered new tserver with Master: 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895) I0401 16:41:35.770176 12740 ts_manager.cc:159] Registered new tserver with Master: 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895) I0401 16:41:35.773542 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s I0401 16:41:35.774292 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:35.777024 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:35.777081 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-1-root uuid: "d8dba20a0d5849dcb24e05863dc0a123" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.777163 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:35.793305 12894 raft_consensus.cc:472] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:35.793426 12894 raft_consensus.cc:494] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.794100 12894 leader_election.cc:296] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d2204fb616014e5c944c1d7538ec0efc (127.11.224.62:47883), 1f9ec791a501435eab0d7b2836d621cb (127.11.224.60:50532) I0401 16:41:35.794668 12864 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9ec791a501435eab0d7b2836d621cb" is_pre_election: true I0401 16:41:35.794677 12750 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2204fb616014e5c944c1d7538ec0efc" is_pre_election: true I0401 16:41:35.795081 12864 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e4b1b33f83944a09262a70c9b11c5d6 in term 0. I0401 16:41:35.795203 12750 raft_consensus.cc:2346] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e4b1b33f83944a09262a70c9b11c5d6 in term 0. I0401 16:41:35.795565 12781 leader_election.cc:310] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9ec791a501435eab0d7b2836d621cb, 9e4b1b33f83944a09262a70c9b11c5d6; no voters: I0401 16:41:35.795907 12894 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:35.795997 12894 raft_consensus.cc:472] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:35.796085 12894 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:35.798003 12894 raft_consensus.cc:494] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.798660 12894 leader_election.cc:296] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [CANDIDATE]: Term 1 election: Requested vote from peers d2204fb616014e5c944c1d7538ec0efc (127.11.224.62:47883), 1f9ec791a501435eab0d7b2836d621cb (127.11.224.60:50532) I0401 16:41:35.798900 12750 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d2204fb616014e5c944c1d7538ec0efc" I0401 16:41:35.799181 12750 raft_consensus.cc:2886] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:35.799175 12864 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1f9ec791a501435eab0d7b2836d621cb" I0401 16:41:35.799358 12864 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:35.801640 12864 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e4b1b33f83944a09262a70c9b11c5d6 in term 1. I0401 16:41:35.802021 12781 leader_election.cc:310] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1f9ec791a501435eab0d7b2836d621cb, 9e4b1b33f83944a09262a70c9b11c5d6; no voters: I0401 16:41:35.802572 12750 raft_consensus.cc:2346] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e4b1b33f83944a09262a70c9b11c5d6 in term 1. I0401 16:41:35.802844 12894 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:35.803966 12894 raft_consensus.cc:667] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 1 LEADER]: Becoming Leader. State: Replica: 9e4b1b33f83944a09262a70c9b11c5d6, State: Running, Role: LEADER I0401 16:41:35.804316 12894 consensus_queue.cc:206] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } I0401 16:41:35.805806 12976 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e4b1b33f83944a09262a70c9b11c5d6. Latest consensus state: current_term: 1 leader_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.806421 12976 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: This master's current role is: LEADER I0401 16:41:35.807384 12978 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:35.809793 12978 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:35.835206 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:35.835278 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:35.853711 12864 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 1 FOLLOWER]: Refusing update from remote peer 9e4b1b33f83944a09262a70c9b11c5d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:35.853788 12750 raft_consensus.cc:1181] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 1 FOLLOWER]: Refusing update from remote peer 9e4b1b33f83944a09262a70c9b11c5d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:35.854351 12976 consensus_queue.cc:984] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:35.855139 12894 consensus_queue.cc:984] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:35.871357 12897 sys_catalog.cc:337] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e4b1b33f83944a09262a70c9b11c5d6. Latest consensus state: current_term: 1 leader_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.871749 12897 sys_catalog.cc:340] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.870837 12891 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e4b1b33f83944a09262a70c9b11c5d6. Latest consensus state: current_term: 1 leader_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.872282 12891 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.879776 12891 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.880234 12891 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.880892 12897 sys_catalog.cc:337] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.881244 12897 sys_catalog.cc:340] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:35.883445 12894 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.883980 12894 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: This master's current role is: LEADER I0401 16:41:35.883572 13014 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d2204fb616014e5c944c1d7538ec0efc" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47883 } } peers { permanent_uuid: "9e4b1b33f83944a09262a70c9b11c5d6" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 55560 } } peers { permanent_uuid: "1f9ec791a501435eab0d7b2836d621cb" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 50532 } } } I0401 16:41:35.884263 13014 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [sys.catalog]: This master's current role is: LEADER I0401 16:41:35.885217 12978 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:35.886924 12978 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:35.902694 12978 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6: Generated new TSK 0 I0401 16:41:35.911600 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:52355 I0401 16:41:35.912742 12160 webserver.cc:308] Webserver started at http://127.11.224.2:54855/ using document root and password file I0401 16:41:35.912839 12797 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:39959 I0401 16:41:35.925164 12964 heartbeater.cc:467] Master 127.11.224.61:55560 was elected leader, sending a full tablet report... I0401 16:41:35.928390 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 837931us I0401 16:41:35.928756 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:35.928967 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:35.929347 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:35.929535 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:35.930778 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "37c64d6d84ba4b82a4befb752c172f5e" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.935678 13046 heartbeater.cc:345] Connected to a master server at 127.11.224.60:50532 I0401 16:41:35.935807 13046 heartbeater.cc:426] Registering TS with master... I0401 16:41:35.936363 13046 heartbeater.cc:475] Master 127.11.224.60:50532 requested a full tablet report, sending... I0401 16:41:35.937772 12854 ts_manager.cc:159] Registered new tserver with Master: d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) I0401 16:41:35.938369 13048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:47883 I0401 16:41:35.938519 13048 heartbeater.cc:426] Registering TS with master... I0401 16:41:35.938957 13047 heartbeater.cc:345] Connected to a master server at 127.11.224.61:55560 I0401 16:41:35.939096 13047 heartbeater.cc:426] Registering TS with master... I0401 16:41:35.939268 13048 heartbeater.cc:475] Master 127.11.224.62:47883 requested a full tablet report, sending... I0401 16:41:35.939606 13047 heartbeater.cc:475] Master 127.11.224.61:55560 requested a full tablet report, sending... I0401 16:41:35.941087 12740 ts_manager.cc:159] Registered new tserver with Master: d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) I0401 16:41:35.941159 12797 ts_manager.cc:159] Registered new tserver with Master: d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) I0401 16:41:35.942231 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.011s user 0.001s sys 0.005s I0401 16:41:35.942502 12797 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:39962 I0401 16:41:35.943651 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:35.946578 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:35.946647 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-2-root uuid: "37c64d6d84ba4b82a4befb752c172f5e" format_stamp: "Formatted at 2019-04-01 23:41:35 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:35.946728 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestCheckUnusualFlags.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:35.954537 13047 heartbeater.cc:467] Master 127.11.224.61:55560 was elected leader, sending a full tablet report... I0401 16:41:36.007580 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:36.007635 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:36.046887 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:56700 I0401 16:41:36.047854 12160 webserver.cc:308] Webserver started at http://127.11.224.3:45266/ using document root and password file I0401 16:41:36.067109 13117 heartbeater.cc:345] Connected to a master server at 127.11.224.60:50532 I0401 16:41:36.067283 13117 heartbeater.cc:426] Registering TS with master... I0401 16:41:36.067281 13118 heartbeater.cc:345] Connected to a master server at 127.11.224.61:55560 I0401 16:41:36.067456 13118 heartbeater.cc:426] Registering TS with master... I0401 16:41:36.067833 13117 heartbeater.cc:475] Master 127.11.224.60:50532 requested a full tablet report, sending... I0401 16:41:36.068631 13118 heartbeater.cc:475] Master 127.11.224.61:55560 requested a full tablet report, sending... I0401 16:41:36.069823 13119 heartbeater.cc:345] Connected to a master server at 127.11.224.62:47883 I0401 16:41:36.070022 13119 heartbeater.cc:426] Registering TS with master... I0401 16:41:36.070364 12854 ts_manager.cc:159] Registered new tserver with Master: 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.070363 12797 ts_manager.cc:159] Registered new tserver with Master: 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.071044 13119 heartbeater.cc:475] Master 127.11.224.62:47883 requested a full tablet report, sending... I0401 16:41:36.071808 12797 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:39965 I0401 16:41:36.071975 12740 ts_manager.cc:159] Registered new tserver with Master: 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.072834 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.020909642s I0401 16:41:36.084856 13118 heartbeater.cc:467] Master 127.11.224.61:55560 was elected leader, sending a full tablet report... I0401 16:41:36.102645 12796 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.61:39968: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:36.103921 12796 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:36.160954 13084 tablet_service.cc:1006] Processing CreateTablet for tablet 5cd867ea58ed4b0f94a00683e468c72f (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:36.163966 13083 tablet_service.cc:1006] Processing CreateTablet for tablet 4a3ab93d6988404697e9d57ff3b08276 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:36.165343 13084 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 5cd867ea58ed4b0f94a00683e468c72f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.164553 13082 tablet_service.cc:1006] Processing CreateTablet for tablet 313183f8b0704fa58ee6bb03c0325a47 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:36.165967 13078 tablet_service.cc:1006] Processing CreateTablet for tablet 4307b4e29325490c8eec5a83768940a7 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:36.165725 13079 tablet_service.cc:1006] Processing CreateTablet for tablet 0002a2c87a5144abbd53c3a79bbf0557 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:36.166398 13077 tablet_service.cc:1006] Processing CreateTablet for tablet 1528709f2f9a40618394fc1ba6bd2922 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:36.166234 13080 tablet_service.cc:1006] Processing CreateTablet for tablet bd721271b4404021931802cc9a11675b (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:36.167321 13075 tablet_service.cc:1006] Processing CreateTablet for tablet e7a4b8a6de384b3ead437ec059b2eef5 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:36.168850 13083 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4a3ab93d6988404697e9d57ff3b08276. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.168829 13081 tablet_service.cc:1006] Processing CreateTablet for tablet c7e6874d51284fa4a1cfde0a2ce07e8a (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:36.169296 13077 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1528709f2f9a40618394fc1ba6bd2922. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.168479 13076 tablet_service.cc:1006] Processing CreateTablet for tablet 952c63a4d69146b19220a4a9789f70b5 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:36.169672 13079 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0002a2c87a5144abbd53c3a79bbf0557. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.169961 13076 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 952c63a4d69146b19220a4a9789f70b5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.170338 13082 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 313183f8b0704fa58ee6bb03c0325a47. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.170658 13078 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4307b4e29325490c8eec5a83768940a7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.175253 13081 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c7e6874d51284fa4a1cfde0a2ce07e8a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.175899 13080 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bd721271b4404021931802cc9a11675b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.178131 13075 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e7a4b8a6de384b3ead437ec059b2eef5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.182122 12930 tablet_service.cc:1006] Processing CreateTablet for tablet 5cd867ea58ed4b0f94a00683e468c72f (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:36.186327 12930 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 5cd867ea58ed4b0f94a00683e468c72f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.189487 12929 tablet_service.cc:1006] Processing CreateTablet for tablet 4a3ab93d6988404697e9d57ff3b08276 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:36.190754 12925 tablet_service.cc:1006] Processing CreateTablet for tablet 0002a2c87a5144abbd53c3a79bbf0557 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:36.190052 12928 tablet_service.cc:1006] Processing CreateTablet for tablet 313183f8b0704fa58ee6bb03c0325a47 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:36.193914 12927 tablet_service.cc:1006] Processing CreateTablet for tablet c7e6874d51284fa4a1cfde0a2ce07e8a (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:36.195339 12922 tablet_service.cc:1006] Processing CreateTablet for tablet 952c63a4d69146b19220a4a9789f70b5 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:36.196735 12923 tablet_service.cc:1006] Processing CreateTablet for tablet 1528709f2f9a40618394fc1ba6bd2922 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:36.197157 12926 tablet_service.cc:1006] Processing CreateTablet for tablet bd721271b4404021931802cc9a11675b (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:36.195762 12924 tablet_service.cc:1006] Processing CreateTablet for tablet 4307b4e29325490c8eec5a83768940a7 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:36.199759 12925 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0002a2c87a5144abbd53c3a79bbf0557. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.200742 12921 tablet_service.cc:1006] Processing CreateTablet for tablet e7a4b8a6de384b3ead437ec059b2eef5 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:36.203724 12927 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c7e6874d51284fa4a1cfde0a2ce07e8a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.204427 12928 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 313183f8b0704fa58ee6bb03c0325a47. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.206029 12926 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bd721271b4404021931802cc9a11675b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.207242 12921 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e7a4b8a6de384b3ead437ec059b2eef5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.207543 12924 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4307b4e29325490c8eec5a83768940a7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.209635 12923 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1528709f2f9a40618394fc1ba6bd2922. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.214668 12922 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 952c63a4d69146b19220a4a9789f70b5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.218168 12929 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4a3ab93d6988404697e9d57ff3b08276. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.223147 13005 tablet_service.cc:1006] Processing CreateTablet for tablet 5cd867ea58ed4b0f94a00683e468c72f (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:36.227185 13000 tablet_service.cc:1006] Processing CreateTablet for tablet 0002a2c87a5144abbd53c3a79bbf0557 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:36.252295 13005 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 5cd867ea58ed4b0f94a00683e468c72f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.251297 13003 tablet_service.cc:1006] Processing CreateTablet for tablet c7e6874d51284fa4a1cfde0a2ce07e8a (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:36.257000 13001 tablet_service.cc:1006] Processing CreateTablet for tablet bd721271b4404021931802cc9a11675b (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:36.256948 13002 tablet_service.cc:1006] Processing CreateTablet for tablet 313183f8b0704fa58ee6bb03c0325a47 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:36.259013 12998 tablet_service.cc:1006] Processing CreateTablet for tablet 4307b4e29325490c8eec5a83768940a7 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:36.260387 13000 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0002a2c87a5144abbd53c3a79bbf0557. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.260665 13004 tablet_service.cc:1006] Processing CreateTablet for tablet 4a3ab93d6988404697e9d57ff3b08276 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:36.262109 12995 tablet_service.cc:1006] Processing CreateTablet for tablet e7a4b8a6de384b3ead437ec059b2eef5 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:36.265465 12996 tablet_service.cc:1006] Processing CreateTablet for tablet 952c63a4d69146b19220a4a9789f70b5 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:36.263648 12997 tablet_service.cc:1006] Processing CreateTablet for tablet 1528709f2f9a40618394fc1ba6bd2922 (table=ksck-test-table [id=82f2b6c7db1041028d25e58ab912c35d]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:36.266311 13001 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bd721271b4404021931802cc9a11675b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.272750 12998 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4307b4e29325490c8eec5a83768940a7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.278990 12996 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 952c63a4d69146b19220a4a9789f70b5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.286203 12997 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1528709f2f9a40618394fc1ba6bd2922. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.286665 13004 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4a3ab93d6988404697e9d57ff3b08276. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.291544 13003 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c7e6874d51284fa4a1cfde0a2ce07e8a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.297152 12995 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e7a4b8a6de384b3ead437ec059b2eef5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.298743 13002 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 313183f8b0704fa58ee6bb03c0325a47. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:36.388643 13137 tablet_bootstrap.cc:439] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.392740 13138 tablet_bootstrap.cc:439] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.404189 13138 tablet_bootstrap.cc:590] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.410161 13139 tablet_bootstrap.cc:439] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.420061 13137 tablet_bootstrap.cc:590] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.426689 13138 tablet_bootstrap.cc:439] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.426805 13137 tablet_bootstrap.cc:439] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.427038 13137 ts_tablet_manager.cc:1053] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.045s user 0.001s sys 0.004s I0401 16:41:36.427033 13138 ts_tablet_manager.cc:1053] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.037s user 0.004s sys 0.004s I0401 16:41:36.428823 13139 tablet_bootstrap.cc:590] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.429150 13138 raft_consensus.cc:340] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.429486 13138 raft_consensus.cc:366] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.429631 13138 raft_consensus.cc:705] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.429482 13137 raft_consensus.cc:340] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.430080 13137 raft_consensus.cc:366] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.430227 13137 raft_consensus.cc:705] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.430078 13138 consensus_queue.cc:229] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.430666 13137 consensus_queue.cc:229] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.441596 13137 ts_tablet_manager.cc:1081] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.012s user 0.002s sys 0.003s I0401 16:41:36.442426 13138 ts_tablet_manager.cc:1081] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.013s user 0.005s sys 0.004s I0401 16:41:36.442752 13137 tablet_bootstrap.cc:439] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.443048 13138 tablet_bootstrap.cc:439] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.448413 13139 tablet_bootstrap.cc:439] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.448580 13139 ts_tablet_manager.cc:1053] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.006s I0401 16:41:36.448885 13137 tablet_bootstrap.cc:590] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.449594 13139 raft_consensus.cc:340] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.450212 13139 raft_consensus.cc:366] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.450377 13139 raft_consensus.cc:705] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.450584 13138 tablet_bootstrap.cc:590] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.451056 13139 consensus_queue.cc:229] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.453899 13139 ts_tablet_manager.cc:1081] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.005s user 0.000s sys 0.004s I0401 16:41:36.454226 13139 tablet_bootstrap.cc:439] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.459712 13139 tablet_bootstrap.cc:590] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.462719 13137 tablet_bootstrap.cc:439] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.462966 13137 ts_tablet_manager.cc:1053] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.007s I0401 16:41:36.463099 13138 tablet_bootstrap.cc:439] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.463300 13138 ts_tablet_manager.cc:1053] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.008s I0401 16:41:36.464004 13138 raft_consensus.cc:340] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.464010 13137 raft_consensus.cc:340] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.464236 13138 raft_consensus.cc:366] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.464381 13137 raft_consensus.cc:366] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.464385 13138 raft_consensus.cc:705] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.464479 13137 raft_consensus.cc:705] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.464745 13138 consensus_queue.cc:229] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.464871 13137 consensus_queue.cc:229] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.467070 13137 ts_tablet_manager.cc:1081] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:36.469249 13138 ts_tablet_manager.cc:1081] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s I0401 16:41:36.470250 13137 tablet_bootstrap.cc:439] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.470710 13138 tablet_bootstrap.cc:439] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.473454 13137 tablet_bootstrap.cc:590] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.474565 13138 tablet_bootstrap.cc:590] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.474565 13139 tablet_bootstrap.cc:439] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.474942 13139 ts_tablet_manager.cc:1053] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.008s I0401 16:41:36.476377 13139 raft_consensus.cc:340] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.476905 13139 raft_consensus.cc:366] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.477000 13139 raft_consensus.cc:705] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.477331 13139 consensus_queue.cc:229] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.477505 13137 tablet_bootstrap.cc:439] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.477705 13137 ts_tablet_manager.cc:1053] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.004s I0401 16:41:36.479008 13137 raft_consensus.cc:340] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.479292 13137 raft_consensus.cc:366] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.479383 13137 raft_consensus.cc:705] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.479600 13137 consensus_queue.cc:229] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.480334 13137 ts_tablet_manager.cc:1081] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:41:36.480660 13137 tablet_bootstrap.cc:439] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.483753 13142 raft_consensus.cc:472] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.484416 13142 raft_consensus.cc:494] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.484666 13139 ts_tablet_manager.cc:1081] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s I0401 16:41:36.484973 13137 tablet_bootstrap.cc:590] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.485162 13139 tablet_bootstrap.cc:439] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.486246 13138 tablet_bootstrap.cc:439] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.487013 13142 leader_election.cc:296] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.487382 13138 ts_tablet_manager.cc:1053] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s I0401 16:41:36.499064 13138 raft_consensus.cc:340] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.499861 13138 raft_consensus.cc:366] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.500274 13138 raft_consensus.cc:705] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.500411 13139 tablet_bootstrap.cc:590] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.501464 13137 tablet_bootstrap.cc:439] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.501776 13137 ts_tablet_manager.cc:1053] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.003s I0401 16:41:36.501235 13138 consensus_queue.cc:229] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.504088 13137 raft_consensus.cc:340] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.504493 13137 raft_consensus.cc:366] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.504611 13137 raft_consensus.cc:705] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.505087 13137 consensus_queue.cc:229] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.505692 13138 ts_tablet_manager.cc:1081] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.015s user 0.000s sys 0.004s I0401 16:41:36.507913 13138 tablet_bootstrap.cc:439] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.510257 13137 ts_tablet_manager.cc:1081] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s I0401 16:41:36.511847 13137 tablet_bootstrap.cc:439] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.514478 13139 tablet_bootstrap.cc:439] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.514752 13139 ts_tablet_manager.cc:1053] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.007s I0401 16:41:36.516433 13138 tablet_bootstrap.cc:590] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.516938 13139 raft_consensus.cc:340] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.518919 13139 raft_consensus.cc:366] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.519151 13139 raft_consensus.cc:705] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.519490 13139 consensus_queue.cc:229] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.521575 13137 tablet_bootstrap.cc:590] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.523281 13094 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4307b4e29325490c8eec5a83768940a7" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.525442 13094 raft_consensus.cc:2346] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 0. I0401 16:41:36.525723 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4307b4e29325490c8eec5a83768940a7" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:36.529222 12904 leader_election.cc:310] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: I0401 16:41:36.529332 13139 ts_tablet_manager.cc:1081] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.011s user 0.002s sys 0.001s I0401 16:41:36.529811 13142 raft_consensus.cc:2640] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:36.530197 13139 tablet_bootstrap.cc:439] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.530272 13142 raft_consensus.cc:472] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) W0401 16:41:36.530280 12901 leader_election.cc:348] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.530388 13142 raft_consensus.cc:2886] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.532618 13138 tablet_bootstrap.cc:439] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.532889 13138 ts_tablet_manager.cc:1053] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.027s user 0.004s sys 0.005s I0401 16:41:36.533421 13139 tablet_bootstrap.cc:590] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.534355 13138 raft_consensus.cc:340] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.534647 13138 raft_consensus.cc:366] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.534754 13138 raft_consensus.cc:705] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.535097 13138 consensus_queue.cc:229] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.535310 13142 raft_consensus.cc:494] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.536433 13137 tablet_bootstrap.cc:439] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.536662 13137 ts_tablet_manager.cc:1053] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.026s user 0.002s sys 0.004s I0401 16:41:36.539005 13094 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4307b4e29325490c8eec5a83768940a7" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" I0401 16:41:36.539994 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4307b4e29325490c8eec5a83768940a7" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" I0401 16:41:36.540237 13142 leader_election.cc:296] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Requested vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.541169 13144 raft_consensus.cc:472] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.541635 13094 raft_consensus.cc:2886] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.541479 13144 raft_consensus.cc:494] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } W0401 16:41:36.543063 12901 leader_election.cc:348] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.544584 13138 ts_tablet_manager.cc:1081] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.010s user 0.003s sys 0.002s I0401 16:41:36.545732 13144 leader_election.cc:296] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) I0401 16:41:36.548102 13137 raft_consensus.cc:340] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.548447 13137 raft_consensus.cc:366] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.548497 13138 tablet_bootstrap.cc:439] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.549398 13137 raft_consensus.cc:705] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.549721 13137 consensus_queue.cc:229] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.555912 13137 ts_tablet_manager.cc:1081] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.017s user 0.002s sys 0.001s I0401 16:41:36.558212 13094 raft_consensus.cc:2346] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 1. I0401 16:41:36.558676 12904 leader_election.cc:310] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: d8dba20a0d5849dcb24e05863dc0a123 I0401 16:41:36.559589 13137 tablet_bootstrap.cc:439] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.561323 13138 tablet_bootstrap.cc:590] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.561846 13161 raft_consensus.cc:2640] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.565284 13161 raft_consensus.cc:667] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Becoming Leader. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Running, Role: LEADER I0401 16:41:36.567744 13137 tablet_bootstrap.cc:590] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.569893 12940 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1528709f2f9a40618394fc1ba6bd2922" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" is_pre_election: true I0401 16:41:36.570928 12940 raft_consensus.cc:2346] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37c64d6d84ba4b82a4befb752c172f5e in term 0. I0401 16:41:36.570602 13139 tablet_bootstrap.cc:439] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.571983 13139 ts_tablet_manager.cc:1053] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.042s user 0.003s sys 0.009s I0401 16:41:36.572492 13056 leader_election.cc:310] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: I0401 16:41:36.572618 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1528709f2f9a40618394fc1ba6bd2922" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:36.573175 13144 raft_consensus.cc:2640] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:36.573307 13144 raft_consensus.cc:472] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:36.573343 13138 tablet_bootstrap.cc:439] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log W0401 16:41:36.573302 13055 leader_election.cc:348] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.573607 13138 ts_tablet_manager.cc:1053] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.006s I0401 16:41:36.573603 13144 raft_consensus.cc:2886] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.573575 13139 raft_consensus.cc:340] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.574226 13139 raft_consensus.cc:366] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.571728 13161 consensus_queue.cc:206] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.574904 13139 raft_consensus.cc:705] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.576138 13139 consensus_queue.cc:229] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.579519 13139 ts_tablet_manager.cc:1081] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s I0401 16:41:36.578583 13138 raft_consensus.cc:340] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.582227 12796 catalog_manager.cc:3977] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c reported cstate change: term changed from 0 to 1, leader changed from to 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1). New cstate: current_term: 1 leader_uuid: "46a1ffbde8cb4162990fb2785a682d2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: UNKNOWN } } } I0401 16:41:36.584326 13139 tablet_bootstrap.cc:439] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.584836 13144 raft_consensus.cc:494] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.585173 13137 tablet_bootstrap.cc:439] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.586038 13137 ts_tablet_manager.cc:1053] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.029s user 0.001s sys 0.006s I0401 16:41:36.587857 12940 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1528709f2f9a40618394fc1ba6bd2922" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" I0401 16:41:36.588064 12940 raft_consensus.cc:2886] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.588315 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1528709f2f9a40618394fc1ba6bd2922" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" I0401 16:41:36.587678 13138 raft_consensus.cc:366] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely W0401 16:41:36.588819 13055 leader_election.cc:348] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.586319 13144 leader_election.cc:296] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 election: Requested vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) I0401 16:41:36.591140 13138 raft_consensus.cc:705] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.591208 13137 raft_consensus.cc:340] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.591445 13137 raft_consensus.cc:366] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.591519 13137 raft_consensus.cc:705] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.591447 13138 consensus_queue.cc:229] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.592476 12940 raft_consensus.cc:2346] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37c64d6d84ba4b82a4befb752c172f5e in term 1. I0401 16:41:36.593148 13137 consensus_queue.cc:229] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.593318 13056 leader_election.cc:310] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: d8dba20a0d5849dcb24e05863dc0a123 I0401 16:41:36.596892 13138 ts_tablet_manager.cc:1081] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.023s user 0.000s sys 0.002s I0401 16:41:36.596894 13144 raft_consensus.cc:2640] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.599817 13137 ts_tablet_manager.cc:1081] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s I0401 16:41:36.601039 13138 tablet_bootstrap.cc:439] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.603905 13137 tablet_bootstrap.cc:439] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.608222 13137 tablet_bootstrap.cc:590] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.608283 13139 tablet_bootstrap.cc:590] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.609988 13144 raft_consensus.cc:667] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 LEADER]: Becoming Leader. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Running, Role: LEADER I0401 16:41:36.611474 13144 consensus_queue.cc:206] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.614163 13138 tablet_bootstrap.cc:590] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.614199 13139 tablet_bootstrap.cc:439] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.614465 13139 ts_tablet_manager.cc:1053] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.003s I0401 16:41:36.615015 13137 tablet_bootstrap.cc:439] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.615322 13137 ts_tablet_manager.cc:1053] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.004s I0401 16:41:36.618000 13137 raft_consensus.cc:340] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.620074 13137 raft_consensus.cc:366] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.620720 13139 raft_consensus.cc:340] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.620657 12796 catalog_manager.cc:3977] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e reported cstate change: term changed from 0 to 1, leader changed from to 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3). New cstate: current_term: 1 leader_uuid: "37c64d6d84ba4b82a4befb752c172f5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: HEALTHY } } } I0401 16:41:36.621168 13139 raft_consensus.cc:366] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.621145 13137 raft_consensus.cc:705] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.621868 13139 raft_consensus.cc:705] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.621868 13137 consensus_queue.cc:229] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.622248 13139 consensus_queue.cc:229] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.629024 13139 ts_tablet_manager.cc:1081] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.013s user 0.000s sys 0.003s I0401 16:41:36.630710 13139 tablet_bootstrap.cc:439] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.629241 13137 ts_tablet_manager.cc:1081] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.012s user 0.001s sys 0.002s I0401 16:41:36.631916 13137 tablet_bootstrap.cc:439] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.632155 13146 raft_consensus.cc:472] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.632630 13146 raft_consensus.cc:494] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.635217 13146 leader_election.cc:296] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.646392 13137 tablet_bootstrap.cc:590] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.647650 13138 tablet_bootstrap.cc:439] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.647914 13138 ts_tablet_manager.cc:1053] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.050s user 0.000s sys 0.011s I0401 16:41:36.648880 13139 tablet_bootstrap.cc:590] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.651218 13146 raft_consensus.cc:472] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.651469 13138 raft_consensus.cc:340] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.652292 13138 raft_consensus.cc:366] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.652294 13146 raft_consensus.cc:494] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.652509 13138 raft_consensus.cc:705] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.653542 13146 leader_election.cc:296] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.656005 13138 consensus_queue.cc:229] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.663110 13137 tablet_bootstrap.cc:439] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.663745 13138 ts_tablet_manager.cc:1081] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.016s user 0.001s sys 0.002s I0401 16:41:36.663754 13137 ts_tablet_manager.cc:1053] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.005s I0401 16:41:36.664451 13138 tablet_bootstrap.cc:439] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.665566 13137 raft_consensus.cc:340] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.666201 13137 raft_consensus.cc:366] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.666440 13137 raft_consensus.cc:705] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.667280 13137 consensus_queue.cc:229] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.670770 13138 tablet_bootstrap.cc:590] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.672482 12940 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bd721271b4404021931802cc9a11675b" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" is_pre_election: true I0401 16:41:36.672408 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "952c63a4d69146b19220a4a9789f70b5" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" is_pre_election: true I0401 16:41:36.672978 12940 raft_consensus.cc:2346] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 0. I0401 16:41:36.674299 12892 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb: acquiring CA information for follower catalog manager: success I0401 16:41:36.674572 13161 raft_consensus.cc:472] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.675024 13137 ts_tablet_manager.cc:1081] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.006s user 0.000s sys 0.003s I0401 16:41:36.675781 12973 leader_election.cc:310] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46a1ffbde8cb4162990fb2785a682d2c, d8dba20a0d5849dcb24e05863dc0a123; no voters: I0401 16:41:36.675938 13139 tablet_bootstrap.cc:439] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.675930 13161 raft_consensus.cc:494] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.676921 13161 leader_election.cc:296] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.676930 13146 raft_consensus.cc:2640] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:36.677112 13146 raft_consensus.cc:472] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) W0401 16:41:36.677110 12973 leader_election.cc:348] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.677151 13094 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0002a2c87a5144abbd53c3a79bbf0557" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.677716 13137 tablet_bootstrap.cc:439] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.678290 13146 raft_consensus.cc:2886] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.679105 13094 raft_consensus.cc:2346] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 0. I0401 16:41:36.679718 12904 leader_election.cc:310] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: I0401 16:41:36.680202 13139 ts_tablet_manager.cc:1053] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.046s user 0.002s sys 0.008s I0401 16:41:36.679711 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0002a2c87a5144abbd53c3a79bbf0557" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:36.680819 13161 raft_consensus.cc:2640] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:36.680819 13093 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bd721271b4404021931802cc9a11675b" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.681162 13161 raft_consensus.cc:472] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:36.681164 13023 raft_consensus.cc:2346] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 0. I0401 16:41:36.681718 13161 raft_consensus.cc:2886] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.681718 13093 raft_consensus.cc:2346] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 0. I0401 16:41:36.681161 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "952c63a4d69146b19220a4a9789f70b5" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.682484 13092 raft_consensus.cc:2346] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 0. I0401 16:41:36.683185 12975 leader_election.cc:310] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, d8dba20a0d5849dcb24e05863dc0a123; no voters: 46a1ffbde8cb4162990fb2785a682d2c I0401 16:41:36.683195 12892 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:36.686910 13146 raft_consensus.cc:494] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.690079 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bd721271b4404021931802cc9a11675b" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" I0401 16:41:36.690575 12939 raft_consensus.cc:2886] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.691336 13146 leader_election.cc:296] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 election: Requested vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.691248 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bd721271b4404021931802cc9a11675b" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" I0401 16:41:36.692525 13092 raft_consensus.cc:2886] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.693892 13146 raft_consensus.cc:2640] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:36.695897 13146 raft_consensus.cc:472] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:36.695435 13139 raft_consensus.cc:340] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.696681 13139 raft_consensus.cc:366] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.696878 13139 raft_consensus.cc:705] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.697659 13139 consensus_queue.cc:229] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.698160 13146 raft_consensus.cc:2886] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.699908 13139 ts_tablet_manager.cc:1081] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.020s user 0.000s sys 0.003s I0401 16:41:36.704619 12898 catalog_manager.cc:1111] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc: acquiring CA information for follower catalog manager: success I0401 16:41:36.700462 13161 raft_consensus.cc:494] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.706126 13139 tablet_bootstrap.cc:439] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.706651 13138 tablet_bootstrap.cc:439] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.706972 12939 raft_consensus.cc:2346] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 1. I0401 16:41:36.707113 13092 raft_consensus.cc:2346] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 1. I0401 16:41:36.707684 12973 leader_election.cc:310] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46a1ffbde8cb4162990fb2785a682d2c, d8dba20a0d5849dcb24e05863dc0a123; no voters: I0401 16:41:36.707865 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0002a2c87a5144abbd53c3a79bbf0557" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" I0401 16:41:36.708351 13138 ts_tablet_manager.cc:1053] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.043s user 0.005s sys 0.002s I0401 16:41:36.709110 13092 raft_consensus.cc:2886] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.709564 13161 leader_election.cc:296] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Requested vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.709697 12898 catalog_manager.cc:1139] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:36.709545 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0002a2c87a5144abbd53c3a79bbf0557" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" I0401 16:41:36.710196 13023 raft_consensus.cc:2886] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.711707 13139 tablet_bootstrap.cc:590] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.712254 13175 raft_consensus.cc:2640] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.712347 13137 tablet_bootstrap.cc:590] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.715895 13023 raft_consensus.cc:2346] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 1. I0401 16:41:36.716991 12901 leader_election.cc:310] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46a1ffbde8cb4162990fb2785a682d2c, d8dba20a0d5849dcb24e05863dc0a123; no voters: I0401 16:41:36.718009 13161 raft_consensus.cc:2640] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.718417 13161 raft_consensus.cc:667] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Becoming Leader. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Running, Role: LEADER I0401 16:41:36.718719 13161 consensus_queue.cc:206] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.720857 13175 raft_consensus.cc:667] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 1 LEADER]: Becoming Leader. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Running, Role: LEADER I0401 16:41:36.722224 13092 raft_consensus.cc:2346] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 1. I0401 16:41:36.723502 13138 raft_consensus.cc:340] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.723459 13146 raft_consensus.cc:494] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.724241 13175 consensus_queue.cc:206] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.727701 13138 raft_consensus.cc:366] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.727202 12796 catalog_manager.cc:3977] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c reported cstate change: term changed from 0 to 1, leader changed from to 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1). New cstate: current_term: 1 leader_uuid: "46a1ffbde8cb4162990fb2785a682d2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: UNKNOWN } } } I0401 16:41:36.729372 13138 raft_consensus.cc:705] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.731446 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "952c63a4d69146b19220a4a9789f70b5" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" I0401 16:41:36.731587 13138 consensus_queue.cc:229] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.731827 13092 raft_consensus.cc:2886] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.734197 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "952c63a4d69146b19220a4a9789f70b5" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" I0401 16:41:36.735328 13146 leader_election.cc:296] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 election: Requested vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.737668 12939 raft_consensus.cc:2886] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.739125 13138 ts_tablet_manager.cc:1081] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s I0401 16:41:36.739993 13138 tablet_bootstrap.cc:439] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.743192 13139 tablet_bootstrap.cc:439] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.743567 13139 ts_tablet_manager.cc:1053] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.004s I0401 16:41:36.743563 12796 catalog_manager.cc:3977] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 reported cstate change: term changed from 0 to 1, leader changed from to d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "d8dba20a0d5849dcb24e05863dc0a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: UNKNOWN } } } I0401 16:41:36.746073 13139 raft_consensus.cc:340] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.746889 13139 raft_consensus.cc:366] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.747658 13139 raft_consensus.cc:705] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.749009 12939 raft_consensus.cc:2346] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 1. I0401 16:41:36.749186 13092 raft_consensus.cc:2346] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 1. I0401 16:41:36.749447 12973 leader_election.cc:310] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46a1ffbde8cb4162990fb2785a682d2c, d8dba20a0d5849dcb24e05863dc0a123; no voters: I0401 16:41:36.752548 13175 raft_consensus.cc:2640] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.750098 13139 consensus_queue.cc:229] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.754264 13139 ts_tablet_manager.cc:1081] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.010s user 0.002s sys 0.001s I0401 16:41:36.754654 13139 tablet_bootstrap.cc:439] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.755486 13175 raft_consensus.cc:667] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 LEADER]: Becoming Leader. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Running, Role: LEADER I0401 16:41:36.755762 13175 consensus_queue.cc:206] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.758097 13139 tablet_bootstrap.cc:590] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.758106 13138 tablet_bootstrap.cc:590] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.758386 13137 tablet_bootstrap.cc:439] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.759410 13137 ts_tablet_manager.cc:1053] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.083s user 0.004s sys 0.006s I0401 16:41:36.761567 12797 catalog_manager.cc:3977] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 reported cstate change: term changed from 0 to 1, leader changed from to d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "d8dba20a0d5849dcb24e05863dc0a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: UNKNOWN } } } I0401 16:41:36.766129 13137 raft_consensus.cc:340] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.769351 13137 raft_consensus.cc:366] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.769544 13137 raft_consensus.cc:705] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.770318 13137 consensus_queue.cc:229] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.771399 13175 raft_consensus.cc:472] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.771571 13175 raft_consensus.cc:494] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.772569 13144 raft_consensus.cc:472] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.774133 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c7e6874d51284fa4a1cfde0a2ce07e8a" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" is_pre_election: true I0401 16:41:36.774134 13144 raft_consensus.cc:494] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.774372 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c7e6874d51284fa4a1cfde0a2ce07e8a" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.775928 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "313183f8b0704fa58ee6bb03c0325a47" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:36.776336 13092 raft_consensus.cc:2346] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 0. I0401 16:41:36.777212 13137 ts_tablet_manager.cc:1081] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.012s user 0.000s sys 0.002s I0401 16:41:36.777813 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "313183f8b0704fa58ee6bb03c0325a47" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" is_pre_election: true I0401 16:41:36.778117 13144 leader_election.cc:296] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) W0401 16:41:36.778020 13055 leader_election.cc:348] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355): Illegal state: must be running to vote when last-logged opid is not known W0401 16:41:36.778524 12973 leader_election.cc:348] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.781636 13137 tablet_bootstrap.cc:439] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e: Bootstrap starting. I0401 16:41:36.780555 13175 leader_election.cc:296] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) W0401 16:41:36.782850 13056 leader_election.cc:348] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.782865 12975 leader_election.cc:310] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, d8dba20a0d5849dcb24e05863dc0a123; no voters: 46a1ffbde8cb4162990fb2785a682d2c I0401 16:41:36.783061 13056 leader_election.cc:310] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e; no voters: 46a1ffbde8cb4162990fb2785a682d2c, d8dba20a0d5849dcb24e05863dc0a123 I0401 16:41:36.784137 13144 raft_consensus.cc:2588] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:36.784482 13175 raft_consensus.cc:2640] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:36.784646 13175 raft_consensus.cc:472] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:36.784742 13175 raft_consensus.cc:2886] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.787106 13137 tablet_bootstrap.cc:590] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e: No blocks or log segments found. Creating new log. I0401 16:41:36.789149 13175 raft_consensus.cc:494] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.790102 13175 leader_election.cc:296] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 election: Requested vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.790165 13138 tablet_bootstrap.cc:439] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.790236 13139 tablet_bootstrap.cc:439] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.790464 13139 ts_tablet_manager.cc:1053] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.036s user 0.004s sys 0.010s I0401 16:41:36.790693 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c7e6874d51284fa4a1cfde0a2ce07e8a" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" I0401 16:41:36.790691 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c7e6874d51284fa4a1cfde0a2ce07e8a" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" I0401 16:41:36.791092 13092 raft_consensus.cc:2886] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 W0401 16:41:36.791246 12973 leader_election.cc:348] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.792034 13138 ts_tablet_manager.cc:1053] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.051s user 0.005s sys 0.008s I0401 16:41:36.793226 13139 raft_consensus.cc:340] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.795215 13139 raft_consensus.cc:366] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.795372 13139 raft_consensus.cc:705] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.795998 13139 consensus_queue.cc:229] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.797137 13092 raft_consensus.cc:2346] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d8dba20a0d5849dcb24e05863dc0a123 in term 1. I0401 16:41:36.797665 12975 leader_election.cc:310] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, d8dba20a0d5849dcb24e05863dc0a123; no voters: 46a1ffbde8cb4162990fb2785a682d2c I0401 16:41:36.798171 13175 raft_consensus.cc:2640] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.798338 13175 raft_consensus.cc:667] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 1 LEADER]: Becoming Leader. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Running, Role: LEADER I0401 16:41:36.798671 13175 consensus_queue.cc:206] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.799052 13139 ts_tablet_manager.cc:1081] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s I0401 16:41:36.799383 13139 tablet_bootstrap.cc:439] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.801612 13138 raft_consensus.cc:340] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.804484 13138 raft_consensus.cc:366] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.804746 13137 tablet_bootstrap.cc:439] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e: No bootstrap required, opened a new log I0401 16:41:36.805057 13138 raft_consensus.cc:705] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.803165 12796 catalog_manager.cc:3977] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 reported cstate change: term changed from 0 to 1, leader changed from to d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "d8dba20a0d5849dcb24e05863dc0a123" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: UNKNOWN } } } I0401 16:41:36.805451 13161 raft_consensus.cc:472] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.805817 13137 ts_tablet_manager.cc:1053] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.003s I0401 16:41:36.805794 13161 raft_consensus.cc:494] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.806846 13161 leader_election.cc:296] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.807516 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4a3ab93d6988404697e9d57ff3b08276" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true W0401 16:41:36.808106 12901 leader_election.cc:348] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.807516 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4a3ab93d6988404697e9d57ff3b08276" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.808296 13092 raft_consensus.cc:2346] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 0. I0401 16:41:36.809741 12904 leader_election.cc:310] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: d8dba20a0d5849dcb24e05863dc0a123 I0401 16:41:36.809777 13139 tablet_bootstrap.cc:590] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.810050 13161 raft_consensus.cc:2640] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:36.810443 13161 raft_consensus.cc:472] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:36.810585 13161 raft_consensus.cc:2886] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.812711 13137 raft_consensus.cc:340] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.815137 13137 raft_consensus.cc:366] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.811790 13138 consensus_queue.cc:229] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.817503 13144 raft_consensus.cc:472] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.817780 13137 raft_consensus.cc:705] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Initialized, Role: FOLLOWER I0401 16:41:36.818176 13144 raft_consensus.cc:494] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.819358 13144 leader_election.cc:296] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) I0401 16:41:36.819869 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e7a4b8a6de384b3ead437ec059b2eef5" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:36.819855 13161 raft_consensus.cc:494] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.820888 13138 ts_tablet_manager.cc:1081] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.025s user 0.001s sys 0.002s I0401 16:41:36.821017 13023 raft_consensus.cc:2346] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 37c64d6d84ba4b82a4befb752c172f5e in term 0. I0401 16:41:36.821328 13161 leader_election.cc:296] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Requested vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.821475 13137 consensus_queue.cc:229] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.821879 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e7a4b8a6de384b3ead437ec059b2eef5" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" is_pre_election: true I0401 16:41:36.822226 13055 leader_election.cc:310] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, d8dba20a0d5849dcb24e05863dc0a123; no voters: I0401 16:41:36.823309 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4a3ab93d6988404697e9d57ff3b08276" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" I0401 16:41:36.823314 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4a3ab93d6988404697e9d57ff3b08276" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" W0401 16:41:36.823314 13056 leader_election.cc:348] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.823523 13092 raft_consensus.cc:2886] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.824414 13137 ts_tablet_manager.cc:1081] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e: Time spent starting tablet: real 0.017s user 0.003s sys 0.000s I0401 16:41:36.824863 13144 raft_consensus.cc:2640] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election won for term 1 W0401 16:41:36.825387 12901 leader_election.cc:348] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.826200 13144 raft_consensus.cc:472] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:36.826591 13144 raft_consensus.cc:2886] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.827893 13138 tablet_bootstrap.cc:439] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.830739 13138 tablet_bootstrap.cc:590] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.832660 13092 raft_consensus.cc:2346] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 1. I0401 16:41:36.833114 12904 leader_election.cc:310] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: d8dba20a0d5849dcb24e05863dc0a123 I0401 16:41:36.833843 13161 raft_consensus.cc:2640] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.834105 13161 raft_consensus.cc:667] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Becoming Leader. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Running, Role: LEADER I0401 16:41:36.834617 13161 consensus_queue.cc:206] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.834125 13144 raft_consensus.cc:494] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.835965 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e7a4b8a6de384b3ead437ec059b2eef5" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" I0401 16:41:36.836644 13144 leader_election.cc:296] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 election: Requested vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) W0401 16:41:36.836649 13056 leader_election.cc:348] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:36.837095 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e7a4b8a6de384b3ead437ec059b2eef5" candidate_uuid: "37c64d6d84ba4b82a4befb752c172f5e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" I0401 16:41:36.837246 13023 raft_consensus.cc:2886] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.837579 13138 tablet_bootstrap.cc:439] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.837759 13138 ts_tablet_manager.cc:1053] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.015s user 0.001s sys 0.005s I0401 16:41:36.839130 13138 raft_consensus.cc:340] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.839774 13139 tablet_bootstrap.cc:439] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.840154 13138 raft_consensus.cc:366] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.840855 13138 raft_consensus.cc:705] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.838431 12796 catalog_manager.cc:3977] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c reported cstate change: term changed from 0 to 1, leader changed from to 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1). New cstate: current_term: 1 leader_uuid: "46a1ffbde8cb4162990fb2785a682d2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: UNKNOWN } } } I0401 16:41:36.842525 13138 consensus_queue.cc:229] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.844616 13138 ts_tablet_manager.cc:1081] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.006s user 0.002s sys 0.001s I0401 16:41:36.845978 13139 ts_tablet_manager.cc:1053] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.005s I0401 16:41:36.845822 13023 raft_consensus.cc:2346] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 37c64d6d84ba4b82a4befb752c172f5e in term 1. I0401 16:41:36.846976 13138 tablet_bootstrap.cc:439] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c: Bootstrap starting. I0401 16:41:36.846868 13055 leader_election.cc:310] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, d8dba20a0d5849dcb24e05863dc0a123; no voters: 46a1ffbde8cb4162990fb2785a682d2c I0401 16:41:36.847666 13144 raft_consensus.cc:2640] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.848961 13144 raft_consensus.cc:667] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 LEADER]: Becoming Leader. State: Replica: 37c64d6d84ba4b82a4befb752c172f5e, State: Running, Role: LEADER I0401 16:41:36.850450 13144 consensus_queue.cc:206] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.852530 13138 tablet_bootstrap.cc:590] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c: No blocks or log segments found. Creating new log. I0401 16:41:36.852234 13139 raft_consensus.cc:340] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.853798 13139 raft_consensus.cc:366] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.854858 13139 raft_consensus.cc:705] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.855918 13139 consensus_queue.cc:229] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.857271 13139 ts_tablet_manager.cc:1081] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s I0401 16:41:36.858109 13139 tablet_bootstrap.cc:439] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123: Bootstrap starting. I0401 16:41:36.855919 12796 catalog_manager.cc:3977] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e reported cstate change: term changed from 0 to 1, leader changed from to 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3). New cstate: current_term: 1 leader_uuid: "37c64d6d84ba4b82a4befb752c172f5e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: HEALTHY } } } I0401 16:41:36.861798 13139 tablet_bootstrap.cc:590] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123: No blocks or log segments found. Creating new log. I0401 16:41:36.862287 13138 tablet_bootstrap.cc:439] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c: No bootstrap required, opened a new log I0401 16:41:36.862555 13138 ts_tablet_manager.cc:1053] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.005s I0401 16:41:36.867019 13138 raft_consensus.cc:340] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.867432 13138 raft_consensus.cc:366] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.867542 13138 raft_consensus.cc:705] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Initialized, Role: FOLLOWER I0401 16:41:36.867848 13138 consensus_queue.cc:229] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.868016 13139 tablet_bootstrap.cc:439] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123: No bootstrap required, opened a new log I0401 16:41:36.868399 13139 ts_tablet_manager.cc:1053] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.003s I0401 16:41:36.869069 13138 ts_tablet_manager.cc:1081] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:36.870609 13139 raft_consensus.cc:340] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.871459 13139 raft_consensus.cc:366] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:36.871582 13139 raft_consensus.cc:705] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d8dba20a0d5849dcb24e05863dc0a123, State: Initialized, Role: FOLLOWER I0401 16:41:36.871721 13139 consensus_queue.cc:229] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.872272 13139 ts_tablet_manager.cc:1081] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s I0401 16:41:36.880374 13161 raft_consensus.cc:472] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.880549 13161 raft_consensus.cc:494] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.881611 13161 leader_election.cc:296] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.881840 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c7e6874d51284fa4a1cfde0a2ce07e8a" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:36.882056 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c7e6874d51284fa4a1cfde0a2ce07e8a" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.882167 13023 raft_consensus.cc:2307] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 46a1ffbde8cb4162990fb2785a682d2c for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:36.882308 13092 raft_consensus.cc:2276] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46a1ffbde8cb4162990fb2785a682d2c in current term 1: Already voted for candidate d8dba20a0d5849dcb24e05863dc0a123 in this term. I0401 16:41:36.882673 12904 leader_election.cc:310] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46a1ffbde8cb4162990fb2785a682d2c; no voters: 37c64d6d84ba4b82a4befb752c172f5e, d8dba20a0d5849dcb24e05863dc0a123 I0401 16:41:36.882962 13161 raft_consensus.cc:2886] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.884510 13161 raft_consensus.cc:2588] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:36.885509 13175 raft_consensus.cc:472] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.885689 13175 raft_consensus.cc:494] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:36.886298 13175 leader_election.cc:296] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:36.886638 12939 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4a3ab93d6988404697e9d57ff3b08276" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "46a1ffbde8cb4162990fb2785a682d2c" is_pre_election: true I0401 16:41:36.886864 12939 raft_consensus.cc:2307] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate d8dba20a0d5849dcb24e05863dc0a123 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:36.886865 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4a3ab93d6988404697e9d57ff3b08276" candidate_uuid: "d8dba20a0d5849dcb24e05863dc0a123" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.887075 13092 raft_consensus.cc:2276] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d8dba20a0d5849dcb24e05863dc0a123 in current term 1: Already voted for candidate 46a1ffbde8cb4162990fb2785a682d2c in this term. I0401 16:41:36.887714 12975 leader_election.cc:310] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d8dba20a0d5849dcb24e05863dc0a123; no voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c I0401 16:41:36.888087 13175 raft_consensus.cc:2886] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.890610 13175 raft_consensus.cc:2588] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:36.893911 13161 raft_consensus.cc:472] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:36.893998 13161 raft_consensus.cc:494] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.894498 13161 leader_election.cc:296] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700), d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) I0401 16:41:36.894799 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "5cd867ea58ed4b0f94a00683e468c72f" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:36.894937 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "5cd867ea58ed4b0f94a00683e468c72f" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:36.895151 13092 raft_consensus.cc:2346] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 0. I0401 16:41:36.895154 13023 raft_consensus.cc:2346] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 0. I0401 16:41:36.895510 12904 leader_election.cc:310] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: I0401 16:41:36.895789 13161 raft_consensus.cc:2640] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:36.895872 13161 raft_consensus.cc:472] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:36.895938 13161 raft_consensus.cc:2886] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.898017 13161 raft_consensus.cc:494] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.898689 13161 leader_election.cc:296] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Requested vote from peers 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700), d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355) I0401 16:41:36.899116 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "5cd867ea58ed4b0f94a00683e468c72f" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" I0401 16:41:36.899284 13092 raft_consensus.cc:2886] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.900069 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "5cd867ea58ed4b0f94a00683e468c72f" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" I0401 16:41:36.900266 13023 raft_consensus.cc:2886] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:36.904458 13092 raft_consensus.cc:2346] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 1. I0401 16:41:36.904618 13023 raft_consensus.cc:2346] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 1. I0401 16:41:36.904920 12904 leader_election.cc:310] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: I0401 16:41:36.905185 13161 raft_consensus.cc:2640] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:36.905587 13161 raft_consensus.cc:667] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Becoming Leader. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Running, Role: LEADER I0401 16:41:36.905815 13161 consensus_queue.cc:206] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } I0401 16:41:36.908574 12796 catalog_manager.cc:3977] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c reported cstate change: term changed from 0 to 1, leader changed from to 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1). New cstate: current_term: 1 leader_uuid: "46a1ffbde8cb4162990fb2785a682d2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: HEALTHY } } } I0401 16:41:37.003634 13023 raft_consensus.cc:2886] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:37.005813 13023 raft_consensus.cc:1181] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Refusing update from remote peer 46a1ffbde8cb4162990fb2785a682d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.006595 13161 consensus_queue.cc:984] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.012269 13092 raft_consensus.cc:1181] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Refusing update from remote peer 46a1ffbde8cb4162990fb2785a682d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.013195 13142 consensus_queue.cc:984] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.040385 13023 raft_consensus.cc:2886] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:37.041968 12939 raft_consensus.cc:1181] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Refusing update from remote peer 37c64d6d84ba4b82a4befb752c172f5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.042541 13144 consensus_queue.cc:984] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.044333 13023 raft_consensus.cc:1181] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Refusing update from remote peer 37c64d6d84ba4b82a4befb752c172f5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.045130 13144 consensus_queue.cc:984] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.057963 13197 raft_consensus.cc:472] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:37.058099 13197 raft_consensus.cc:494] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:37.058686 13197 leader_election.cc:296] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:37.059067 13092 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e7a4b8a6de384b3ead437ec059b2eef5" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:37.059036 13023 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e7a4b8a6de384b3ead437ec059b2eef5" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:37.059401 13092 raft_consensus.cc:2307] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 46a1ffbde8cb4162990fb2785a682d2c for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:37.059401 13023 raft_consensus.cc:2276] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 46a1ffbde8cb4162990fb2785a682d2c in current term 1: Already voted for candidate 37c64d6d84ba4b82a4befb752c172f5e in this term. I0401 16:41:37.059819 12901 leader_election.cc:310] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 46a1ffbde8cb4162990fb2785a682d2c; no voters: 37c64d6d84ba4b82a4befb752c172f5e, d8dba20a0d5849dcb24e05863dc0a123 I0401 16:41:37.060045 13197 raft_consensus.cc:2886] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:37.061581 13197 raft_consensus.cc:2588] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:37.107599 12939 raft_consensus.cc:1181] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Refusing update from remote peer d8dba20a0d5849dcb24e05863dc0a123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.108080 13175 consensus_queue.cc:984] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.115849 13023 raft_consensus.cc:1181] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Refusing update from remote peer 46a1ffbde8cb4162990fb2785a682d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.116374 13092 raft_consensus.cc:1181] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Refusing update from remote peer d8dba20a0d5849dcb24e05863dc0a123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.116717 13161 consensus_queue.cc:984] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.116894 13146 consensus_queue.cc:984] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.122303 13093 raft_consensus.cc:1181] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Refusing update from remote peer 46a1ffbde8cb4162990fb2785a682d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.123252 13197 consensus_queue.cc:984] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.137460 13093 raft_consensus.cc:1181] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Refusing update from remote peer d8dba20a0d5849dcb24e05863dc0a123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.138046 13146 consensus_queue.cc:984] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.143200 12939 raft_consensus.cc:1181] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Refusing update from remote peer d8dba20a0d5849dcb24e05863dc0a123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.144368 13146 consensus_queue.cc:984] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:37.197324 13197 raft_consensus.cc:472] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:37.197465 13197 raft_consensus.cc:494] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:37.198133 13197 leader_election.cc:296] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:37.198606 13093 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "313183f8b0704fa58ee6bb03c0325a47" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" is_pre_election: true I0401 16:41:37.198606 13022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "313183f8b0704fa58ee6bb03c0325a47" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" is_pre_election: true I0401 16:41:37.198909 13022 raft_consensus.cc:2346] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 0. I0401 16:41:37.198909 13093 raft_consensus.cc:2346] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 0. I0401 16:41:37.199335 12901 leader_election.cc:310] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 46a1ffbde8cb4162990fb2785a682d2c, d8dba20a0d5849dcb24e05863dc0a123; no voters: I0401 16:41:37.199971 13197 raft_consensus.cc:2640] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:37.200080 13197 raft_consensus.cc:472] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:37.200175 13197 raft_consensus.cc:2886] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:37.202956 13197 raft_consensus.cc:494] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:37.203869 13197 leader_election.cc:296] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Requested vote from peers d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355), 37c64d6d84ba4b82a4befb752c172f5e (127.11.224.3:56700) I0401 16:41:37.204280 13022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "313183f8b0704fa58ee6bb03c0325a47" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d8dba20a0d5849dcb24e05863dc0a123" I0401 16:41:37.204280 13093 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "313183f8b0704fa58ee6bb03c0325a47" candidate_uuid: "46a1ffbde8cb4162990fb2785a682d2c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "37c64d6d84ba4b82a4befb752c172f5e" I0401 16:41:37.204493 13022 raft_consensus.cc:2886] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:37.204493 13093 raft_consensus.cc:2886] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:37.208067 13093 raft_consensus.cc:2346] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 1. I0401 16:41:37.208223 13022 raft_consensus.cc:2346] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 46a1ffbde8cb4162990fb2785a682d2c in term 1. I0401 16:41:37.208413 12904 leader_election.cc:310] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 37c64d6d84ba4b82a4befb752c172f5e, 46a1ffbde8cb4162990fb2785a682d2c; no voters: I0401 16:41:37.208696 13197 raft_consensus.cc:2640] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:37.208837 13197 raft_consensus.cc:667] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Becoming Leader. State: Replica: 46a1ffbde8cb4162990fb2785a682d2c, State: Running, Role: LEADER I0401 16:41:37.209139 13197 consensus_queue.cc:206] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } } I0401 16:41:37.212913 12796 catalog_manager.cc:3977] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c reported cstate change: term changed from 0 to 1, leader changed from to 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1). New cstate: current_term: 1 leader_uuid: "46a1ffbde8cb4162990fb2785a682d2c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 } health_report { overall_health: UNKNOWN } } } I0401 16:41:37.321305 13022 raft_consensus.cc:1181] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Refusing update from remote peer 37c64d6d84ba4b82a4befb752c172f5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.321911 13202 consensus_queue.cc:984] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.333042 12939 raft_consensus.cc:1181] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Refusing update from remote peer 37c64d6d84ba4b82a4befb752c172f5e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.334877 13202 consensus_queue.cc:984] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [LEADER]: Connected to new peer: Peer: permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s I0401 16:41:37.348737 12939 raft_consensus.cc:1181] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Refusing update from remote peer d8dba20a0d5849dcb24e05863dc0a123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.349362 13177 consensus_queue.cc:984] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "46a1ffbde8cb4162990fb2785a682d2c" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:37.351006 13022 raft_consensus.cc:1181] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Refusing update from remote peer 46a1ffbde8cb4162990fb2785a682d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.351605 13142 consensus_queue.cc:984] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:37.358822 13093 raft_consensus.cc:1181] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Refusing update from remote peer d8dba20a0d5849dcb24e05863dc0a123: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.360904 13175 consensus_queue.cc:984] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [LEADER]: Connected to new peer: Peer: permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.371543 13092 raft_consensus.cc:1181] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Refusing update from remote peer 46a1ffbde8cb4162990fb2785a682d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.374397 13161 consensus_queue.cc:984] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s I0401 16:41:37.437908 13092 raft_consensus.cc:1181] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Refusing update from remote peer 46a1ffbde8cb4162990fb2785a682d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.439393 13226 consensus_queue.cc:984] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "37c64d6d84ba4b82a4befb752c172f5e" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 56700 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:37.447084 13022 raft_consensus.cc:1181] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Refusing update from remote peer 46a1ffbde8cb4162990fb2785a682d2c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:37.448365 13161 consensus_queue.cc:984] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [LEADER]: Connected to new peer: Peer: permanent_uuid: "d8dba20a0d5849dcb24e05863dc0a123" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 52355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:37.524507 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:37.549324 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:37.549604 12160 tablet_replica.cc:264] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.549855 12160 raft_consensus.cc:2143] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.550091 12160 raft_consensus.cc:2170] T e7a4b8a6de384b3ead437ec059b2eef5 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.551177 12160 tablet_replica.cc:264] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.551390 12160 raft_consensus.cc:2143] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.551574 12160 raft_consensus.cc:2170] T c7e6874d51284fa4a1cfde0a2ce07e8a P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.552574 12160 tablet_replica.cc:264] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.552831 12160 raft_consensus.cc:2143] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.553122 12160 pending_rounds.cc:64] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c: Trying to abort 1 pending transactions. I0401 16:41:37.553279 12160 pending_rounds.cc:70] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365847950171021312 op_type: NO_OP noop_request { } I0401 16:41:37.553510 12160 raft_consensus.cc:2723] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:37.553664 12160 raft_consensus.cc:2170] T 313183f8b0704fa58ee6bb03c0325a47 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.554533 12160 tablet_replica.cc:264] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.554755 12160 raft_consensus.cc:2143] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.555035 12160 raft_consensus.cc:2170] T 5cd867ea58ed4b0f94a00683e468c72f P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.555891 12160 tablet_replica.cc:264] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.556102 12160 raft_consensus.cc:2143] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.556315 12160 raft_consensus.cc:2170] T 952c63a4d69146b19220a4a9789f70b5 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.558295 12160 tablet_replica.cc:264] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.558527 12160 raft_consensus.cc:2143] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.558841 12160 raft_consensus.cc:2170] T 4a3ab93d6988404697e9d57ff3b08276 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.559986 12160 tablet_replica.cc:264] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.560209 12160 raft_consensus.cc:2143] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.560437 12160 raft_consensus.cc:2170] T 1528709f2f9a40618394fc1ba6bd2922 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.561595 12160 tablet_replica.cc:264] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.561820 12160 raft_consensus.cc:2143] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.562036 12160 raft_consensus.cc:2170] T bd721271b4404021931802cc9a11675b P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.563369 12160 tablet_replica.cc:264] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.563588 12160 raft_consensus.cc:2143] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.563982 12160 raft_consensus.cc:2170] T 0002a2c87a5144abbd53c3a79bbf0557 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.565065 12160 tablet_replica.cc:264] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c: stopping tablet replica I0401 16:41:37.565248 12160 raft_consensus.cc:2143] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.565523 12160 raft_consensus.cc:2170] T 4307b4e29325490c8eec5a83768940a7 P 46a1ffbde8cb4162990fb2785a682d2c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.578028 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:37.578209 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:37.578478 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:37.583883 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:37.604312 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:37.604591 12160 tablet_replica.cc:264] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.604871 12160 raft_consensus.cc:2143] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.605116 12160 raft_consensus.cc:2170] T 313183f8b0704fa58ee6bb03c0325a47 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.605893 12160 tablet_replica.cc:264] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.606079 12160 raft_consensus.cc:2143] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.606246 12160 raft_consensus.cc:2170] T e7a4b8a6de384b3ead437ec059b2eef5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.607378 12160 tablet_replica.cc:264] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.607563 12160 raft_consensus.cc:2143] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.607887 12160 raft_consensus.cc:2170] T bd721271b4404021931802cc9a11675b P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.609072 12160 tablet_replica.cc:264] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.609520 12160 raft_consensus.cc:2143] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.609938 12160 raft_consensus.cc:2170] T 4307b4e29325490c8eec5a83768940a7 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! W0401 16:41:37.610635 13056 consensus_peers.cc:457] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e -> Peer 46a1ffbde8cb4162990fb2785a682d2c (127.11.224.1:60895): Couldn't send request to peer 46a1ffbde8cb4162990fb2785a682d2c. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:60895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:37.610867 12160 tablet_replica.cc:264] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.611033 12160 raft_consensus.cc:2143] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.611150 12160 raft_consensus.cc:2170] T 0002a2c87a5144abbd53c3a79bbf0557 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.612032 12160 tablet_replica.cc:264] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.612159 12160 raft_consensus.cc:2143] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.612298 12160 raft_consensus.cc:2170] T 4a3ab93d6988404697e9d57ff3b08276 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.613029 12160 tablet_replica.cc:264] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.613168 12160 raft_consensus.cc:2143] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.613338 12160 raft_consensus.cc:2170] T 1528709f2f9a40618394fc1ba6bd2922 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.614487 12160 tablet_replica.cc:264] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.614609 12160 raft_consensus.cc:2143] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.614812 12160 raft_consensus.cc:2170] T 952c63a4d69146b19220a4a9789f70b5 P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.615572 12160 tablet_replica.cc:264] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.615710 12160 raft_consensus.cc:2143] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.616003 12160 raft_consensus.cc:2170] T c7e6874d51284fa4a1cfde0a2ce07e8a P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.616780 12160 tablet_replica.cc:264] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123: stopping tablet replica I0401 16:41:37.616973 12160 raft_consensus.cc:2143] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.617118 12160 raft_consensus.cc:2170] T 5cd867ea58ed4b0f94a00683e468c72f P d8dba20a0d5849dcb24e05863dc0a123 [term 1 FOLLOWER]: Raft consensus is shut down! W0401 16:41:37.625821 13055 consensus_peers.cc:457] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e -> Peer d8dba20a0d5849dcb24e05863dc0a123 (127.11.224.2:52355): Couldn't send request to peer d8dba20a0d5849dcb24e05863dc0a123. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.2:52355: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:37.773057 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:37.773176 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:37.773416 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:37.777114 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:37.790354 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:37.790490 12160 tablet_replica.cc:264] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.790629 12160 raft_consensus.cc:2143] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.790747 12160 raft_consensus.cc:2170] T 5cd867ea58ed4b0f94a00683e468c72f P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.791563 12160 tablet_replica.cc:264] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.791669 12160 raft_consensus.cc:2143] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.791757 12160 raft_consensus.cc:2170] T c7e6874d51284fa4a1cfde0a2ce07e8a P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.792335 12160 tablet_replica.cc:264] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.792434 12160 raft_consensus.cc:2143] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.792527 12160 raft_consensus.cc:2170] T 313183f8b0704fa58ee6bb03c0325a47 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.792896 12160 tablet_replica.cc:264] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.792995 12160 raft_consensus.cc:2143] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.793082 12160 raft_consensus.cc:2170] T bd721271b4404021931802cc9a11675b P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.793637 12160 tablet_replica.cc:264] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.793732 12160 raft_consensus.cc:2143] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.793948 12160 raft_consensus.cc:2170] T e7a4b8a6de384b3ead437ec059b2eef5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.794570 12160 tablet_replica.cc:264] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.794670 12160 raft_consensus.cc:2143] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.794759 12160 raft_consensus.cc:2170] T 952c63a4d69146b19220a4a9789f70b5 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.795325 12160 tablet_replica.cc:264] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.795419 12160 raft_consensus.cc:2143] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.795512 12160 raft_consensus.cc:2170] T 4a3ab93d6988404697e9d57ff3b08276 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.796046 12160 tablet_replica.cc:264] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.796146 12160 raft_consensus.cc:2143] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.796299 12160 raft_consensus.cc:2170] T 1528709f2f9a40618394fc1ba6bd2922 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.796964 12160 tablet_replica.cc:264] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.797065 12160 raft_consensus.cc:2143] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.797158 12160 raft_consensus.cc:2170] T 4307b4e29325490c8eec5a83768940a7 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.797713 12160 tablet_replica.cc:264] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e: stopping tablet replica I0401 16:41:37.797827 12160 raft_consensus.cc:2143] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.797917 12160 raft_consensus.cc:2170] T 0002a2c87a5144abbd53c3a79bbf0557 P 37c64d6d84ba4b82a4befb752c172f5e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.814306 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:37.814363 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:37.814517 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:37.817915 12160 master.cc:270] Master@127.11.224.62:47883 shutting down... I0401 16:41:37.827373 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.827527 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.827622 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P d2204fb616014e5c944c1d7538ec0efc: stopping tablet replica I0401 16:41:37.841485 12160 master.cc:281] Master@127.11.224.62:47883 shutdown complete. I0401 16:41:37.844117 12160 master.cc:270] Master@127.11.224.61:55560 shutting down... I0401 16:41:37.853379 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:37.853646 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.853724 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 9e4b1b33f83944a09262a70c9b11c5d6: stopping tablet replica I0401 16:41:37.867450 12160 master.cc:281] Master@127.11.224.61:55560 shutdown complete. I0401 16:41:37.870265 12160 master.cc:270] Master@127.11.224.60:50532 shutting down... I0401 16:41:37.879513 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:37.879683 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:37.879776 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 1f9ec791a501435eab0d7b2836d621cb: stopping tablet replica I0401 16:41:37.893291 12160 master.cc:281] Master@127.11.224.60:50532 shutdown complete. [ OK ] RemoteKsckTest.TestCheckUnusualFlags (2423 ms) [ RUN ] RemoteKsckTest.TestTabletServerMismatchedUUID I0401 16:41:37.914172 12160 test_util.cc:212] Using random seed: -1882914519 I0401 16:41:37.914731 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:48516,127.11.224.61:39448,127.11.224.60:37168 I0401 16:41:37.918118 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 838931us I0401 16:41:37.918296 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:37.918351 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:37.918465 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:37.918510 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:37.919003 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" format_stamp: "Formatted at 2019-04-01 23:41:37 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:37.923279 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s I0401 16:41:37.924082 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:37.925949 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:37.926005 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-0-root uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" format_stamp: "Formatted at 2019-04-01 23:41:37 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:37.926102 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:37.984882 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:48516 I0401 16:41:37.985633 12160 webserver.cc:308] Webserver started at http://127.11.224.62:47029/ using document root and password file I0401 16:41:37.986735 13304 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:37.988942 13304 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:37.989619 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 838931us I0401 16:41:37.990116 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:37.990877 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:37.991395 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:37.991513 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:37.992244 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "201391c7ace24cd3892f79bf40365093" format_stamp: "Formatted at 2019-04-01 23:41:37 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:37.997054 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s I0401 16:41:37.997056 13304 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:37.997836 13304 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:39448: Network error: Client connection negotiation failed: client connection to 127.11.224.61:39448: connect: Connection refused (error 111) I0401 16:41:37.998183 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:38.000229 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:38.000298 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-1-root uuid: "201391c7ace24cd3892f79bf40365093" format_stamp: "Formatted at 2019-04-01 23:41:37 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.000378 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:38.045953 13304 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } attempt: 1 W0401 16:41:38.047188 13304 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:39448: Network error: Client connection negotiation failed: client connection to 127.11.224.61:39448: connect: Connection refused (error 111) I0401 16:41:38.049475 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:39448 I0401 16:41:38.050180 12160 webserver.cc:308] Webserver started at http://127.11.224.61:57399/ using document root and password file I0401 16:41:38.051277 13361 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.053321 13361 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:38.054497 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 839431us I0401 16:41:38.054780 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:38.054894 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:38.055021 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:38.055090 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:38.055703 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "417834d010834e939b776a60ca3dc755" format_stamp: "Formatted at 2019-04-01 23:41:38 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.059247 13361 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:38.060519 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s I0401 16:41:38.061905 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:38.064465 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:38.064565 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-2-root uuid: "417834d010834e939b776a60ca3dc755" format_stamp: "Formatted at 2019-04-01 23:41:38 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.064735 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:38.065317 13361 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:38.066305 13361 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:37168: Network error: Client connection negotiation failed: client connection to 127.11.224.60:37168: connect: Connection refused (error 111) I0401 16:41:38.102069 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:37168 I0401 16:41:38.102821 12160 webserver.cc:308] Webserver started at http://127.11.224.60:55515/ using document root and password file I0401 16:41:38.103185 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:38.103799 13418 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.105691 13418 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:38.110327 13418 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:38.110373 13304 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } attempt: 2 I0401 16:41:38.114961 13418 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:38.116291 13304 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:38.125159 13304 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c: Bootstrap starting. I0401 16:41:38.125159 13418 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755: Bootstrap starting. I0401 16:41:38.127573 13304 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c: No blocks or log segments found. Creating new log. I0401 16:41:38.127573 13361 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } attempt: 1 I0401 16:41:38.128384 13418 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755: No blocks or log segments found. Creating new log. I0401 16:41:38.131621 13304 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c: No bootstrap required, opened a new log I0401 16:41:38.132652 13304 raft_consensus.cc:340] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.132977 13304 raft_consensus.cc:366] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.133057 13304 raft_consensus.cc:705] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 18e7cff7e17e4f0c895f3d9a1cf6886c, State: Initialized, Role: FOLLOWER I0401 16:41:38.133373 13304 consensus_queue.cc:229] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.134183 13304 sys_catalog.cc:337] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.134186 13425 sys_catalog.cc:337] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.134726 13418 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755: No bootstrap required, opened a new log I0401 16:41:38.134799 13304 sys_catalog.cc:340] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.134802 13425 sys_catalog.cc:340] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.135453 13304 sys_catalog.cc:424] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:38.136342 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:41:38.135862 13418 raft_consensus.cc:340] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.136656 13418 raft_consensus.cc:366] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.136782 13418 raft_consensus.cc:705] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 417834d010834e939b776a60ca3dc755, State: Initialized, Role: FOLLOWER I0401 16:41:38.137198 13418 consensus_queue.cc:229] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.137393 13361 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093: Bootstrap starting. I0401 16:41:38.138173 13418 sys_catalog.cc:337] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.138571 13418 sys_catalog.cc:340] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.138209 13427 sys_catalog.cc:337] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.138942 13427 sys_catalog.cc:340] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: This master's current role is: FOLLOWER W0401 16:41:38.139199 13426 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c: acquiring CA information for follower catalog manager: Not found: root CA entry not found I0401 16:41:38.139302 13418 sys_catalog.cc:424] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: configured and running, proceeding with master startup. W0401 16:41:38.139323 13426 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:38.139860 13361 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093: No blocks or log segments found. Creating new log. W0401 16:41:38.141261 13428 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:38.141353 13428 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:38.141997 13361 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093: No bootstrap required, opened a new log I0401 16:41:38.142508 13361 raft_consensus.cc:340] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.142644 13361 raft_consensus.cc:366] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.142683 13361 raft_consensus.cc:705] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 201391c7ace24cd3892f79bf40365093, State: Initialized, Role: FOLLOWER I0401 16:41:38.142838 13361 consensus_queue.cc:229] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.143241 13361 sys_catalog.cc:337] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.143497 13361 sys_catalog.cc:340] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.143309 13430 sys_catalog.cc:337] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.143638 13430 sys_catalog.cc:340] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.143817 13361 sys_catalog.cc:424] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:38.144161 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:38.145695 13431 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:38.145779 13431 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:38.148994 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 839431us I0401 16:41:38.149158 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:38.149217 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:38.149312 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:38.149355 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:38.149780 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "06f0213f87654957840d437566ac9c74" format_stamp: "Formatted at 2019-04-01 23:41:38 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.153574 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s I0401 16:41:38.154320 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:38.156591 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:38.156648 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root uuid: "06f0213f87654957840d437566ac9c74" format_stamp: "Formatted at 2019-04-01 23:41:38 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.156740 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:38.214617 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:38.214681 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:38.231408 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:44443 I0401 16:41:38.232213 12160 webserver.cc:308] Webserver started at http://127.11.224.1:38660/ using document root and password file I0401 16:41:38.243090 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 839431us I0401 16:41:38.243680 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:38.243835 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:38.244048 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:38.244211 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:38.245283 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "08c5d9e5b99c47b99a22fe631293c55c" format_stamp: "Formatted at 2019-04-01 23:41:38 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.246464 13497 heartbeater.cc:345] Connected to a master server at 127.11.224.60:37168 I0401 16:41:38.246724 13498 heartbeater.cc:345] Connected to a master server at 127.11.224.62:48516 I0401 16:41:38.246878 13498 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.247045 13497 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.247596 13498 heartbeater.cc:475] Master 127.11.224.62:48516 requested a full tablet report, sending... I0401 16:41:38.247594 13497 heartbeater.cc:475] Master 127.11.224.60:37168 requested a full tablet report, sending... I0401 16:41:38.248034 13496 heartbeater.cc:345] Connected to a master server at 127.11.224.61:39448 I0401 16:41:38.248172 13496 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.249075 13385 ts_manager.cc:159] Registered new tserver with Master: 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443) I0401 16:41:38.249279 13271 ts_manager.cc:159] Registered new tserver with Master: 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443) I0401 16:41:38.249502 13496 heartbeater.cc:475] Master 127.11.224.61:39448 requested a full tablet report, sending... I0401 16:41:38.250596 13328 ts_manager.cc:159] Registered new tserver with Master: 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443) I0401 16:41:38.251642 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s I0401 16:41:38.252418 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:38.255044 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:38.255115 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-1-root uuid: "08c5d9e5b99c47b99a22fe631293c55c" format_stamp: "Formatted at 2019-04-01 23:41:38 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.255199 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:38.271894 13425 raft_consensus.cc:472] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:38.272063 13425 raft_consensus.cc:494] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.273169 13425 leader_election.cc:296] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 201391c7ace24cd3892f79bf40365093 (127.11.224.61:39448), 417834d010834e939b776a60ca3dc755 (127.11.224.60:37168) I0401 16:41:38.273703 13338 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201391c7ace24cd3892f79bf40365093" is_pre_election: true I0401 16:41:38.274237 13338 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18e7cff7e17e4f0c895f3d9a1cf6886c in term 0. I0401 16:41:38.274235 13395 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417834d010834e939b776a60ca3dc755" is_pre_election: true I0401 16:41:38.274700 13395 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 18e7cff7e17e4f0c895f3d9a1cf6886c in term 0. I0401 16:41:38.274837 13255 leader_election.cc:310] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e7cff7e17e4f0c895f3d9a1cf6886c, 201391c7ace24cd3892f79bf40365093; no voters: I0401 16:41:38.275223 13425 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:38.275323 13425 raft_consensus.cc:472] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:38.275419 13425 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.277273 13425 raft_consensus.cc:494] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.277835 13425 leader_election.cc:296] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [CANDIDATE]: Term 1 election: Requested vote from peers 201391c7ace24cd3892f79bf40365093 (127.11.224.61:39448), 417834d010834e939b776a60ca3dc755 (127.11.224.60:37168) I0401 16:41:38.278208 13338 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "201391c7ace24cd3892f79bf40365093" I0401 16:41:38.278213 13395 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "417834d010834e939b776a60ca3dc755" I0401 16:41:38.278446 13338 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.278451 13395 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.280614 13338 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e7cff7e17e4f0c895f3d9a1cf6886c in term 1. I0401 16:41:38.280977 13255 leader_election.cc:310] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 18e7cff7e17e4f0c895f3d9a1cf6886c, 201391c7ace24cd3892f79bf40365093; no voters: I0401 16:41:38.281297 13425 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:38.281656 13395 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 18e7cff7e17e4f0c895f3d9a1cf6886c in term 1. I0401 16:41:38.282166 13425 raft_consensus.cc:667] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 1 LEADER]: Becoming Leader. State: Replica: 18e7cff7e17e4f0c895f3d9a1cf6886c, State: Running, Role: LEADER I0401 16:41:38.282475 13425 consensus_queue.cc:206] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } I0401 16:41:38.285022 13509 sys_catalog.cc:337] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18e7cff7e17e4f0c895f3d9a1cf6886c. Latest consensus state: current_term: 1 leader_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.286677 13509 sys_catalog.cc:340] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: This master's current role is: LEADER I0401 16:41:38.288125 13513 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:38.290192 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:38.290253 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:38.290765 13513 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:38.332429 13395 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 1 FOLLOWER]: Refusing update from remote peer 18e7cff7e17e4f0c895f3d9a1cf6886c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:38.333209 13338 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 1 FOLLOWER]: Refusing update from remote peer 18e7cff7e17e4f0c895f3d9a1cf6886c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:38.333211 13509 consensus_queue.cc:984] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [LEADER]: Connected to new peer: Peer: permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:38.334023 13425 consensus_queue.cc:984] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [LEADER]: Connected to new peer: Peer: permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:38.340237 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:43295 I0401 16:41:38.348047 13427 sys_catalog.cc:337] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18e7cff7e17e4f0c895f3d9a1cf6886c. Latest consensus state: current_term: 1 leader_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.347358 13430 sys_catalog.cc:337] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 18e7cff7e17e4f0c895f3d9a1cf6886c. Latest consensus state: current_term: 1 leader_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.348569 13427 sys_catalog.cc:340] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.349200 13430 sys_catalog.cc:340] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.353801 12160 webserver.cc:308] Webserver started at http://127.11.224.2:56065/ using document root and password file I0401 16:41:38.356071 13509 sys_catalog.cc:337] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.359825 13509 sys_catalog.cc:340] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: This master's current role is: LEADER I0401 16:41:38.361788 13513 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:38.359561 13575 sys_catalog.cc:337] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.361366 13430 sys_catalog.cc:337] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.362342 13430 sys_catalog.cc:340] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.363075 13575 sys_catalog.cc:340] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [sys.catalog]: This master's current role is: LEADER I0401 16:41:38.364976 13513 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:38.372020 13427 sys_catalog.cc:337] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "18e7cff7e17e4f0c895f3d9a1cf6886c" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 48516 } } peers { permanent_uuid: "201391c7ace24cd3892f79bf40365093" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39448 } } peers { permanent_uuid: "417834d010834e939b776a60ca3dc755" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37168 } } } I0401 16:41:38.372398 13427 sys_catalog.cc:340] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:38.376461 13579 heartbeater.cc:345] Connected to a master server at 127.11.224.61:39448 I0401 16:41:38.376794 13579 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.378655 13579 heartbeater.cc:475] Master 127.11.224.61:39448 requested a full tablet report, sending... I0401 16:41:38.380167 13328 ts_manager.cc:159] Registered new tserver with Master: 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.384048 13580 heartbeater.cc:345] Connected to a master server at 127.11.224.60:37168 I0401 16:41:38.384194 13580 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.384726 13580 heartbeater.cc:475] Master 127.11.224.60:37168 requested a full tablet report, sending... I0401 16:41:38.386077 13385 ts_manager.cc:159] Registered new tserver with Master: 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.390929 13513 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c: Generated new TSK 0 I0401 16:41:38.392277 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 839431us I0401 16:41:38.392493 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:38.392593 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:38.392829 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:38.392928 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:38.393597 13582 heartbeater.cc:345] Connected to a master server at 127.11.224.62:48516 I0401 16:41:38.393594 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "23af318238484ef9a92eb95e6550dfcc" format_stamp: "Formatted at 2019-04-01 23:41:38 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.393756 13582 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.394309 13582 heartbeater.cc:475] Master 127.11.224.62:48516 requested a full tablet report, sending... I0401 16:41:38.395074 13270 ts_manager.cc:159] Registered new tserver with Master: 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.395457 13271 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:33905 I0401 16:41:38.396610 13270 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:33908 I0401 16:41:38.400467 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.000s sys 0.005s I0401 16:41:38.401326 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:38.404260 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:38.404319 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-2-root uuid: "23af318238484ef9a92eb95e6550dfcc" format_stamp: "Formatted at 2019-04-01 23:41:38 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:38.404402 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:38.408581 13582 heartbeater.cc:467] Master 127.11.224.62:48516 was elected leader, sending a full tablet report... I0401 16:41:38.410295 13498 heartbeater.cc:467] Master 127.11.224.62:48516 was elected leader, sending a full tablet report... I0401 16:41:38.419137 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:38.419193 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:38.461007 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:38333 I0401 16:41:38.461874 12160 webserver.cc:308] Webserver started at http://127.11.224.3:33932/ using document root and password file I0401 16:41:38.493975 13650 heartbeater.cc:345] Connected to a master server at 127.11.224.60:37168 I0401 16:41:38.494133 13650 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.496517 13650 heartbeater.cc:475] Master 127.11.224.60:37168 requested a full tablet report, sending... I0401 16:41:38.497561 13649 heartbeater.cc:345] Connected to a master server at 127.11.224.61:39448 I0401 16:41:38.497720 13649 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.498210 13649 heartbeater.cc:475] Master 127.11.224.61:39448 requested a full tablet report, sending... I0401 16:41:38.499316 13385 ts_manager.cc:159] Registered new tserver with Master: 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:38.499577 13328 ts_manager.cc:159] Registered new tserver with Master: 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:38.499909 13651 heartbeater.cc:345] Connected to a master server at 127.11.224.62:48516 I0401 16:41:38.499980 13651 heartbeater.cc:426] Registering TS with master... I0401 16:41:38.500152 13651 heartbeater.cc:475] Master 127.11.224.62:48516 requested a full tablet report, sending... I0401 16:41:38.500967 13271 ts_manager.cc:159] Registered new tserver with Master: 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:38.501832 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.010269538s I0401 16:41:38.501907 13271 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:33911 I0401 16:41:38.513522 13651 heartbeater.cc:467] Master 127.11.224.62:48516 was elected leader, sending a full tablet report... I0401 16:41:38.526968 13271 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.62:33912: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:38.527838 13271 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:38.581995 13462 tablet_service.cc:1006] Processing CreateTablet for tablet 04f81e1b2f3e4f3f9d0b780d60d45c39 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:38.586021 13456 tablet_service.cc:1006] Processing CreateTablet for tablet d621d7353f94423ba39af452834b78d4 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:38.586663 13461 tablet_service.cc:1006] Processing CreateTablet for tablet 37932eedad8b4cc0976a2646090f84b3 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:38.585541 13459 tablet_service.cc:1006] Processing CreateTablet for tablet 86f4a446b8dd4d9abb1d9214303842e3 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:38.586208 13458 tablet_service.cc:1006] Processing CreateTablet for tablet 55a20d481298439c9464da6bd6a35dee (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:38.587282 13462 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 04f81e1b2f3e4f3f9d0b780d60d45c39. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.587499 13463 tablet_service.cc:1006] Processing CreateTablet for tablet 384e1ddffaff458485ef136a4df89922 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:38.588380 13460 tablet_service.cc:1006] Processing CreateTablet for tablet f87568f1327546d48d3cea2e12ebd08b (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:38.586978 13455 tablet_service.cc:1006] Processing CreateTablet for tablet 96dfd007ed1d43b5baae5e46cf2ba91a (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:38.590019 13454 tablet_service.cc:1006] Processing CreateTablet for tablet 28edfa2828274f5d894d568f23c58db8 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:38.590668 13457 tablet_service.cc:1006] Processing CreateTablet for tablet 1f1318e7978b461897280d152a86b709 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:38.591162 13463 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 384e1ddffaff458485ef136a4df89922. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.591642 13459 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 86f4a446b8dd4d9abb1d9214303842e3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.591900 13460 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f87568f1327546d48d3cea2e12ebd08b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.592074 13537 tablet_service.cc:1006] Processing CreateTablet for tablet 384e1ddffaff458485ef136a4df89922 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:38.592200 13458 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 55a20d481298439c9464da6bd6a35dee. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.592589 13455 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 96dfd007ed1d43b5baae5e46cf2ba91a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.592687 13537 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 384e1ddffaff458485ef136a4df89922. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.592885 13457 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1f1318e7978b461897280d152a86b709. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.593302 13461 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 37932eedad8b4cc0976a2646090f84b3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.593600 13454 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 28edfa2828274f5d894d568f23c58db8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.593885 13456 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d621d7353f94423ba39af452834b78d4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.602486 13531 tablet_service.cc:1006] Processing CreateTablet for tablet 1f1318e7978b461897280d152a86b709 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:38.600813 13534 tablet_service.cc:1006] Processing CreateTablet for tablet f87568f1327546d48d3cea2e12ebd08b (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:38.605482 13532 tablet_service.cc:1006] Processing CreateTablet for tablet 55a20d481298439c9464da6bd6a35dee (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:38.604790 13535 tablet_service.cc:1006] Processing CreateTablet for tablet 37932eedad8b4cc0976a2646090f84b3 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:38.607081 13530 tablet_service.cc:1006] Processing CreateTablet for tablet d621d7353f94423ba39af452834b78d4 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:38.610446 13531 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1f1318e7978b461897280d152a86b709. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.608904 13533 tablet_service.cc:1006] Processing CreateTablet for tablet 86f4a446b8dd4d9abb1d9214303842e3 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:38.610348 13536 tablet_service.cc:1006] Processing CreateTablet for tablet 04f81e1b2f3e4f3f9d0b780d60d45c39 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:38.611889 13528 tablet_service.cc:1006] Processing CreateTablet for tablet 28edfa2828274f5d894d568f23c58db8 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:38.614090 13529 tablet_service.cc:1006] Processing CreateTablet for tablet 96dfd007ed1d43b5baae5e46cf2ba91a (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:38.618669 13616 tablet_service.cc:1006] Processing CreateTablet for tablet 384e1ddffaff458485ef136a4df89922 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:38.619415 13532 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 55a20d481298439c9464da6bd6a35dee. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.620653 13612 tablet_service.cc:1006] Processing CreateTablet for tablet 86f4a446b8dd4d9abb1d9214303842e3 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:38.619325 13611 tablet_service.cc:1006] Processing CreateTablet for tablet 55a20d481298439c9464da6bd6a35dee (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:38.623251 13614 tablet_service.cc:1006] Processing CreateTablet for tablet 37932eedad8b4cc0976a2646090f84b3 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:38.621034 13615 tablet_service.cc:1006] Processing CreateTablet for tablet 04f81e1b2f3e4f3f9d0b780d60d45c39 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:38.624433 13610 tablet_service.cc:1006] Processing CreateTablet for tablet 1f1318e7978b461897280d152a86b709 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:38.628062 13536 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 04f81e1b2f3e4f3f9d0b780d60d45c39. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.630064 13613 tablet_service.cc:1006] Processing CreateTablet for tablet f87568f1327546d48d3cea2e12ebd08b (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:38.630872 13616 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 384e1ddffaff458485ef136a4df89922. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.632480 13607 tablet_service.cc:1006] Processing CreateTablet for tablet 28edfa2828274f5d894d568f23c58db8 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:38.630327 13608 tablet_service.cc:1006] Processing CreateTablet for tablet 96dfd007ed1d43b5baae5e46cf2ba91a (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:38.629271 13609 tablet_service.cc:1006] Processing CreateTablet for tablet d621d7353f94423ba39af452834b78d4 (table=ksck-test-table [id=b2780429a9da4bb1930940fc1ffe9921]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:38.637442 13615 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 04f81e1b2f3e4f3f9d0b780d60d45c39. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.639425 13529 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 96dfd007ed1d43b5baae5e46cf2ba91a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.645412 13608 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 96dfd007ed1d43b5baae5e46cf2ba91a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.645596 13533 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 86f4a446b8dd4d9abb1d9214303842e3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.652362 13610 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1f1318e7978b461897280d152a86b709. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.652698 13530 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d621d7353f94423ba39af452834b78d4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.659497 13528 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 28edfa2828274f5d894d568f23c58db8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.660193 13609 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d621d7353f94423ba39af452834b78d4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.663431 13535 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 37932eedad8b4cc0976a2646090f84b3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.667749 13612 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 86f4a446b8dd4d9abb1d9214303842e3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.670027 13611 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 55a20d481298439c9464da6bd6a35dee. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.672005 13534 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f87568f1327546d48d3cea2e12ebd08b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.680536 13613 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f87568f1327546d48d3cea2e12ebd08b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.681018 13614 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 37932eedad8b4cc0976a2646090f84b3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.682008 13607 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 28edfa2828274f5d894d568f23c58db8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:38.764993 13670 tablet_bootstrap.cc:439] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:38.772591 13669 tablet_bootstrap.cc:439] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:38.789635 13670 tablet_bootstrap.cc:590] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:38.790531 13669 tablet_bootstrap.cc:590] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:38.791049 13671 tablet_bootstrap.cc:439] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:38.794718 13670 tablet_bootstrap.cc:439] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:38.795212 13670 ts_tablet_manager.cc:1053] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.002s I0401 16:41:38.796340 13670 raft_consensus.cc:340] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.796787 13670 raft_consensus.cc:366] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.796988 13670 raft_consensus.cc:705] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:38.797235 13670 consensus_queue.cc:229] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.799481 13670 ts_tablet_manager.cc:1081] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s I0401 16:41:38.799803 13670 tablet_bootstrap.cc:439] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:38.800658 13669 tablet_bootstrap.cc:439] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:38.800693 13671 tablet_bootstrap.cc:590] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:38.800951 13669 ts_tablet_manager.cc:1053] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.003s I0401 16:41:38.802781 13669 raft_consensus.cc:340] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.803934 13669 raft_consensus.cc:366] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.804162 13669 raft_consensus.cc:705] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:38.804486 13669 consensus_queue.cc:229] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.806622 13670 tablet_bootstrap.cc:590] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:38.808326 13669 ts_tablet_manager.cc:1081] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s I0401 16:41:38.808677 13669 tablet_bootstrap.cc:439] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:38.809324 13671 tablet_bootstrap.cc:439] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:38.810541 13671 ts_tablet_manager.cc:1053] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.026s user 0.000s sys 0.007s I0401 16:41:38.815650 13669 tablet_bootstrap.cc:590] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:38.815731 13670 tablet_bootstrap.cc:439] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:38.815943 13670 ts_tablet_manager.cc:1053] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.004s I0401 16:41:38.817910 13671 raft_consensus.cc:340] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:38.817911 13670 raft_consensus.cc:340] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.818754 13671 raft_consensus.cc:366] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.818936 13670 raft_consensus.cc:366] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.819056 13671 raft_consensus.cc:705] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:38.819173 13670 raft_consensus.cc:705] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:38.819403 13671 consensus_queue.cc:229] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:38.819604 13670 consensus_queue.cc:229] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.820667 13670 ts_tablet_manager.cc:1081] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s I0401 16:41:38.823896 13669 tablet_bootstrap.cc:439] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:38.824297 13670 tablet_bootstrap.cc:439] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:38.824359 13669 ts_tablet_manager.cc:1053] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.002s I0401 16:41:38.827116 13671 ts_tablet_manager.cc:1081] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.016s user 0.002s sys 0.005s I0401 16:41:38.827451 13671 tablet_bootstrap.cc:439] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:38.827026 13669 raft_consensus.cc:340] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.828794 13669 raft_consensus.cc:366] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.828981 13669 raft_consensus.cc:705] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:38.829514 13669 consensus_queue.cc:229] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.830456 13671 tablet_bootstrap.cc:590] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:38.830454 13670 tablet_bootstrap.cc:590] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:38.831193 13669 ts_tablet_manager.cc:1081] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s I0401 16:41:38.833159 13669 tablet_bootstrap.cc:439] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:38.837204 13671 tablet_bootstrap.cc:439] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:38.837574 13669 tablet_bootstrap.cc:590] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:38.837572 13671 ts_tablet_manager.cc:1053] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.004s I0401 16:41:38.839933 13670 tablet_bootstrap.cc:439] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:38.840653 13670 ts_tablet_manager.cc:1053] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.004s I0401 16:41:38.840407 13671 raft_consensus.cc:340] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.841121 13671 raft_consensus.cc:366] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.841274 13671 raft_consensus.cc:705] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:38.841915 13671 consensus_queue.cc:229] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.842191 13670 raft_consensus.cc:340] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:38.843041 13671 ts_tablet_manager.cc:1081] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s I0401 16:41:38.844337 13671 tablet_bootstrap.cc:439] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:38.844601 13670 raft_consensus.cc:366] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.845134 13670 raft_consensus.cc:705] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:38.845882 13670 consensus_queue.cc:229] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:38.847488 13669 tablet_bootstrap.cc:439] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:38.847723 13669 ts_tablet_manager.cc:1053] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s I0401 16:41:38.848940 13671 tablet_bootstrap.cc:590] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:38.850095 13670 ts_tablet_manager.cc:1081] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.008s user 0.001s sys 0.002s I0401 16:41:38.850369 13670 tablet_bootstrap.cc:439] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:38.851675 13669 raft_consensus.cc:340] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.852471 13669 raft_consensus.cc:366] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.852705 13669 raft_consensus.cc:705] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:38.853075 13669 consensus_queue.cc:229] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.853366 13670 tablet_bootstrap.cc:590] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:38.853902 13669 ts_tablet_manager.cc:1081] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s I0401 16:41:38.854245 13669 tablet_bootstrap.cc:439] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:38.855365 13671 tablet_bootstrap.cc:439] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:38.855631 13671 ts_tablet_manager.cc:1053] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.004s I0401 16:41:38.857189 13671 raft_consensus.cc:340] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.857342 13671 raft_consensus.cc:366] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.857400 13671 raft_consensus.cc:705] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:38.857586 13671 consensus_queue.cc:229] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.861028 13671 ts_tablet_manager.cc:1081] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:38.862463 13679 raft_consensus.cc:472] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:38.863440 13671 tablet_bootstrap.cc:439] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:38.863430 13679 raft_consensus.cc:494] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:38.864617 13679 leader_election.cc:296] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:38.866294 13674 raft_consensus.cc:472] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:38.866744 13674 raft_consensus.cc:494] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:38.865871 13669 tablet_bootstrap.cc:590] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:38.868973 13674 leader_election.cc:296] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.880419 13670 tablet_bootstrap.cc:439] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:38.881054 13670 ts_tablet_manager.cc:1053] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.006s I0401 16:41:38.882833 13671 tablet_bootstrap.cc:590] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:38.887727 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true I0401 16:41:38.889529 13626 raft_consensus.cc:2346] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 0. I0401 16:41:38.889894 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:38.891338 13507 leader_election.cc:310] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:38.888129 13670 raft_consensus.cc:340] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.890627 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:38.892401 13547 raft_consensus.cc:2346] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 0. I0401 16:41:38.893605 13670 raft_consensus.cc:366] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.894127 13679 raft_consensus.cc:2640] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election won for term 1 W0401 16:41:38.894186 13505 leader_election.cc:348] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:38.894896 13679 raft_consensus.cc:472] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:38.895020 13679 raft_consensus.cc:2886] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.895298 13670 raft_consensus.cc:705] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:38.895537 13590 leader_election.cc:310] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:38.895596 13670 consensus_queue.cc:229] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.895925 13674 raft_consensus.cc:2640] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:38.896574 13674 raft_consensus.cc:472] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:38.896721 13674 raft_consensus.cc:2886] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.903467 13669 tablet_bootstrap.cc:439] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:38.903654 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:38.905745 13669 ts_tablet_manager.cc:1053] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.050s user 0.002s sys 0.010s W0401 16:41:38.907562 13587 leader_election.cc:348] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:38.907341 13674 raft_consensus.cc:494] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:38.910223 13669 raft_consensus.cc:340] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.910905 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:38.909938 13679 raft_consensus.cc:494] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:38.911639 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" W0401 16:41:38.912662 13587 leader_election.cc:348] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:38.912766 13669 raft_consensus.cc:366] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.912900 13669 raft_consensus.cc:705] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:38.913267 13674 leader_election.cc:296] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.915392 13669 consensus_queue.cc:229] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.916127 13669 ts_tablet_manager.cc:1081] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.010s user 0.003s sys 0.000s I0401 16:41:38.916424 13547 raft_consensus.cc:2276] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 23af318238484ef9a92eb95e6550dfcc in current term 1: Already voted for candidate 08c5d9e5b99c47b99a22fe631293c55c in this term. I0401 16:41:38.919247 13590 leader_election.cc:310] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23af318238484ef9a92eb95e6550dfcc; no voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c I0401 16:41:38.919535 13671 tablet_bootstrap.cc:439] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:38.920409 13669 tablet_bootstrap.cc:439] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:38.921440 13670 ts_tablet_manager.cc:1081] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.037s user 0.002s sys 0.009s I0401 16:41:38.921640 13689 raft_consensus.cc:472] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:38.921757 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" I0401 16:41:38.921753 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:38.922262 13671 ts_tablet_manager.cc:1053] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.059s user 0.002s sys 0.019s W0401 16:41:38.922376 13505 leader_election.cc:348] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:38.922011 13689 raft_consensus.cc:494] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.923215 13687 raft_consensus.cc:2588] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority I0401 16:41:38.923461 13626 raft_consensus.cc:2276] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 08c5d9e5b99c47b99a22fe631293c55c in current term 1: Already voted for candidate 23af318238484ef9a92eb95e6550dfcc in this term. I0401 16:41:38.923774 13679 leader_election.cc:296] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:38.924573 13507 leader_election.cc:310] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c; no voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc I0401 16:41:38.924219 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "55a20d481298439c9464da6bd6a35dee" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:38.925225 13473 raft_consensus.cc:2346] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 0. I0401 16:41:38.925896 13505 leader_election.cc:310] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c; no voters: I0401 16:41:38.926043 13671 raft_consensus.cc:340] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.926606 13669 tablet_bootstrap.cc:590] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:38.926965 13670 tablet_bootstrap.cc:439] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:38.929853 13671 raft_consensus.cc:366] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.930140 13671 raft_consensus.cc:705] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:38.929936 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "55a20d481298439c9464da6bd6a35dee" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true I0401 16:41:38.930734 13679 raft_consensus.cc:2588] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority W0401 16:41:38.930999 13507 leader_election.cc:348] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:38.930855 13689 leader_election.cc:296] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:38.932216 13679 raft_consensus.cc:2640] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:38.932909 13679 raft_consensus.cc:472] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:38.932654 13671 consensus_queue.cc:229] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.935442 13679 raft_consensus.cc:2886] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.937360 13671 ts_tablet_manager.cc:1081] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s I0401 16:41:38.937974 13671 tablet_bootstrap.cc:439] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:38.940814 13674 raft_consensus.cc:472] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:38.941020 13674 raft_consensus.cc:494] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.941311 13687 raft_consensus.cc:472] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:38.943406 13674 leader_election.cc:296] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.943409 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "04f81e1b2f3e4f3f9d0b780d60d45c39" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:38.942478 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "04f81e1b2f3e4f3f9d0b780d60d45c39" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:38.943949 13473 raft_consensus.cc:2346] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 0. I0401 16:41:38.944448 13587 leader_election.cc:310] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:38.944633 13670 tablet_bootstrap.cc:590] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. W0401 16:41:38.944821 13590 leader_election.cc:348] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:38.944907 13674 raft_consensus.cc:2640] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:38.945881 13674 raft_consensus.cc:472] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:38.946421 13674 raft_consensus.cc:2886] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.946849 13671 tablet_bootstrap.cc:590] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:38.945169 13687 raft_consensus.cc:494] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.950204 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "96dfd007ed1d43b5baae5e46cf2ba91a" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:38.950609 13473 raft_consensus.cc:2346] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 0. I0401 16:41:38.950613 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "96dfd007ed1d43b5baae5e46cf2ba91a" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:38.951145 13547 raft_consensus.cc:2346] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 0. I0401 16:41:38.951537 13669 tablet_bootstrap.cc:439] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:38.951786 13679 raft_consensus.cc:494] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.951784 13587 leader_election.cc:310] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:38.950613 13687 leader_election.cc:296] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.952746 13687 raft_consensus.cc:2640] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:38.952802 13669 ts_tablet_manager.cc:1053] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.004s I0401 16:41:38.953379 13687 raft_consensus.cc:472] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:38.954272 13687 raft_consensus.cc:2886] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.954226 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "55a20d481298439c9464da6bd6a35dee" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" I0401 16:41:38.954267 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "55a20d481298439c9464da6bd6a35dee" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:38.954617 13473 raft_consensus.cc:2886] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.954624 13679 leader_election.cc:296] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) W0401 16:41:38.955384 13507 leader_election.cc:348] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:38.956353 13674 raft_consensus.cc:494] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.959215 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "04f81e1b2f3e4f3f9d0b780d60d45c39" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" I0401 16:41:38.959517 13674 leader_election.cc:296] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.960222 13669 raft_consensus.cc:340] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } W0401 16:41:38.961567 13590 leader_election.cc:348] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:38.960065 13472 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "04f81e1b2f3e4f3f9d0b780d60d45c39" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:38.963757 13669 raft_consensus.cc:366] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.963804 13472 raft_consensus.cc:2886] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.964746 13473 raft_consensus.cc:2346] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 1. I0401 16:41:38.965049 13669 raft_consensus.cc:705] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:38.965392 13505 leader_election.cc:310] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c; no voters: 23af318238484ef9a92eb95e6550dfcc I0401 16:41:38.966449 13679 raft_consensus.cc:2640] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:38.966620 13669 consensus_queue.cc:229] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.968109 13679 raft_consensus.cc:667] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 1 LEADER]: Becoming Leader. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Running, Role: LEADER I0401 16:41:38.972229 13669 ts_tablet_manager.cc:1081] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.016s user 0.001s sys 0.002s I0401 16:41:38.973577 13669 tablet_bootstrap.cc:439] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:38.973582 13679 consensus_queue.cc:206] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.978266 13670 tablet_bootstrap.cc:439] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:38.979238 13670 ts_tablet_manager.cc:1053] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.057s user 0.003s sys 0.004s I0401 16:41:38.980382 13671 tablet_bootstrap.cc:439] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:38.980604 13687 raft_consensus.cc:494] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.981640 13671 ts_tablet_manager.cc:1053] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.044s user 0.005s sys 0.005s I0401 16:41:38.982511 13669 tablet_bootstrap.cc:590] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:38.982502 13270 catalog_manager.cc:3977] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c reported cstate change: term changed from 0 to 1, leader changed from to 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2). New cstate: current_term: 1 leader_uuid: "08c5d9e5b99c47b99a22fe631293c55c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: UNKNOWN } } } I0401 16:41:38.983698 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "96dfd007ed1d43b5baae5e46cf2ba91a" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:38.987283 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "96dfd007ed1d43b5baae5e46cf2ba91a" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" I0401 16:41:38.987447 13473 raft_consensus.cc:2886] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.988184 13687 leader_election.cc:296] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:38.989212 13547 raft_consensus.cc:2886] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:38.990223 13472 raft_consensus.cc:2346] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 1. I0401 16:41:38.988262 13670 raft_consensus.cc:340] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.991098 13587 leader_election.cc:310] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc; no voters: 08c5d9e5b99c47b99a22fe631293c55c I0401 16:41:38.992198 13687 raft_consensus.cc:2640] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:38.988524 13671 raft_consensus.cc:340] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.994011 13670 raft_consensus.cc:366] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.995815 13671 raft_consensus.cc:366] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:38.996326 13670 raft_consensus.cc:705] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:38.995785 13687 raft_consensus.cc:667] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 1 LEADER]: Becoming Leader. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Running, Role: LEADER I0401 16:41:38.996887 13547 raft_consensus.cc:2346] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 1. I0401 16:41:38.997697 13590 leader_election.cc:310] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:38.998244 13674 raft_consensus.cc:2640] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:38.998381 13674 raft_consensus.cc:667] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 1 LEADER]: Becoming Leader. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Running, Role: LEADER I0401 16:41:38.999100 13674 consensus_queue.cc:206] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.999312 13473 raft_consensus.cc:2346] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 1. I0401 16:41:38.999824 13671 raft_consensus.cc:705] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:38.998857 13670 consensus_queue.cc:229] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.000181 13671 consensus_queue.cc:229] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:38.998929 13687 consensus_queue.cc:206] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.004443 13670 ts_tablet_manager.cc:1081] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.024s user 0.001s sys 0.001s I0401 16:41:39.005012 13671 ts_tablet_manager.cc:1081] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.022s user 0.002s sys 0.001s I0401 16:41:39.005432 13670 tablet_bootstrap.cc:439] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:39.006188 13671 tablet_bootstrap.cc:439] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:39.007738 13669 tablet_bootstrap.cc:439] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:39.007624 13270 catalog_manager.cc:3977] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc reported cstate change: term changed from 0 to 1, leader changed from to 23af318238484ef9a92eb95e6550dfcc (127.11.224.3). New cstate: current_term: 1 leader_uuid: "23af318238484ef9a92eb95e6550dfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: HEALTHY } } } I0401 16:41:39.010785 13669 ts_tablet_manager.cc:1053] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.004s I0401 16:41:39.011868 13669 raft_consensus.cc:340] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:39.012454 13669 raft_consensus.cc:366] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.012620 13669 raft_consensus.cc:705] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:39.015174 13670 tablet_bootstrap.cc:590] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:39.014943 13669 consensus_queue.cc:229] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:39.019992 13669 ts_tablet_manager.cc:1081] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s I0401 16:41:39.022096 13270 catalog_manager.cc:3977] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc reported cstate change: term changed from 0 to 1, leader changed from to 23af318238484ef9a92eb95e6550dfcc (127.11.224.3). New cstate: current_term: 1 leader_uuid: "23af318238484ef9a92eb95e6550dfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: HEALTHY } } } I0401 16:41:39.023241 13669 tablet_bootstrap.cc:439] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:39.033931 13676 raft_consensus.cc:472] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.034195 13676 raft_consensus.cc:494] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.044353 13676 leader_election.cc:296] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.046221 13669 tablet_bootstrap.cc:590] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:39.046592 13671 tablet_bootstrap.cc:590] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:39.057636 13670 tablet_bootstrap.cc:439] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:39.058699 13670 ts_tablet_manager.cc:1053] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.054s user 0.002s sys 0.021s I0401 16:41:39.059949 13669 tablet_bootstrap.cc:439] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:39.060142 13669 ts_tablet_manager.cc:1053] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.040s user 0.001s sys 0.006s I0401 16:41:39.060211 13671 tablet_bootstrap.cc:439] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:39.060551 13671 ts_tablet_manager.cc:1053] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.055s user 0.001s sys 0.005s I0401 16:41:39.061234 13670 raft_consensus.cc:340] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.062014 13670 raft_consensus.cc:366] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.062021 13671 raft_consensus.cc:340] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.062448 13671 raft_consensus.cc:366] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.062754 13671 raft_consensus.cc:705] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:39.062985 13670 raft_consensus.cc:705] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:39.062019 13669 raft_consensus.cc:340] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.063132 13671 consensus_queue.cc:229] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.064429 13671 ts_tablet_manager.cc:1081] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s I0401 16:41:39.066046 13669 raft_consensus.cc:366] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.063863 13670 consensus_queue.cc:229] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.067407 13669 raft_consensus.cc:705] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:39.067452 13671 tablet_bootstrap.cc:439] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:39.067720 13669 consensus_queue.cc:229] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.070088 13670 ts_tablet_manager.cc:1081] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.011s user 0.003s sys 0.000s I0401 16:41:39.070894 13670 tablet_bootstrap.cc:439] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:39.073406 13669 ts_tablet_manager.cc:1081] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.013s user 0.000s sys 0.003s I0401 16:41:39.073946 13669 tablet_bootstrap.cc:439] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:39.077296 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d621d7353f94423ba39af452834b78d4" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:39.077803 13547 raft_consensus.cc:2346] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0213f87654957840d437566ac9c74 in term 0. I0401 16:41:39.078591 13437 leader_election.cc:310] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c; no voters: I0401 16:41:39.079039 13671 tablet_bootstrap.cc:590] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:39.079763 13676 raft_consensus.cc:2640] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:39.080138 13676 raft_consensus.cc:472] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:39.080282 13676 raft_consensus.cc:2886] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.080323 13670 tablet_bootstrap.cc:590] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:39.081264 13669 tablet_bootstrap.cc:590] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:39.081524 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d621d7353f94423ba39af452834b78d4" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true W0401 16:41:39.082690 13436 leader_election.cc:348] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:39.086683 13676 raft_consensus.cc:494] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.086899 13671 tablet_bootstrap.cc:439] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:39.089082 13671 ts_tablet_manager.cc:1053] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.003s I0401 16:41:39.089357 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d621d7353f94423ba39af452834b78d4" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" I0401 16:41:39.090015 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d621d7353f94423ba39af452834b78d4" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" W0401 16:41:39.090736 13436 leader_election.cc:348] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:39.091683 13676 leader_election.cc:296] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 election: Requested vote from peers 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.091688 13547 raft_consensus.cc:2886] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.093413 13671 raft_consensus.cc:340] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.094229 13671 raft_consensus.cc:366] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.094725 13669 tablet_bootstrap.cc:439] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:39.095011 13669 ts_tablet_manager.cc:1053] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.008s I0401 16:41:39.096115 13669 raft_consensus.cc:340] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.096920 13669 raft_consensus.cc:366] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.096917 13547 raft_consensus.cc:2346] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0213f87654957840d437566ac9c74 in term 1. I0401 16:41:39.097082 13669 raft_consensus.cc:705] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:39.096740 13671 raft_consensus.cc:705] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:39.097323 13437 leader_election.cc:310] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c; no voters: 23af318238484ef9a92eb95e6550dfcc I0401 16:41:39.097615 13669 consensus_queue.cc:229] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.098139 13676 raft_consensus.cc:2640] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:39.098417 13671 consensus_queue.cc:229] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.102643 13676 raft_consensus.cc:667] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 1 LEADER]: Becoming Leader. State: Replica: 06f0213f87654957840d437566ac9c74, State: Running, Role: LEADER I0401 16:41:39.103361 13671 ts_tablet_manager.cc:1081] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.011s user 0.001s sys 0.002s I0401 16:41:39.104115 13669 ts_tablet_manager.cc:1081] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.006s user 0.001s sys 0.002s I0401 16:41:39.107261 13670 tablet_bootstrap.cc:439] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:39.108538 13670 ts_tablet_manager.cc:1053] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.008s I0401 16:41:39.105881 13676 consensus_queue.cc:206] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.108824 13669 tablet_bootstrap.cc:439] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:39.109333 13671 tablet_bootstrap.cc:439] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:39.112203 13670 raft_consensus.cc:340] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.112637 13670 raft_consensus.cc:366] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.113060 13670 raft_consensus.cc:705] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:39.113322 13670 consensus_queue.cc:229] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.113318 13270 catalog_manager.cc:3977] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 reported cstate change: term changed from 0 to 1, leader changed from to 06f0213f87654957840d437566ac9c74 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "06f0213f87654957840d437566ac9c74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: UNKNOWN } } } I0401 16:41:39.114398 13670 ts_tablet_manager.cc:1081] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s I0401 16:41:39.115996 13670 tablet_bootstrap.cc:439] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:39.116159 13669 tablet_bootstrap.cc:590] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:39.122460 13670 tablet_bootstrap.cc:590] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:39.124898 13671 tablet_bootstrap.cc:590] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:39.126447 13669 tablet_bootstrap.cc:439] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:39.126685 13669 ts_tablet_manager.cc:1053] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.005s I0401 16:41:39.127876 13669 raft_consensus.cc:340] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.128285 13669 raft_consensus.cc:366] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.128953 13669 raft_consensus.cc:705] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER I0401 16:41:39.129449 13669 consensus_queue.cc:229] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.130323 13669 ts_tablet_manager.cc:1081] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s I0401 16:41:39.131253 13669 tablet_bootstrap.cc:439] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74: Bootstrap starting. I0401 16:41:39.133754 13671 tablet_bootstrap.cc:439] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:39.134341 13671 ts_tablet_manager.cc:1053] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.030s user 0.001s sys 0.005s I0401 16:41:39.134855 13670 tablet_bootstrap.cc:439] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:39.135069 13670 ts_tablet_manager.cc:1053] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.005s I0401 16:41:39.136184 13669 tablet_bootstrap.cc:590] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74: No blocks or log segments found. Creating new log. I0401 16:41:39.136037 13670 raft_consensus.cc:340] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.137122 13670 raft_consensus.cc:366] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.137122 13679 raft_consensus.cc:472] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.137362 13670 raft_consensus.cc:705] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:39.137360 13679 raft_consensus.cc:494] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.137979 13670 consensus_queue.cc:229] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.138226 13679 leader_election.cc:296] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.139729 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "86f4a446b8dd4d9abb1d9214303842e3" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:39.140172 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "86f4a446b8dd4d9abb1d9214303842e3" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true I0401 16:41:39.140349 13473 raft_consensus.cc:2346] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 0. I0401 16:41:39.138885 13671 raft_consensus.cc:340] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.140566 13670 ts_tablet_manager.cc:1081] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:39.141445 13505 leader_election.cc:310] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c; no voters: I0401 16:41:39.145860 13671 raft_consensus.cc:366] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely W0401 16:41:39.146257 13507 leader_election.cc:348] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:39.146257 13671 raft_consensus.cc:705] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:39.147969 13679 raft_consensus.cc:2640] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:39.148090 13679 raft_consensus.cc:472] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:39.148496 13670 tablet_bootstrap.cc:439] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:39.149444 13679 raft_consensus.cc:2886] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.150451 13671 consensus_queue.cc:229] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.152140 13671 ts_tablet_manager.cc:1081] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.017s user 0.001s sys 0.001s I0401 16:41:39.153089 13671 tablet_bootstrap.cc:439] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:39.154913 13679 raft_consensus.cc:494] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.159240 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "86f4a446b8dd4d9abb1d9214303842e3" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:39.159238 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "86f4a446b8dd4d9abb1d9214303842e3" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" I0401 16:41:39.159559 13676 raft_consensus.cc:472] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.159698 13679 leader_election.cc:296] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.160015 13473 raft_consensus.cc:2886] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.160032 13676 raft_consensus.cc:494] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.161629 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "37932eedad8b4cc0976a2646090f84b3" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true I0401 16:41:39.161770 13626 raft_consensus.cc:2346] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0213f87654957840d437566ac9c74 in term 0. I0401 16:41:39.161844 13431 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093: acquiring CA information for follower catalog manager: success W0401 16:41:39.162330 13507 leader_election.cc:348] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:39.162598 13690 raft_consensus.cc:472] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.162751 13676 leader_election.cc:296] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.162972 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "37932eedad8b4cc0976a2646090f84b3" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:39.163153 13436 leader_election.cc:310] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:39.164762 13676 raft_consensus.cc:2640] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:39.164767 13428 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755: acquiring CA information for follower catalog manager: success I0401 16:41:39.164877 13676 raft_consensus.cc:472] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:39.163164 13690 raft_consensus.cc:494] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.165158 13669 tablet_bootstrap.cc:439] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74: No bootstrap required, opened a new log I0401 16:41:39.167428 13676 raft_consensus.cc:2886] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.167754 13687 raft_consensus.cc:472] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.167981 13670 tablet_bootstrap.cc:590] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:39.167981 13687 raft_consensus.cc:494] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.168146 13547 raft_consensus.cc:2346] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 06f0213f87654957840d437566ac9c74 in term 0. I0401 16:41:39.168434 13669 ts_tablet_manager.cc:1053] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74: Time spent bootstrapping tablet: real 0.035s user 0.002s sys 0.010s I0401 16:41:39.169064 13472 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "37932eedad8b4cc0976a2646090f84b3" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:39.169090 13690 leader_election.cc:296] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.170019 13687 leader_election.cc:296] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:39.170269 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "37932eedad8b4cc0976a2646090f84b3" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true I0401 16:41:39.170399 13626 raft_consensus.cc:2346] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 0. I0401 16:41:39.170877 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "28edfa2828274f5d894d568f23c58db8" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:39.171066 13507 leader_election.cc:310] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:39.171435 13547 raft_consensus.cc:2346] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 0. I0401 16:41:39.171058 13471 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "28edfa2828274f5d894d568f23c58db8" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:39.171593 13471 raft_consensus.cc:2346] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 0. I0401 16:41:39.171831 13690 raft_consensus.cc:2640] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:39.171903 13690 raft_consensus.cc:472] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:39.171957 13690 raft_consensus.cc:2886] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.171974 13587 leader_election.cc:310] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:39.172315 13473 raft_consensus.cc:2346] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 1. I0401 16:41:39.173051 13687 raft_consensus.cc:2640] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:39.173055 13505 leader_election.cc:310] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c; no voters: 23af318238484ef9a92eb95e6550dfcc I0401 16:41:39.173099 13687 raft_consensus.cc:472] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:39.173158 13687 raft_consensus.cc:2886] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.173349 13689 raft_consensus.cc:2640] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:39.174871 13671 tablet_bootstrap.cc:590] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:39.181351 13687 raft_consensus.cc:494] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.182055 13687 leader_election.cc:296] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:39.182346 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "28edfa2828274f5d894d568f23c58db8" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:39.182490 13473 raft_consensus.cc:2886] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.183209 13547 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "28edfa2828274f5d894d568f23c58db8" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" I0401 16:41:39.183326 13547 raft_consensus.cc:2886] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.184934 13676 raft_consensus.cc:494] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.185530 13676 leader_election.cc:296] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 election: Requested vote from peers 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.185686 13472 raft_consensus.cc:2276] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 08c5d9e5b99c47b99a22fe631293c55c in current term 1: Already voted for candidate 06f0213f87654957840d437566ac9c74 in this term. I0401 16:41:39.185922 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "37932eedad8b4cc0976a2646090f84b3" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" I0401 16:41:39.186028 13626 raft_consensus.cc:2886] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.186264 13546 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "37932eedad8b4cc0976a2646090f84b3" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" I0401 16:41:39.189775 13547 raft_consensus.cc:2346] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 1. I0401 16:41:39.190732 13690 raft_consensus.cc:494] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.196902 13546 raft_consensus.cc:2276] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 06f0213f87654957840d437566ac9c74 in current term 1: Already voted for candidate 08c5d9e5b99c47b99a22fe631293c55c in this term. I0401 16:41:39.196939 13590 leader_election.cc:310] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:39.197361 13687 raft_consensus.cc:2640] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:39.197455 13431 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:39.197458 13687 raft_consensus.cc:667] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 1 LEADER]: Becoming Leader. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Running, Role: LEADER I0401 16:41:39.197535 13626 raft_consensus.cc:2346] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 06f0213f87654957840d437566ac9c74 in term 1. I0401 16:41:39.197700 13687 consensus_queue.cc:206] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.197955 13436 leader_election.cc:310] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:39.198299 13676 raft_consensus.cc:2640] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:39.198388 13676 raft_consensus.cc:667] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 1 LEADER]: Becoming Leader. State: Replica: 06f0213f87654957840d437566ac9c74, State: Running, Role: LEADER I0401 16:41:39.198460 13472 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "37932eedad8b4cc0976a2646090f84b3" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:39.198537 13676 consensus_queue.cc:206] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.193809 13690 leader_election.cc:296] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.198959 13690 raft_consensus.cc:472] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.200570 13473 raft_consensus.cc:2346] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 1. I0401 16:41:39.199352 13690 raft_consensus.cc:494] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.200310 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "37932eedad8b4cc0976a2646090f84b3" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" I0401 16:41:39.201234 13626 raft_consensus.cc:2276] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 08c5d9e5b99c47b99a22fe631293c55c in current term 1: Already voted for candidate 06f0213f87654957840d437566ac9c74 in this term. I0401 16:41:39.202109 13690 leader_election.cc:296] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.202486 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f87568f1327546d48d3cea2e12ebd08b" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:39.202486 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f87568f1327546d48d3cea2e12ebd08b" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true I0401 16:41:39.200726 13669 raft_consensus.cc:340] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.202832 13669 raft_consensus.cc:366] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.202895 13669 raft_consensus.cc:705] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06f0213f87654957840d437566ac9c74, State: Initialized, Role: FOLLOWER W0401 16:41:39.203054 13507 leader_election.cc:348] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:39.203550 13669 consensus_queue.cc:229] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.204874 13473 raft_consensus.cc:2346] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 0. I0401 16:41:39.205703 13669 ts_tablet_manager.cc:1081] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74: Time spent starting tablet: real 0.037s user 0.002s sys 0.000s I0401 16:41:39.206063 13689 raft_consensus.cc:667] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 LEADER]: Becoming Leader. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Running, Role: LEADER I0401 16:41:39.206562 13505 leader_election.cc:310] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c; no voters: 23af318238484ef9a92eb95e6550dfcc I0401 16:41:39.207274 13690 raft_consensus.cc:2640] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:39.207321 13690 raft_consensus.cc:472] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:39.207366 13690 raft_consensus.cc:2886] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.208818 13428 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:39.208950 13472 raft_consensus.cc:2307] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 1 LEADER]: Leader election vote request: Denying vote to candidate 08c5d9e5b99c47b99a22fe631293c55c for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:39.207201 13689 consensus_queue.cc:206] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.211550 13671 tablet_bootstrap.cc:439] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:39.211668 13671 ts_tablet_manager.cc:1053] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.059s user 0.001s sys 0.010s I0401 16:41:39.212329 13505 leader_election.cc:310] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c; no voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc I0401 16:41:39.214085 13671 raft_consensus.cc:340] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.214238 13671 raft_consensus.cc:366] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.214263 13671 raft_consensus.cc:705] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:39.214380 13671 consensus_queue.cc:229] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.214799 13717 raft_consensus.cc:2588] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority I0401 16:41:39.214941 13671 ts_tablet_manager.cc:1081] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s I0401 16:41:39.215138 13671 tablet_bootstrap.cc:439] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c: Bootstrap starting. I0401 16:41:39.215371 13269 catalog_manager.cc:3977] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 reported cstate change: term changed from 0 to 1, leader changed from to 06f0213f87654957840d437566ac9c74 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "06f0213f87654957840d437566ac9c74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: UNKNOWN } } } I0401 16:41:39.216431 13671 tablet_bootstrap.cc:590] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c: No blocks or log segments found. Creating new log. I0401 16:41:39.219223 13690 raft_consensus.cc:494] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.220693 13472 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f87568f1327546d48d3cea2e12ebd08b" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:39.220829 13472 raft_consensus.cc:2886] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.223091 13472 raft_consensus.cc:2346] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 1. I0401 16:41:39.223522 13505 leader_election.cc:310] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c; no voters: I0401 16:41:39.223950 13690 leader_election.cc:296] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:39.224102 13690 raft_consensus.cc:2640] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:39.224228 13690 raft_consensus.cc:667] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 1 LEADER]: Becoming Leader. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Running, Role: LEADER I0401 16:41:39.224326 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f87568f1327546d48d3cea2e12ebd08b" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" W0401 16:41:39.224737 13507 leader_election.cc:348] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:39.224457 13690 consensus_queue.cc:206] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.227862 13269 catalog_manager.cc:3977] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c reported cstate change: term changed from 0 to 1, leader changed from to 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2). New cstate: current_term: 1 leader_uuid: "08c5d9e5b99c47b99a22fe631293c55c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: UNKNOWN } } } I0401 16:41:39.229476 13670 tablet_bootstrap.cc:439] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:39.229593 13670 ts_tablet_manager.cc:1053] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.089s user 0.004s sys 0.011s I0401 16:41:39.229215 13270 catalog_manager.cc:3977] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc reported cstate change: term changed from 0 to 1, leader changed from to 23af318238484ef9a92eb95e6550dfcc (127.11.224.3). New cstate: current_term: 1 leader_uuid: "23af318238484ef9a92eb95e6550dfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: HEALTHY } } } I0401 16:41:39.233588 13670 raft_consensus.cc:340] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.233750 13670 raft_consensus.cc:366] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.233786 13670 raft_consensus.cc:705] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:39.234987 13671 tablet_bootstrap.cc:439] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c: No bootstrap required, opened a new log I0401 16:41:39.235131 13671 ts_tablet_manager.cc:1053] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent bootstrapping tablet: real 0.020s user 0.004s sys 0.002s I0401 16:41:39.234782 13670 consensus_queue.cc:229] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.240752 13670 ts_tablet_manager.cc:1081] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.011s user 0.001s sys 0.002s I0401 16:41:39.241029 13670 tablet_bootstrap.cc:439] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc: Bootstrap starting. I0401 16:41:39.242697 13670 tablet_bootstrap.cc:590] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc: No blocks or log segments found. Creating new log. I0401 16:41:39.244149 13269 catalog_manager.cc:3977] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c reported cstate change: term changed from 0 to 1, leader changed from to 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2). New cstate: current_term: 1 leader_uuid: "08c5d9e5b99c47b99a22fe631293c55c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: UNKNOWN } } } I0401 16:41:39.240440 13671 raft_consensus.cc:340] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.245535 13671 raft_consensus.cc:366] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.245605 13671 raft_consensus.cc:705] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Initialized, Role: FOLLOWER I0401 16:41:39.245877 13671 consensus_queue.cc:229] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.250802 13671 ts_tablet_manager.cc:1081] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c: Time spent starting tablet: real 0.016s user 0.002s sys 0.000s I0401 16:41:39.253639 13670 tablet_bootstrap.cc:439] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc: No bootstrap required, opened a new log I0401 16:41:39.253926 13670 ts_tablet_manager.cc:1053] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.005s I0401 16:41:39.254469 13670 raft_consensus.cc:340] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.254585 13670 raft_consensus.cc:366] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:39.254622 13670 raft_consensus.cc:705] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Initialized, Role: FOLLOWER I0401 16:41:39.254760 13670 consensus_queue.cc:229] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.256057 13670 ts_tablet_manager.cc:1081] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s I0401 16:41:39.256409 13687 raft_consensus.cc:472] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.256489 13687 raft_consensus.cc:494] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.257171 13687 leader_election.cc:296] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:39.257580 13472 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1f1318e7978b461897280d152a86b709" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:39.257643 13546 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1f1318e7978b461897280d152a86b709" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:39.257740 13546 raft_consensus.cc:2346] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 0. I0401 16:41:39.257728 13472 raft_consensus.cc:2346] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 0. I0401 16:41:39.258066 13590 leader_election.cc:310] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:39.258260 13687 raft_consensus.cc:2640] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:39.258301 13687 raft_consensus.cc:472] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:39.258355 13687 raft_consensus.cc:2886] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.260061 13687 raft_consensus.cc:494] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.260577 13687 leader_election.cc:296] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:39.260833 13472 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1f1318e7978b461897280d152a86b709" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:39.260946 13472 raft_consensus.cc:2886] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.261126 13546 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1f1318e7978b461897280d152a86b709" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" I0401 16:41:39.261246 13546 raft_consensus.cc:2886] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.262253 13472 raft_consensus.cc:2346] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 1. I0401 16:41:39.262501 13587 leader_election.cc:310] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 06f0213f87654957840d437566ac9c74, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:39.262735 13687 raft_consensus.cc:2640] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:39.262830 13546 raft_consensus.cc:2346] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23af318238484ef9a92eb95e6550dfcc in term 1. I0401 16:41:39.262840 13687 raft_consensus.cc:667] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 1 LEADER]: Becoming Leader. State: Replica: 23af318238484ef9a92eb95e6550dfcc, State: Running, Role: LEADER I0401 16:41:39.263058 13687 consensus_queue.cc:206] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.265703 13269 catalog_manager.cc:3977] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc reported cstate change: term changed from 0 to 1, leader changed from to 23af318238484ef9a92eb95e6550dfcc (127.11.224.3). New cstate: current_term: 1 leader_uuid: "23af318238484ef9a92eb95e6550dfcc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: HEALTHY } } } I0401 16:41:39.370546 13687 raft_consensus.cc:472] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.370654 13687 raft_consensus.cc:494] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } I0401 16:41:39.371253 13687 leader_election.cc:296] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295), 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443) I0401 16:41:39.371599 13546 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "55a20d481298439c9464da6bd6a35dee" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:39.371665 13472 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "55a20d481298439c9464da6bd6a35dee" candidate_uuid: "23af318238484ef9a92eb95e6550dfcc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:39.371789 13546 raft_consensus.cc:2307] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 23af318238484ef9a92eb95e6550dfcc for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:39.371827 13472 raft_consensus.cc:2276] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23af318238484ef9a92eb95e6550dfcc in current term 1: Already voted for candidate 08c5d9e5b99c47b99a22fe631293c55c in this term. I0401 16:41:39.372280 13590 leader_election.cc:310] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23af318238484ef9a92eb95e6550dfcc; no voters: 06f0213f87654957840d437566ac9c74, 08c5d9e5b99c47b99a22fe631293c55c I0401 16:41:39.372509 13687 raft_consensus.cc:2886] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.374801 13687 raft_consensus.cc:2588] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:39.460793 13546 raft_consensus.cc:2886] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.462474 13546 raft_consensus.cc:1181] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Refusing update from remote peer 23af318238484ef9a92eb95e6550dfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.462982 13687 consensus_queue.cc:984] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.467474 13472 raft_consensus.cc:1181] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Refusing update from remote peer 23af318238484ef9a92eb95e6550dfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.469470 13687 consensus_queue.cc:984] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.482487 13676 raft_consensus.cc:472] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:39.482581 13676 raft_consensus.cc:494] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:39.483106 13676 leader_election.cc:296] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333), 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295) I0401 16:41:39.483428 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true I0401 16:41:39.483608 13626 raft_consensus.cc:2276] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06f0213f87654957840d437566ac9c74 in current term 1: Already voted for candidate 23af318238484ef9a92eb95e6550dfcc in this term. I0401 16:41:39.483484 13546 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "06f0213f87654957840d437566ac9c74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "08c5d9e5b99c47b99a22fe631293c55c" is_pre_election: true I0401 16:41:39.483703 13546 raft_consensus.cc:2276] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 06f0213f87654957840d437566ac9c74 in current term 1: Already voted for candidate 08c5d9e5b99c47b99a22fe631293c55c in this term. I0401 16:41:39.484119 13437 leader_election.cc:310] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 06f0213f87654957840d437566ac9c74; no voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc I0401 16:41:39.484340 13676 raft_consensus.cc:2886] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.486294 13676 raft_consensus.cc:2588] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:39.496506 13546 raft_consensus.cc:1181] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Refusing update from remote peer 06f0213f87654957840d437566ac9c74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.497092 13676 consensus_queue.cc:984] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.500494 13472 raft_consensus.cc:1181] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Refusing update from remote peer 23af318238484ef9a92eb95e6550dfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.501014 13687 consensus_queue.cc:984] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.501677 13626 raft_consensus.cc:2886] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.504724 13626 raft_consensus.cc:1181] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Refusing update from remote peer 06f0213f87654957840d437566ac9c74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.505465 13709 consensus_queue.cc:984] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.511349 13546 raft_consensus.cc:1181] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Refusing update from remote peer 23af318238484ef9a92eb95e6550dfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.512109 13692 consensus_queue.cc:984] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.550963 13626 raft_consensus.cc:1181] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Refusing update from remote peer 08c5d9e5b99c47b99a22fe631293c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.551425 13690 consensus_queue.cc:984] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.555534 13472 raft_consensus.cc:1181] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Refusing update from remote peer 08c5d9e5b99c47b99a22fe631293c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.556020 13679 consensus_queue.cc:984] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.597362 13472 raft_consensus.cc:1181] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Refusing update from remote peer 23af318238484ef9a92eb95e6550dfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.597841 13692 consensus_queue.cc:984] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.602355 13546 raft_consensus.cc:1181] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Refusing update from remote peer 23af318238484ef9a92eb95e6550dfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.603296 13674 consensus_queue.cc:984] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.621918 13626 raft_consensus.cc:2886] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.623579 13626 raft_consensus.cc:1181] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Refusing update from remote peer 08c5d9e5b99c47b99a22fe631293c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.624032 13679 consensus_queue.cc:984] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.629293 13472 raft_consensus.cc:1181] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Refusing update from remote peer 08c5d9e5b99c47b99a22fe631293c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.630340 13679 consensus_queue.cc:984] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.637609 13626 raft_consensus.cc:2886] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:39.639212 13626 raft_consensus.cc:1181] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Refusing update from remote peer 08c5d9e5b99c47b99a22fe631293c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.639652 13690 consensus_queue.cc:984] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.642942 13473 raft_consensus.cc:1181] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Refusing update from remote peer 08c5d9e5b99c47b99a22fe631293c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.643632 13679 consensus_queue.cc:984] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.700351 13473 raft_consensus.cc:1181] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Refusing update from remote peer 23af318238484ef9a92eb95e6550dfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.700850 13674 consensus_queue.cc:984] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.707428 13546 raft_consensus.cc:1181] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Refusing update from remote peer 23af318238484ef9a92eb95e6550dfcc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.708010 13674 consensus_queue.cc:984] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [LEADER]: Connected to new peer: Peer: permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.818820 13626 raft_consensus.cc:1181] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Refusing update from remote peer 06f0213f87654957840d437566ac9c74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.819327 13676 consensus_queue.cc:984] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:39.822659 13546 raft_consensus.cc:1181] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Refusing update from remote peer 06f0213f87654957840d437566ac9c74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:39.823287 13676 consensus_queue.cc:984] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:40.704277 13679 raft_consensus.cc:472] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:40.704444 13679 raft_consensus.cc:494] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:40.705312 13679 leader_election.cc:296] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:40.705549 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" is_pre_election: true I0401 16:41:40.705690 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" is_pre_election: true I0401 16:41:40.705766 13473 raft_consensus.cc:2346] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 1. I0401 16:41:40.705914 13626 raft_consensus.cc:2346] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 1. I0401 16:41:40.706213 13507 leader_election.cc:310] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:40.706840 13679 raft_consensus.cc:2640] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Leader pre-election won for term 2 I0401 16:41:40.706948 13679 raft_consensus.cc:472] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:40.707671 13679 raft_consensus.cc:2886] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Advancing to term 2 I0401 16:41:40.709893 13679 raft_consensus.cc:494] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:40.710701 13679 leader_election.cc:296] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 2 election: Requested vote from peers 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443), 23af318238484ef9a92eb95e6550dfcc (127.11.224.3:38333) I0401 16:41:40.711166 13626 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23af318238484ef9a92eb95e6550dfcc" I0401 16:41:40.711231 13473 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "384e1ddffaff458485ef136a4df89922" candidate_uuid: "08c5d9e5b99c47b99a22fe631293c55c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "06f0213f87654957840d437566ac9c74" I0401 16:41:40.711585 13473 raft_consensus.cc:2886] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Advancing to term 2 I0401 16:41:40.711587 13626 raft_consensus.cc:2886] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Advancing to term 2 I0401 16:41:40.713395 13626 raft_consensus.cc:2346] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 2. I0401 16:41:40.713448 13473 raft_consensus.cc:2346] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 08c5d9e5b99c47b99a22fe631293c55c in term 2. I0401 16:41:40.713740 13507 leader_election.cc:310] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 08c5d9e5b99c47b99a22fe631293c55c, 23af318238484ef9a92eb95e6550dfcc; no voters: I0401 16:41:40.714164 13679 raft_consensus.cc:2640] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 2 FOLLOWER]: Leader election won for term 2 I0401 16:41:40.714634 13679 raft_consensus.cc:667] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 2 LEADER]: Becoming Leader. State: Replica: 08c5d9e5b99c47b99a22fe631293c55c, State: Running, Role: LEADER I0401 16:41:40.714932 13679 consensus_queue.cc:206] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } } I0401 16:41:40.717432 13269 catalog_manager.cc:3977] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c reported cstate change: term changed from 0 to 2, leader changed from to 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2). New cstate: current_term: 2 leader_uuid: "08c5d9e5b99c47b99a22fe631293c55c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "08c5d9e5b99c47b99a22fe631293c55c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 43295 } health_report { overall_health: HEALTHY } } } I0401 16:41:41.121629 13473 raft_consensus.cc:1181] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 2 FOLLOWER]: Refusing update from remote peer 08c5d9e5b99c47b99a22fe631293c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch) I0401 16:41:41.122077 13679 consensus_queue.cc:984] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "06f0213f87654957840d437566ac9c74" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 44443 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:41.126979 13626 raft_consensus.cc:1181] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 2 FOLLOWER]: Refusing update from remote peer 08c5d9e5b99c47b99a22fe631293c55c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch) I0401 16:41:41.127822 13747 consensus_queue.cc:984] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [LEADER]: Connected to new peer: Peer: permanent_uuid: "23af318238484ef9a92eb95e6550dfcc" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:41.289716 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:41.308486 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:41.308609 12160 tablet_replica.cc:264] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.308745 12160 raft_consensus.cc:2143] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.308864 12160 raft_consensus.cc:2170] T f87568f1327546d48d3cea2e12ebd08b P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.309535 12160 tablet_replica.cc:264] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.309628 12160 raft_consensus.cc:2143] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.309705 12160 raft_consensus.cc:2170] T 28edfa2828274f5d894d568f23c58db8 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.310123 12160 tablet_replica.cc:264] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.310209 12160 raft_consensus.cc:2143] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 2 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.310284 12160 raft_consensus.cc:2170] T 384e1ddffaff458485ef136a4df89922 P 06f0213f87654957840d437566ac9c74 [term 2 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.311028 12160 tablet_replica.cc:264] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.311157 12160 raft_consensus.cc:2143] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.311236 12160 raft_consensus.cc:2170] T 1f1318e7978b461897280d152a86b709 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.311575 12160 tablet_replica.cc:264] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.311659 12160 raft_consensus.cc:2143] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.311861 12160 raft_consensus.cc:2170] T 37932eedad8b4cc0976a2646090f84b3 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.312214 12160 tablet_replica.cc:264] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.312297 12160 raft_consensus.cc:2143] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.312373 12160 raft_consensus.cc:2170] T 55a20d481298439c9464da6bd6a35dee P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.312703 12160 tablet_replica.cc:264] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.312788 12160 raft_consensus.cc:2143] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.312867 12160 raft_consensus.cc:2170] T 86f4a446b8dd4d9abb1d9214303842e3 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.313328 12160 tablet_replica.cc:264] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.313446 12160 raft_consensus.cc:2143] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.313524 12160 raft_consensus.cc:2170] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.314007 12160 tablet_replica.cc:264] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.314090 12160 raft_consensus.cc:2143] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.314240 12160 raft_consensus.cc:2170] T d621d7353f94423ba39af452834b78d4 P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.314585 12160 tablet_replica.cc:264] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74: stopping tablet replica I0401 16:41:41.314666 12160 raft_consensus.cc:2143] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.314739 12160 raft_consensus.cc:2170] T 96dfd007ed1d43b5baae5e46cf2ba91a P 06f0213f87654957840d437566ac9c74 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.324218 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:41.324318 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:41.324470 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:41.334213 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 840931us I0401 16:41:41.334399 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:41.334439 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:41.334533 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:41.334561 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:41.335057 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root2/instance: uuid: "52507c01ba774c228665fafcdf6a546b" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.341621 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.002s sys 0.002s I0401 16:41:41.342597 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:41.345546 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:41.345605 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root2 uuid: "52507c01ba774c228665fafcdf6a546b" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.345695 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root2 metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root2 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTabletServerMismatchedUUID.1554162092376624-12160/minicluster-data/ts-0-root2/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0401 16:41:41.348722 13505 consensus_peers.cc:457] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c -> Peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Couldn't send request to peer 06f0213f87654957840d437566ac9c74. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:44443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:41.369879 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:41.369942 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:41.393250 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:44443 I0401 16:41:41.394290 12160 webserver.cc:308] Webserver started at http://127.11.224.1:50977/ using document root and password file W0401 16:41:41.399238 13853 heartbeater.cc:587] Failed to heartbeat to 127.0.0.1:7051 (0 consecutive failures): Network error: Failed to ping master at 127.0.0.1:7051: Client connection negotiation failed: client connection to 127.0.0.1:7051: connect: Connection refused (error 111) W0401 16:41:41.401748 13853 heartbeater.cc:380] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. I0401 16:41:41.450995 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:41.465212 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... W0401 16:41:41.478379 13587 consensus_peers.cc:457] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc -> Peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Couldn't send request to peer 06f0213f87654957840d437566ac9c74. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:44443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. W0401 16:41:41.479902 13587 consensus_peers.cc:457] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc -> Peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Couldn't send request to peer 06f0213f87654957840d437566ac9c74. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:44443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:41.480638 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:41.480676 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:41.480942 12160 tablet_server.cc:179] TabletServer shutdown complete. W0401 16:41:41.482977 13587 consensus_peers.cc:457] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc -> Peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Couldn't send request to peer 06f0213f87654957840d437566ac9c74. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:44443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:41.483721 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:41.505975 13506 messenger.cc:381] Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer W0401 16:41:41.506445 13590 consensus_peers.cc:457] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc -> Peer 08c5d9e5b99c47b99a22fe631293c55c (127.11.224.2:43295): Couldn't send request to peer 08c5d9e5b99c47b99a22fe631293c55c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry. W0401 16:41:41.506955 13505 consensus_peers.cc:457] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c -> Peer 06f0213f87654957840d437566ac9c74 (127.11.224.1:44443): Couldn't send request to peer 06f0213f87654957840d437566ac9c74. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:44443: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:41.509438 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:41.509580 12160 tablet_replica.cc:264] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.509708 12160 raft_consensus.cc:2143] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.509821 12160 raft_consensus.cc:2170] T 28edfa2828274f5d894d568f23c58db8 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.510423 12160 tablet_replica.cc:264] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.510514 12160 raft_consensus.cc:2143] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.510699 12160 raft_consensus.cc:2170] T f87568f1327546d48d3cea2e12ebd08b P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.511121 12160 tablet_replica.cc:264] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.511209 12160 raft_consensus.cc:2143] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.511288 12160 raft_consensus.cc:2170] T d621d7353f94423ba39af452834b78d4 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.511626 12160 tablet_replica.cc:264] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.511711 12160 raft_consensus.cc:2143] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.511792 12160 raft_consensus.cc:2170] T 96dfd007ed1d43b5baae5e46cf2ba91a P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.512152 12160 tablet_replica.cc:264] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.512238 12160 raft_consensus.cc:2143] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.512317 12160 raft_consensus.cc:2170] T 1f1318e7978b461897280d152a86b709 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.512655 12160 tablet_replica.cc:264] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.512745 12160 raft_consensus.cc:2143] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.512826 12160 raft_consensus.cc:2170] T 37932eedad8b4cc0976a2646090f84b3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.513188 12160 tablet_replica.cc:264] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.513274 12160 raft_consensus.cc:2143] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.513423 12160 raft_consensus.cc:2170] T 55a20d481298439c9464da6bd6a35dee P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.514103 12160 tablet_replica.cc:264] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.514256 12160 raft_consensus.cc:2143] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.514416 12160 raft_consensus.cc:2170] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.515090 12160 tablet_replica.cc:264] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.515180 12160 raft_consensus.cc:2143] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.515337 12160 raft_consensus.cc:2170] T 86f4a446b8dd4d9abb1d9214303842e3 P 08c5d9e5b99c47b99a22fe631293c55c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.515697 12160 tablet_replica.cc:264] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c: stopping tablet replica I0401 16:41:41.515785 12160 raft_consensus.cc:2143] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 2 LEADER]: Raft consensus shutting down. I0401 16:41:41.515995 12160 raft_consensus.cc:2170] T 384e1ddffaff458485ef136a4df89922 P 08c5d9e5b99c47b99a22fe631293c55c [term 2 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.533578 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:41.533630 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:41.533776 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:41.537348 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:41.553258 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:41.553360 12160 tablet_replica.cc:264] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.553483 12160 raft_consensus.cc:2143] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.553591 12160 raft_consensus.cc:2170] T d621d7353f94423ba39af452834b78d4 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.554157 12160 tablet_replica.cc:264] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.554234 12160 raft_consensus.cc:2143] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.554400 12160 raft_consensus.cc:2170] T 1f1318e7978b461897280d152a86b709 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.554741 12160 tablet_replica.cc:264] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.554839 12160 raft_consensus.cc:2143] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.554916 12160 raft_consensus.cc:2170] T 55a20d481298439c9464da6bd6a35dee P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.555240 12160 tablet_replica.cc:264] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.555313 12160 raft_consensus.cc:2143] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.555377 12160 raft_consensus.cc:2170] T 37932eedad8b4cc0976a2646090f84b3 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.555696 12160 tablet_replica.cc:264] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.555768 12160 raft_consensus.cc:2143] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.555855 12160 raft_consensus.cc:2170] T f87568f1327546d48d3cea2e12ebd08b P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.556200 12160 tablet_replica.cc:264] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.556274 12160 raft_consensus.cc:2143] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.556437 12160 raft_consensus.cc:2170] T 28edfa2828274f5d894d568f23c58db8 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.556788 12160 tablet_replica.cc:264] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.556885 12160 raft_consensus.cc:2143] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 2 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.556952 12160 raft_consensus.cc:2170] T 384e1ddffaff458485ef136a4df89922 P 23af318238484ef9a92eb95e6550dfcc [term 2 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.557512 12160 tablet_replica.cc:264] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.557579 12160 raft_consensus.cc:2143] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.557709 12160 raft_consensus.cc:2170] T 96dfd007ed1d43b5baae5e46cf2ba91a P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.558066 12160 tablet_replica.cc:264] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.558136 12160 raft_consensus.cc:2143] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.558199 12160 raft_consensus.cc:2170] T 86f4a446b8dd4d9abb1d9214303842e3 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.558522 12160 tablet_replica.cc:264] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc: stopping tablet replica I0401 16:41:41.558589 12160 raft_consensus.cc:2143] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.558719 12160 raft_consensus.cc:2170] T 04f81e1b2f3e4f3f9d0b780d60d45c39 P 23af318238484ef9a92eb95e6550dfcc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.575155 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:41.575207 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:41.575364 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:41.578766 12160 master.cc:270] Master@127.11.224.62:48516 shutting down... I0401 16:41:41.588304 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:41.588574 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.588639 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 18e7cff7e17e4f0c895f3d9a1cf6886c: stopping tablet replica I0401 16:41:41.612628 12160 master.cc:281] Master@127.11.224.62:48516 shutdown complete. I0401 16:41:41.615463 12160 master.cc:270] Master@127.11.224.61:39448 shutting down... I0401 16:41:41.624846 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.624995 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.625061 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 201391c7ace24cd3892f79bf40365093: stopping tablet replica I0401 16:41:41.638563 12160 master.cc:281] Master@127.11.224.61:39448 shutdown complete. I0401 16:41:41.641077 12160 master.cc:270] Master@127.11.224.60:37168 shutting down... I0401 16:41:41.650640 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:41.650784 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:41.650876 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 417834d010834e939b776a60ca3dc755: stopping tablet replica I0401 16:41:41.664273 12160 master.cc:281] Master@127.11.224.60:37168 shutdown complete. [ OK ] RemoteKsckTest.TestTabletServerMismatchedUUID (3769 ms) [ RUN ] RemoteKsckTest.TestTableConsistency I0401 16:41:41.683115 12160 test_util.cc:212] Using random seed: -1879145572 I0401 16:41:41.683646 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:54067,127.11.224.61:43507,127.11.224.60:55817 I0401 16:41:41.686964 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 840931us I0401 16:41:41.687134 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:41.687171 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:41.687259 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:41.687286 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:41.687711 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "945cfa77e0464ef7908600619e1eacde" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.691843 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s I0401 16:41:41.692520 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:41.694311 12160 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.001s I0401 16:41:41.694355 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-0-root uuid: "945cfa77e0464ef7908600619e1eacde" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.694422 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:41.717604 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:54067 I0401 16:41:41.718274 12160 webserver.cc:308] Webserver started at http://127.11.224.62:35643/ using document root and password file I0401 16:41:41.719260 13923 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:41.721170 13923 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:41.721988 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 840931us I0401 16:41:41.722149 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:41.722209 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:41.722322 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:41.722379 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:41.723064 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "7add0c01d1c845d6af1e6612d46558c1" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.726658 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.002s sys 0.002s I0401 16:41:41.727480 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:41.729717 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:41.729792 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-1-root uuid: "7add0c01d1c845d6af1e6612d46558c1" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.729924 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:41.730659 13923 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:41.731384 13923 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:43507: Network error: Client connection negotiation failed: client connection to 127.11.224.61:43507: connect: Connection refused (error 111) I0401 16:41:41.752588 13923 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } attempt: 1 W0401 16:41:41.753513 13923 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:43507: Network error: Client connection negotiation failed: client connection to 127.11.224.61:43507: connect: Connection refused (error 111) I0401 16:41:41.792026 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:43507 I0401 16:41:41.792677 12160 webserver.cc:308] Webserver started at http://127.11.224.61:50427/ using document root and password file I0401 16:41:41.793648 13980 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:41.795773 13980 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:41.796926 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 840931us I0401 16:41:41.797086 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:41.797125 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:41.797212 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:41.797242 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:41.797752 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "8b91977a995b40aeb8aa0beaa589da13" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.800946 13980 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:41.802953 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s I0401 16:41:41.803704 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:41.806126 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:41.806167 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-2-root uuid: "8b91977a995b40aeb8aa0beaa589da13" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.806264 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:41.806551 13980 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:41.807210 13980 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:55817: Network error: Client connection negotiation failed: client connection to 127.11.224.60:55817: connect: Connection refused (error 111) I0401 16:41:41.825898 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:55817 I0401 16:41:41.826560 12160 webserver.cc:308] Webserver started at http://127.11.224.60:44187/ using document root and password file I0401 16:41:41.826689 13923 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } attempt: 2 I0401 16:41:41.826963 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:41.827620 14037 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:41.829670 14037 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:41.831396 13923 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:41.835263 14037 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:41.839159 14037 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:41.840726 13923 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde: Bootstrap starting. I0401 16:41:41.842288 13923 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde: No blocks or log segments found. Creating new log. I0401 16:41:41.844482 13923 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde: No bootstrap required, opened a new log I0401 16:41:41.844986 14037 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13: Bootstrap starting. I0401 16:41:41.845104 13923 raft_consensus.cc:340] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.845281 13923 raft_consensus.cc:366] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:41.845335 13923 raft_consensus.cc:705] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 945cfa77e0464ef7908600619e1eacde, State: Initialized, Role: FOLLOWER I0401 16:41:41.845479 13923 consensus_queue.cc:229] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.846220 14037 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13: No blocks or log segments found. Creating new log. I0401 16:41:41.846088 13923 sys_catalog.cc:337] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:41.846292 13923 sys_catalog.cc:340] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:41.846168 14041 sys_catalog.cc:337] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:41.846552 14041 sys_catalog.cc:340] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:41.846779 13923 sys_catalog.cc:424] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:41.847388 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:41:41.847882 14037 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13: No bootstrap required, opened a new log I0401 16:41:41.848352 14037 raft_consensus.cc:340] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.848470 14037 raft_consensus.cc:366] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:41.848500 14037 raft_consensus.cc:705] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8b91977a995b40aeb8aa0beaa589da13, State: Initialized, Role: FOLLOWER W0401 16:41:41.848577 14043 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:41.848623 14043 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:41.848642 14037 consensus_queue.cc:229] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.849052 14037 sys_catalog.cc:337] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:41.849174 14037 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:41.849103 14044 sys_catalog.cc:337] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:41.849344 14044 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:41.849480 14037 sys_catalog.cc:424] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: configured and running, proceeding with master startup. W0401 16:41:41.850486 14045 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:41.850528 14045 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:41.863431 13980 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } attempt: 1 I0401 16:41:41.869601 13980 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1: Bootstrap starting. I0401 16:41:41.870723 13980 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1: No blocks or log segments found. Creating new log. I0401 16:41:41.872268 13980 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1: No bootstrap required, opened a new log I0401 16:41:41.872875 13980 raft_consensus.cc:340] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.873034 13980 raft_consensus.cc:366] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:41.873066 13980 raft_consensus.cc:705] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7add0c01d1c845d6af1e6612d46558c1, State: Initialized, Role: FOLLOWER I0401 16:41:41.873248 13980 consensus_queue.cc:229] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.873664 13980 sys_catalog.cc:337] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:41.873791 13980 sys_catalog.cc:340] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:41.873718 14047 sys_catalog.cc:337] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:41.873946 14047 sys_catalog.cc:340] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:41.874264 13980 sys_catalog.cc:424] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:41.874586 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:41.875991 14048 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:41.876045 14048 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:41.879305 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 840931us I0401 16:41:41.879449 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:41.879478 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:41.879541 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:41.879564 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:41.879986 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "3b217a135438461a92af851b0ff0e3b1" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.883635 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s I0401 16:41:41.884268 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:41.886495 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:41.886535 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-0-root uuid: "3b217a135438461a92af851b0ff0e3b1" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.886592 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:41.902031 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:41.902068 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:41.917165 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:60190 I0401 16:41:41.917929 12160 webserver.cc:308] Webserver started at http://127.11.224.1:55910/ using document root and password file I0401 16:41:41.924512 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 840931us I0401 16:41:41.924669 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:41.924700 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:41.924770 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:41.924793 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:41.925321 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "c8a139e6be04411cafa08fa475b4a949" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.928350 14041 raft_consensus.cc:472] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:41.928454 14041 raft_consensus.cc:494] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.929183 14041 leader_election.cc:296] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7add0c01d1c845d6af1e6612d46558c1 (127.11.224.61:43507), 8b91977a995b40aeb8aa0beaa589da13 (127.11.224.60:55817) I0401 16:41:41.929715 13957 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "945cfa77e0464ef7908600619e1eacde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7add0c01d1c845d6af1e6612d46558c1" is_pre_election: true I0401 16:41:41.929925 13957 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 945cfa77e0464ef7908600619e1eacde in term 0. I0401 16:41:41.930138 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s I0401 16:41:41.930321 13873 leader_election.cc:310] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7add0c01d1c845d6af1e6612d46558c1, 945cfa77e0464ef7908600619e1eacde; no voters: I0401 16:41:41.930219 14014 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "945cfa77e0464ef7908600619e1eacde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b91977a995b40aeb8aa0beaa589da13" is_pre_election: true I0401 16:41:41.930452 14014 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 945cfa77e0464ef7908600619e1eacde in term 0. I0401 16:41:41.930609 14041 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:41.930653 14041 raft_consensus.cc:472] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:41.930698 14041 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:41.931285 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:41.932883 14041 raft_consensus.cc:494] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.933418 14041 leader_election.cc:296] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [CANDIDATE]: Term 1 election: Requested vote from peers 7add0c01d1c845d6af1e6612d46558c1 (127.11.224.61:43507), 8b91977a995b40aeb8aa0beaa589da13 (127.11.224.60:55817) I0401 16:41:41.934235 14014 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "945cfa77e0464ef7908600619e1eacde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8b91977a995b40aeb8aa0beaa589da13" I0401 16:41:41.934358 14014 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:41.935612 13957 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "945cfa77e0464ef7908600619e1eacde" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7add0c01d1c845d6af1e6612d46558c1" I0401 16:41:41.935730 13957 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:41.936323 14014 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 945cfa77e0464ef7908600619e1eacde in term 1. I0401 16:41:41.936638 13873 leader_election.cc:310] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8b91977a995b40aeb8aa0beaa589da13, 945cfa77e0464ef7908600619e1eacde; no voters: I0401 16:41:41.937153 14114 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43507 I0401 16:41:41.937219 14114 heartbeater.cc:426] Registering TS with master... I0401 16:41:41.937670 14114 heartbeater.cc:475] Master 127.11.224.61:43507 requested a full tablet report, sending... I0401 16:41:41.937831 13957 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 945cfa77e0464ef7908600619e1eacde in term 1. I0401 16:41:41.938125 14041 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:41.938256 14113 heartbeater.cc:345] Connected to a master server at 127.11.224.60:55817 I0401 16:41:41.938307 14113 heartbeater.cc:426] Registering TS with master... I0401 16:41:41.938536 14113 heartbeater.cc:475] Master 127.11.224.60:55817 requested a full tablet report, sending... I0401 16:41:41.938750 14041 raft_consensus.cc:667] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 1 LEADER]: Becoming Leader. State: Replica: 945cfa77e0464ef7908600619e1eacde, State: Running, Role: LEADER I0401 16:41:41.938990 14041 consensus_queue.cc:206] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } I0401 16:41:41.939674 13947 ts_manager.cc:159] Registered new tserver with Master: 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190) I0401 16:41:41.940946 14004 ts_manager.cc:159] Registered new tserver with Master: 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190) I0401 16:41:41.941434 12160 fs_manager.cc:419] Time spent opening block manager: real 0.007s user 0.000s sys 0.005s I0401 16:41:41.941493 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-1-root uuid: "c8a139e6be04411cafa08fa475b4a949" format_stamp: "Formatted at 2019-04-01 23:41:41 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:41.941568 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:41.940518 14121 sys_catalog.cc:337] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: SysCatalogTable state changed. Reason: New leader 945cfa77e0464ef7908600619e1eacde. Latest consensus state: current_term: 1 leader_uuid: "945cfa77e0464ef7908600619e1eacde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:41.941857 14121 sys_catalog.cc:340] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: This master's current role is: LEADER I0401 16:41:41.942724 14123 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:41.942912 14115 heartbeater.cc:345] Connected to a master server at 127.11.224.62:54067 I0401 16:41:41.942991 14115 heartbeater.cc:426] Registering TS with master... I0401 16:41:41.943145 14115 heartbeater.cc:475] Master 127.11.224.62:54067 requested a full tablet report, sending... I0401 16:41:41.943843 13890 ts_manager.cc:159] Registered new tserver with Master: 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190) I0401 16:41:41.945230 14123 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:41.977576 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:41.977625 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:41.991683 14014 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 1 FOLLOWER]: Refusing update from remote peer 945cfa77e0464ef7908600619e1eacde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:41.992230 14121 consensus_queue.cc:984] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [LEADER]: Connected to new peer: Peer: permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:41.992570 13957 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 1 FOLLOWER]: Refusing update from remote peer 945cfa77e0464ef7908600619e1eacde: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:41.993047 14121 consensus_queue.cc:984] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [LEADER]: Connected to new peer: Peer: permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:42.001698 14044 sys_catalog.cc:337] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 945cfa77e0464ef7908600619e1eacde. Latest consensus state: current_term: 1 leader_uuid: "945cfa77e0464ef7908600619e1eacde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:42.001919 14044 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:42.002548 14047 sys_catalog.cc:337] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 945cfa77e0464ef7908600619e1eacde. Latest consensus state: current_term: 1 leader_uuid: "945cfa77e0464ef7908600619e1eacde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:42.002732 14047 sys_catalog.cc:340] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:42.011337 14123 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:42.012305 14047 sys_catalog.cc:337] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "945cfa77e0464ef7908600619e1eacde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:42.012504 14047 sys_catalog.cc:340] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:42.013321 14123 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:42.014808 14044 sys_catalog.cc:337] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "945cfa77e0464ef7908600619e1eacde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:42.014945 14044 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:42.016048 14041 sys_catalog.cc:337] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "945cfa77e0464ef7908600619e1eacde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:42.016105 14121 sys_catalog.cc:337] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "945cfa77e0464ef7908600619e1eacde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "945cfa77e0464ef7908600619e1eacde" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 54067 } } peers { permanent_uuid: "7add0c01d1c845d6af1e6612d46558c1" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43507 } } peers { permanent_uuid: "8b91977a995b40aeb8aa0beaa589da13" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 55817 } } } I0401 16:41:42.016271 14121 sys_catalog.cc:340] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: This master's current role is: LEADER I0401 16:41:42.016248 14041 sys_catalog.cc:340] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [sys.catalog]: This master's current role is: LEADER I0401 16:41:42.020790 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:56141 I0401 16:41:42.021775 12160 webserver.cc:308] Webserver started at http://127.11.224.2:50196/ using document root and password file I0401 16:41:42.031098 14123 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde: Generated new TSK 0 I0401 16:41:42.034226 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 841431us I0401 16:41:42.034415 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:42.034453 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:42.034538 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:42.034566 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:42.035187 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" format_stamp: "Formatted at 2019-04-01 23:41:42 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:42.043988 14197 heartbeater.cc:345] Connected to a master server at 127.11.224.62:54067 I0401 16:41:42.044070 14197 heartbeater.cc:426] Registering TS with master... I0401 16:41:42.044869 14197 heartbeater.cc:475] Master 127.11.224.62:54067 requested a full tablet report, sending... I0401 16:41:42.045892 13890 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:37724 I0401 16:41:42.045878 13889 ts_manager.cc:159] Registered new tserver with Master: c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.045979 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.003s sys 0.003s I0401 16:41:42.046829 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:42.046998 13889 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:37726 I0401 16:41:42.048305 14196 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43507 I0401 16:41:42.048362 14196 heartbeater.cc:426] Registering TS with master... I0401 16:41:42.048712 14196 heartbeater.cc:475] Master 127.11.224.61:43507 requested a full tablet report, sending... I0401 16:41:42.049414 13947 ts_manager.cc:159] Registered new tserver with Master: c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.049964 14195 heartbeater.cc:345] Connected to a master server at 127.11.224.60:55817 I0401 16:41:42.050034 14195 heartbeater.cc:426] Registering TS with master... I0401 16:41:42.050151 14195 heartbeater.cc:475] Master 127.11.224.60:55817 requested a full tablet report, sending... I0401 16:41:42.050995 14004 ts_manager.cc:159] Registered new tserver with Master: c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.051213 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:42.051270 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-2-root uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" format_stamp: "Formatted at 2019-04-01 23:41:42 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:42.051348 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestTableConsistency.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:42.058697 14115 heartbeater.cc:467] Master 127.11.224.62:54067 was elected leader, sending a full tablet report... I0401 16:41:42.059751 14197 heartbeater.cc:467] Master 127.11.224.62:54067 was elected leader, sending a full tablet report... I0401 16:41:42.078299 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:42.078346 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:42.099092 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:41734 I0401 16:41:42.099859 12160 webserver.cc:308] Webserver started at http://127.11.224.3:52826/ using document root and password file I0401 16:41:42.115782 14266 heartbeater.cc:345] Connected to a master server at 127.11.224.60:55817 I0401 16:41:42.115882 14266 heartbeater.cc:426] Registering TS with master... I0401 16:41:42.116150 14266 heartbeater.cc:475] Master 127.11.224.60:55817 requested a full tablet report, sending... I0401 16:41:42.116667 14268 heartbeater.cc:345] Connected to a master server at 127.11.224.62:54067 I0401 16:41:42.116731 14268 heartbeater.cc:426] Registering TS with master... I0401 16:41:42.116964 14267 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43507 I0401 16:41:42.117005 14268 heartbeater.cc:475] Master 127.11.224.62:54067 requested a full tablet report, sending... I0401 16:41:42.117023 14267 heartbeater.cc:426] Registering TS with master... I0401 16:41:42.117000 14004 ts_manager.cc:159] Registered new tserver with Master: 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.117278 14267 heartbeater.cc:475] Master 127.11.224.61:43507 requested a full tablet report, sending... I0401 16:41:42.117740 13890 ts_manager.cc:159] Registered new tserver with Master: 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.118165 13947 ts_manager.cc:159] Registered new tserver with Master: 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.119041 13890 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:37730 I0401 16:41:42.120321 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.006961893s I0401 16:41:42.131428 14268 heartbeater.cc:467] Master 127.11.224.62:54067 was elected leader, sending a full tablet report... I0401 16:41:42.146195 13889 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.62:37731: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:42.146888 13889 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:42.174818 14079 tablet_service.cc:1006] Processing CreateTablet for tablet f7b07c95350a4913ac25ac4e7fe1d56f (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:42.174803 14078 tablet_service.cc:1006] Processing CreateTablet for tablet f3a8c8f94f44477aa2aba69e0834cd23 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:42.174971 14080 tablet_service.cc:1006] Processing CreateTablet for tablet 25462a2724aa4e57b7b90498c8c2fade (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:42.175390 14078 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f3a8c8f94f44477aa2aba69e0834cd23. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.175549 14079 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f7b07c95350a4913ac25ac4e7fe1d56f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.175483 14077 tablet_service.cc:1006] Processing CreateTablet for tablet 265f9ab062db4a7993f0dec921bf7c89 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:42.175869 14077 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 265f9ab062db4a7993f0dec921bf7c89. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.178773 14080 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 25462a2724aa4e57b7b90498c8c2fade. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.179728 14076 tablet_service.cc:1006] Processing CreateTablet for tablet 676a5ec766f84ebebe099001cd7401a9 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:42.180116 14076 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 676a5ec766f84ebebe099001cd7401a9. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.181381 14075 tablet_service.cc:1006] Processing CreateTablet for tablet c436001f027647dfa8569052010729a6 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:42.181723 14075 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c436001f027647dfa8569052010729a6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.187175 14080 tablet_service.cc:1006] Processing CreateTablet for tablet 13a6988475ce40e693996f0f56711a1a (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:42.187527 14080 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 13a6988475ce40e693996f0f56711a1a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.190230 14079 tablet_service.cc:1006] Processing CreateTablet for tablet b037d993bb1c4d0e973c88f5232fcec4 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:42.190552 14079 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b037d993bb1c4d0e973c88f5232fcec4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.191007 14075 tablet_service.cc:1006] Processing CreateTablet for tablet 97c087eb8f4a49a8aab7f45d389073bd (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:42.191320 14075 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 97c087eb8f4a49a8aab7f45d389073bd. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.194056 14286 tablet_bootstrap.cc:439] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.190493 14076 tablet_service.cc:1006] Processing CreateTablet for tablet d854a8d5225f43a7a40cfcec0bd9c1d5 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:42.194579 14076 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d854a8d5225f43a7a40cfcec0bd9c1d5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.194802 14153 tablet_service.cc:1006] Processing CreateTablet for tablet 25462a2724aa4e57b7b90498c8c2fade (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:42.195199 14153 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 25462a2724aa4e57b7b90498c8c2fade. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.195885 14286 tablet_bootstrap.cc:590] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.198863 14232 tablet_service.cc:1006] Processing CreateTablet for tablet f7b07c95350a4913ac25ac4e7fe1d56f (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:42.199247 14232 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f7b07c95350a4913ac25ac4e7fe1d56f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.199304 14231 tablet_service.cc:1006] Processing CreateTablet for tablet f3a8c8f94f44477aa2aba69e0834cd23 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:42.199959 14231 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f3a8c8f94f44477aa2aba69e0834cd23. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.200049 14230 tablet_service.cc:1006] Processing CreateTablet for tablet 265f9ab062db4a7993f0dec921bf7c89 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:42.200613 14230 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 265f9ab062db4a7993f0dec921bf7c89. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.202443 14226 tablet_service.cc:1006] Processing CreateTablet for tablet b037d993bb1c4d0e973c88f5232fcec4 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:42.202662 14227 tablet_service.cc:1006] Processing CreateTablet for tablet 13a6988475ce40e693996f0f56711a1a (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:42.203321 14228 tablet_service.cc:1006] Processing CreateTablet for tablet c436001f027647dfa8569052010729a6 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:42.203307 14229 tablet_service.cc:1006] Processing CreateTablet for tablet 676a5ec766f84ebebe099001cd7401a9 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:42.203390 14225 tablet_service.cc:1006] Processing CreateTablet for tablet 97c087eb8f4a49a8aab7f45d389073bd (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:42.203599 14228 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c436001f027647dfa8569052010729a6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.203745 14229 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 676a5ec766f84ebebe099001cd7401a9. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.203986 14225 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 97c087eb8f4a49a8aab7f45d389073bd. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.204205 14224 tablet_service.cc:1006] Processing CreateTablet for tablet d854a8d5225f43a7a40cfcec0bd9c1d5 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:42.198864 14233 tablet_service.cc:1006] Processing CreateTablet for tablet 25462a2724aa4e57b7b90498c8c2fade (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:42.205713 14152 tablet_service.cc:1006] Processing CreateTablet for tablet f7b07c95350a4913ac25ac4e7fe1d56f (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:42.206377 14152 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f7b07c95350a4913ac25ac4e7fe1d56f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.209694 14226 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b037d993bb1c4d0e973c88f5232fcec4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.210125 14151 tablet_service.cc:1006] Processing CreateTablet for tablet f3a8c8f94f44477aa2aba69e0834cd23 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:42.210464 14227 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 13a6988475ce40e693996f0f56711a1a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.210582 14151 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f3a8c8f94f44477aa2aba69e0834cd23. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.211477 14286 tablet_bootstrap.cc:439] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.211977 14286 ts_tablet_manager.cc:1053] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.018s user 0.001s sys 0.006s I0401 16:41:42.212692 14147 tablet_service.cc:1006] Processing CreateTablet for tablet 13a6988475ce40e693996f0f56711a1a (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:42.213053 14146 tablet_service.cc:1006] Processing CreateTablet for tablet b037d993bb1c4d0e973c88f5232fcec4 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:42.213308 14147 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 13a6988475ce40e693996f0f56711a1a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.213433 14146 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b037d993bb1c4d0e973c88f5232fcec4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.215988 14224 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d854a8d5225f43a7a40cfcec0bd9c1d5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.217097 14233 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 25462a2724aa4e57b7b90498c8c2fade. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.211107 14150 tablet_service.cc:1006] Processing CreateTablet for tablet 265f9ab062db4a7993f0dec921bf7c89 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:42.217806 14148 tablet_service.cc:1006] Processing CreateTablet for tablet c436001f027647dfa8569052010729a6 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:42.219573 14148 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c436001f027647dfa8569052010729a6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.221923 14145 tablet_service.cc:1006] Processing CreateTablet for tablet 97c087eb8f4a49a8aab7f45d389073bd (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:42.222187 14145 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 97c087eb8f4a49a8aab7f45d389073bd. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.223332 14150 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 265f9ab062db4a7993f0dec921bf7c89. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.217219 14149 tablet_service.cc:1006] Processing CreateTablet for tablet 676a5ec766f84ebebe099001cd7401a9 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:42.224285 14149 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 676a5ec766f84ebebe099001cd7401a9. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.225116 14144 tablet_service.cc:1006] Processing CreateTablet for tablet d854a8d5225f43a7a40cfcec0bd9c1d5 (table=ksck-test-table [id=19c6a0d43059434db66f542ea84c7fc9]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:42.225576 14144 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d854a8d5225f43a7a40cfcec0bd9c1d5. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:42.250133 14286 raft_consensus.cc:340] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.250423 14286 raft_consensus.cc:366] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.250495 14286 raft_consensus.cc:705] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.250742 14286 consensus_queue.cc:229] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.261145 14288 tablet_bootstrap.cc:439] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.271670 14289 tablet_bootstrap.cc:439] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.271670 14286 ts_tablet_manager.cc:1081] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.060s user 0.002s sys 0.003s I0401 16:41:42.272029 14286 tablet_bootstrap.cc:439] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.273857 14288 tablet_bootstrap.cc:590] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.275408 14286 tablet_bootstrap.cc:590] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.276023 14289 tablet_bootstrap.cc:590] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.278678 14288 tablet_bootstrap.cc:439] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.278838 14288 ts_tablet_manager.cc:1053] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.003s I0401 16:41:42.278964 14286 tablet_bootstrap.cc:439] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.279069 14286 ts_tablet_manager.cc:1053] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s I0401 16:41:42.279130 14289 tablet_bootstrap.cc:439] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.279232 14289 ts_tablet_manager.cc:1053] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.001s I0401 16:41:42.279417 14288 raft_consensus.cc:340] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.279543 14288 raft_consensus.cc:366] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.279594 14288 raft_consensus.cc:705] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.279754 14288 consensus_queue.cc:229] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.279685 14286 raft_consensus.cc:340] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.279974 14286 raft_consensus.cc:366] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.279882 14289 raft_consensus.cc:340] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.280036 14286 raft_consensus.cc:705] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.280076 14289 raft_consensus.cc:366] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.280145 14289 raft_consensus.cc:705] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.280920 14288 ts_tablet_manager.cc:1081] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:42.281107 14288 tablet_bootstrap.cc:439] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.280264 14286 consensus_queue.cc:229] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.280920 14289 consensus_queue.cc:229] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.283756 14288 tablet_bootstrap.cc:590] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.284916 14286 ts_tablet_manager.cc:1081] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s I0401 16:41:42.286156 14289 ts_tablet_manager.cc:1081] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.007s user 0.002s sys 0.001s I0401 16:41:42.286378 14289 tablet_bootstrap.cc:439] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.286543 14286 tablet_bootstrap.cc:439] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.288507 14289 tablet_bootstrap.cc:590] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.289182 14286 tablet_bootstrap.cc:590] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.290225 14288 tablet_bootstrap.cc:439] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.290349 14288 ts_tablet_manager.cc:1053] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s I0401 16:41:42.291270 14288 raft_consensus.cc:340] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.291411 14288 raft_consensus.cc:366] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.291472 14288 raft_consensus.cc:705] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.291662 14289 tablet_bootstrap.cc:439] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.291754 14289 ts_tablet_manager.cc:1053] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s I0401 16:41:42.291666 14288 consensus_queue.cc:229] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.291874 14286 tablet_bootstrap.cc:439] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.291987 14286 ts_tablet_manager.cc:1053] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:42.292506 14288 ts_tablet_manager.cc:1081] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s I0401 16:41:42.292616 14286 raft_consensus.cc:340] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.292832 14286 raft_consensus.cc:366] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.292896 14286 raft_consensus.cc:705] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.292925 14288 tablet_bootstrap.cc:439] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.293231 14286 consensus_queue.cc:229] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.293418 14289 raft_consensus.cc:340] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.294872 14289 raft_consensus.cc:366] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.294993 14289 raft_consensus.cc:705] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.295331 14289 consensus_queue.cc:229] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.297513 14286 ts_tablet_manager.cc:1081] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:42.297916 14286 tablet_bootstrap.cc:439] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.298032 14289 ts_tablet_manager.cc:1081] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s I0401 16:41:42.298158 14288 tablet_bootstrap.cc:590] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.298262 14289 tablet_bootstrap.cc:439] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.300004 14289 tablet_bootstrap.cc:590] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.300127 14286 tablet_bootstrap.cc:590] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.309343 14286 tablet_bootstrap.cc:439] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.309347 14288 tablet_bootstrap.cc:439] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.309499 14288 ts_tablet_manager.cc:1053] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.008s I0401 16:41:42.309501 14286 ts_tablet_manager.cc:1053] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.006s I0401 16:41:42.310717 14286 raft_consensus.cc:340] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.310818 14288 raft_consensus.cc:340] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.311010 14288 raft_consensus.cc:366] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.310972 14286 raft_consensus.cc:366] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.311074 14288 raft_consensus.cc:705] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.311111 14286 raft_consensus.cc:705] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.311275 14289 tablet_bootstrap.cc:439] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.311411 14289 ts_tablet_manager.cc:1053] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.003s I0401 16:41:42.311308 14288 consensus_queue.cc:229] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.311308 14286 consensus_queue.cc:229] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.312019 14289 raft_consensus.cc:340] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.312238 14289 raft_consensus.cc:366] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.312304 14288 ts_tablet_manager.cc:1081] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:42.312711 14288 tablet_bootstrap.cc:439] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.312309 14289 raft_consensus.cc:705] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.313211 14289 consensus_queue.cc:229] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.314146 14289 ts_tablet_manager.cc:1081] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:42.315553 14289 tablet_bootstrap.cc:439] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.317324 14288 tablet_bootstrap.cc:590] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.317853 14289 tablet_bootstrap.cc:590] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.318837 14286 ts_tablet_manager.cc:1081] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s I0401 16:41:42.319113 14286 tablet_bootstrap.cc:439] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.320322 14288 tablet_bootstrap.cc:439] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.320437 14286 tablet_bootstrap.cc:590] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.320457 14288 ts_tablet_manager.cc:1053] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s I0401 16:41:42.320479 14289 tablet_bootstrap.cc:439] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.320631 14289 ts_tablet_manager.cc:1053] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s I0401 16:41:42.321135 14289 raft_consensus.cc:340] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.321223 14288 raft_consensus.cc:340] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.321331 14289 raft_consensus.cc:366] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.321424 14288 raft_consensus.cc:366] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.321455 14288 raft_consensus.cc:705] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.321450 14289 raft_consensus.cc:705] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.321617 14288 consensus_queue.cc:229] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.321697 14289 consensus_queue.cc:229] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.322373 14288 ts_tablet_manager.cc:1081] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:42.322540 14288 tablet_bootstrap.cc:439] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.322979 14294 raft_consensus.cc:472] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.323066 14294 raft_consensus.cc:494] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.323901 14294 leader_election.cc:296] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.324062 14288 tablet_bootstrap.cc:590] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.325202 14289 ts_tablet_manager.cc:1081] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I0401 16:41:42.326313 14289 tablet_bootstrap.cc:439] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.326108 14286 tablet_bootstrap.cc:439] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.327236 14290 raft_consensus.cc:472] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.327327 14290 raft_consensus.cc:494] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.328121 14290 leader_election.cc:296] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.329756 14286 ts_tablet_manager.cc:1053] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s I0401 16:41:42.334331 14243 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "25462a2724aa4e57b7b90498c8c2fade" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true W0401 16:41:42.336325 14124 leader_election.cc:348] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.331871 14286 raft_consensus.cc:340] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.336881 14286 raft_consensus.cc:366] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.336921 14286 raft_consensus.cc:705] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.337136 14286 consensus_queue.cc:229] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.338014 14286 ts_tablet_manager.cc:1081] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s I0401 16:41:42.338461 14090 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "25462a2724aa4e57b7b90498c8c2fade" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true I0401 16:41:42.338986 14289 tablet_bootstrap.cc:590] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.338973 14090 raft_consensus.cc:2346] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8a139e6be04411cafa08fa475b4a949 in term 0. I0401 16:41:42.340075 14124 leader_election.cc:310] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, c8a139e6be04411cafa08fa475b4a949; no voters: 7f56a852ff774ae3bf4b2db3fdd9e794 I0401 16:41:42.340674 14294 raft_consensus.cc:2640] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.340816 14294 raft_consensus.cc:472] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.340966 14294 raft_consensus.cc:2886] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.343582 14286 tablet_bootstrap.cc:439] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.344880 14164 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "25462a2724aa4e57b7b90498c8c2fade" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.346984 14294 raft_consensus.cc:494] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.347370 14164 raft_consensus.cc:2276] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b217a135438461a92af851b0ff0e3b1 in current term 1: Already voted for candidate c8a139e6be04411cafa08fa475b4a949 in this term. I0401 16:41:42.348006 14294 leader_election.cc:296] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Requested vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.348768 14288 tablet_bootstrap.cc:439] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.348778 14243 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "25462a2724aa4e57b7b90498c8c2fade" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" I0401 16:41:42.348762 14090 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "25462a2724aa4e57b7b90498c8c2fade" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" I0401 16:41:42.348906 14090 raft_consensus.cc:2886] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.349150 14288 ts_tablet_manager.cc:1053] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.027s user 0.003s sys 0.007s W0401 16:41:42.349177 14124 leader_election.cc:348] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.350133 14243 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "25462a2724aa4e57b7b90498c8c2fade" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true W0401 16:41:42.350491 14051 leader_election.cc:348] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.350555 14051 leader_election.cc:310] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1; no voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949 I0401 16:41:42.349958 14288 raft_consensus.cc:340] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.351003 14288 raft_consensus.cc:366] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.351038 14288 raft_consensus.cc:705] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.351271 14289 tablet_bootstrap.cc:439] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.351395 14289 ts_tablet_manager.cc:1053] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.025s user 0.001s sys 0.002s I0401 16:41:42.353404 14090 raft_consensus.cc:2346] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8a139e6be04411cafa08fa475b4a949 in term 1. I0401 16:41:42.353487 14290 raft_consensus.cc:2588] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:42.353803 14124 leader_election.cc:310] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, c8a139e6be04411cafa08fa475b4a949; no voters: 7f56a852ff774ae3bf4b2db3fdd9e794 I0401 16:41:42.354079 14294 raft_consensus.cc:2640] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.354547 14286 tablet_bootstrap.cc:590] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.351219 14288 consensus_queue.cc:229] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.353148 14289 raft_consensus.cc:340] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.356813 14289 raft_consensus.cc:366] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.356860 14289 raft_consensus.cc:705] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.357375 14294 raft_consensus.cc:667] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Becoming Leader. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Running, Role: LEADER I0401 16:41:42.357136 14289 consensus_queue.cc:229] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.357944 14294 consensus_queue.cc:206] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.358716 14288 ts_tablet_manager.cc:1081] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s I0401 16:41:42.359113 14288 tablet_bootstrap.cc:439] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.359848 14289 ts_tablet_manager.cc:1081] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.008s user 0.002s sys 0.001s I0401 16:41:42.361155 14289 tablet_bootstrap.cc:439] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.361557 14288 tablet_bootstrap.cc:590] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.363723 14289 tablet_bootstrap.cc:590] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.366616 13889 catalog_manager.cc:3977] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 reported cstate change: term changed from 0 to 1, leader changed from to c8a139e6be04411cafa08fa475b4a949 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "c8a139e6be04411cafa08fa475b4a949" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: UNKNOWN } } } I0401 16:41:42.372664 14295 raft_consensus.cc:472] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.378792 14286 tablet_bootstrap.cc:439] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.378928 14286 ts_tablet_manager.cc:1053] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.035s user 0.003s sys 0.001s I0401 16:41:42.379570 14286 raft_consensus.cc:340] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.379693 14286 raft_consensus.cc:366] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.379734 14286 raft_consensus.cc:705] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.380403 14288 tablet_bootstrap.cc:439] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.379899 14286 consensus_queue.cc:229] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.380537 14288 ts_tablet_manager.cc:1053] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.004s I0401 16:41:42.380969 14286 ts_tablet_manager.cc:1081] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:42.381201 14286 tablet_bootstrap.cc:439] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.382076 14288 raft_consensus.cc:340] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.382270 14288 raft_consensus.cc:366] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.382325 14288 raft_consensus.cc:705] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.382585 14286 tablet_bootstrap.cc:590] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.382666 14288 consensus_queue.cc:229] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.383613 14288 ts_tablet_manager.cc:1081] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:42.383852 14288 tablet_bootstrap.cc:439] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.388398 14288 tablet_bootstrap.cc:590] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.390816 14289 tablet_bootstrap.cc:439] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.390995 14289 ts_tablet_manager.cc:1053] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.011s I0401 16:41:42.391510 14288 tablet_bootstrap.cc:439] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.391618 14288 ts_tablet_manager.cc:1053] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s I0401 16:41:42.391922 14289 raft_consensus.cc:340] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.392150 14289 raft_consensus.cc:366] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.392220 14289 raft_consensus.cc:705] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.392653 14288 raft_consensus.cc:340] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.392890 14288 raft_consensus.cc:366] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.392446 14289 consensus_queue.cc:229] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.392963 14288 raft_consensus.cc:705] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.393138 14288 consensus_queue.cc:229] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.375955 14295 raft_consensus.cc:494] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.399228 14295 leader_election.cc:296] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.400504 14289 ts_tablet_manager.cc:1081] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.009s user 0.003s sys 0.004s I0401 16:41:42.400949 14289 tablet_bootstrap.cc:439] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.402459 14295 raft_consensus.cc:472] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.402622 14295 raft_consensus.cc:494] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.403216 14295 leader_election.cc:296] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.403504 14288 ts_tablet_manager.cc:1081] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s I0401 16:41:42.403764 14288 tablet_bootstrap.cc:439] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.404649 14286 tablet_bootstrap.cc:439] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.404811 14286 ts_tablet_manager.cc:1053] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.006s I0401 16:41:42.405498 14288 tablet_bootstrap.cc:590] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.406163 14286 raft_consensus.cc:340] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.406474 14286 raft_consensus.cc:366] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.406518 14286 raft_consensus.cc:705] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.406744 14289 tablet_bootstrap.cc:590] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.406731 14286 consensus_queue.cc:229] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.411026 14286 ts_tablet_manager.cc:1081] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s I0401 16:41:42.411265 14286 tablet_bootstrap.cc:439] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.412858 14288 tablet_bootstrap.cc:439] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.412966 14288 ts_tablet_manager.cc:1053] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s I0401 16:41:42.415180 14288 raft_consensus.cc:340] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.415297 14288 raft_consensus.cc:366] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.415318 14288 raft_consensus.cc:705] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.417752 14289 tablet_bootstrap.cc:439] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.417865 14289 ts_tablet_manager.cc:1053] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.002s I0401 16:41:42.415457 14288 consensus_queue.cc:229] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.419760 14090 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f7b07c95350a4913ac25ac4e7fe1d56f" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true I0401 16:41:42.419940 14090 raft_consensus.cc:2346] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 0. I0401 16:41:42.420596 14204 leader_election.cc:310] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, 7f56a852ff774ae3bf4b2db3fdd9e794; no voters: I0401 16:41:42.420891 14289 raft_consensus.cc:340] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.421002 14289 raft_consensus.cc:366] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.421030 14289 raft_consensus.cc:705] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.421182 14289 consensus_queue.cc:229] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.421612 14289 ts_tablet_manager.cc:1081] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0401 16:41:42.421824 14289 tablet_bootstrap.cc:439] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.422010 14288 ts_tablet_manager.cc:1081] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s I0401 16:41:42.422366 14288 tablet_bootstrap.cc:439] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.423105 14316 raft_consensus.cc:2640] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.423187 14316 raft_consensus.cc:472] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.424721 14316 raft_consensus.cc:2886] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.419924 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b037d993bb1c4d0e973c88f5232fcec4" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true W0401 16:41:42.428542 14204 leader_election.cc:348] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.432235 14286 tablet_bootstrap.cc:590] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.433784 14164 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f7b07c95350a4913ac25ac4e7fe1d56f" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.434048 14164 raft_consensus.cc:2346] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 0. I0401 16:41:42.434190 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b037d993bb1c4d0e973c88f5232fcec4" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.434645 14163 raft_consensus.cc:2346] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 0. I0401 16:41:42.434931 14207 leader_election.cc:310] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949; no voters: 3b217a135438461a92af851b0ff0e3b1 I0401 16:41:42.435461 14295 raft_consensus.cc:2640] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.435513 14295 raft_consensus.cc:472] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.435557 14295 raft_consensus.cc:2886] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.438979 14288 tablet_bootstrap.cc:590] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.439831 14295 raft_consensus.cc:494] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.440492 14289 tablet_bootstrap.cc:590] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.441066 14295 leader_election.cc:296] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 election: Requested vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.441362 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b037d993bb1c4d0e973c88f5232fcec4" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" I0401 16:41:42.441581 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b037d993bb1c4d0e973c88f5232fcec4" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" I0401 16:41:42.441695 14163 raft_consensus.cc:2886] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 W0401 16:41:42.441768 14204 leader_election.cc:348] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.445372 14316 raft_consensus.cc:494] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.446280 14316 leader_election.cc:296] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 election: Requested vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.446569 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f7b07c95350a4913ac25ac4e7fe1d56f" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" I0401 16:41:42.446692 14089 raft_consensus.cc:2886] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.446810 14164 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f7b07c95350a4913ac25ac4e7fe1d56f" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" I0401 16:41:42.446955 14164 raft_consensus.cc:2886] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.450889 14089 raft_consensus.cc:2346] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 1. I0401 16:41:42.451232 14204 leader_election.cc:310] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, 7f56a852ff774ae3bf4b2db3fdd9e794; no voters: I0401 16:41:42.451467 14316 raft_consensus.cc:2640] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.451555 14316 raft_consensus.cc:667] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 LEADER]: Becoming Leader. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Running, Role: LEADER I0401 16:41:42.451808 14163 raft_consensus.cc:2346] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 1. I0401 16:41:42.451877 14316 consensus_queue.cc:206] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.452178 14207 leader_election.cc:310] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949; no voters: 3b217a135438461a92af851b0ff0e3b1 I0401 16:41:42.452682 14295 raft_consensus.cc:2640] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.452749 14295 raft_consensus.cc:667] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 LEADER]: Becoming Leader. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Running, Role: LEADER I0401 16:41:42.453541 14295 consensus_queue.cc:206] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.460677 14164 raft_consensus.cc:2346] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 1. I0401 16:41:42.463644 14295 raft_consensus.cc:472] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.463730 14295 raft_consensus.cc:494] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.465557 14288 tablet_bootstrap.cc:439] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.465704 14288 ts_tablet_manager.cc:1053] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.044s user 0.001s sys 0.007s I0401 16:41:42.466289 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "676a5ec766f84ebebe099001cd7401a9" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true I0401 16:41:42.466455 14089 raft_consensus.cc:2346] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 0. I0401 16:41:42.466727 14204 leader_election.cc:310] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, 7f56a852ff774ae3bf4b2db3fdd9e794; no voters: I0401 16:41:42.465299 13888 catalog_manager.cc:3977] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 reported cstate change: term changed from 0 to 1, leader changed from to 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: HEALTHY } } } I0401 16:41:42.467131 14295 leader_election.cc:296] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.467232 14295 raft_consensus.cc:2640] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.467175 14288 raft_consensus.cc:340] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.467293 14295 raft_consensus.cc:472] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.467358 14295 raft_consensus.cc:2886] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.468221 14289 tablet_bootstrap.cc:439] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.468327 14289 ts_tablet_manager.cc:1053] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.047s user 0.002s sys 0.005s I0401 16:41:42.470050 14288 raft_consensus.cc:366] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.470126 14288 raft_consensus.cc:705] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.472416 14290 raft_consensus.cc:472] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.471302 14164 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "676a5ec766f84ebebe099001cd7401a9" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.472501 14290 raft_consensus.cc:494] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.473323 14290 leader_election.cc:296] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.473881 14243 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f3a8c8f94f44477aa2aba69e0834cd23" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.474799 14290 raft_consensus.cc:472] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.474558 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f3a8c8f94f44477aa2aba69e0834cd23" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.474905 14290 raft_consensus.cc:494] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.475395 14286 tablet_bootstrap.cc:439] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log W0401 16:41:42.475518 14054 leader_election.cc:348] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.475689 14290 leader_election.cc:296] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.475477 13890 catalog_manager.cc:3977] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 reported cstate change: term changed from 0 to 1, leader changed from to 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: HEALTHY } } } I0401 16:41:42.475963 14286 ts_tablet_manager.cc:1053] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.065s user 0.003s sys 0.014s I0401 16:41:42.474130 14243 raft_consensus.cc:2346] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 0. I0401 16:41:42.476541 14051 leader_election.cc:310] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, 7f56a852ff774ae3bf4b2db3fdd9e794; no voters: c8a139e6be04411cafa08fa475b4a949 I0401 16:41:42.476593 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "265f9ab062db4a7993f0dec921bf7c89" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.476728 14163 raft_consensus.cc:2346] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 0. I0401 16:41:42.476894 14290 raft_consensus.cc:2640] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.476938 14290 raft_consensus.cc:472] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.476982 14290 raft_consensus.cc:2886] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.477077 14054 leader_election.cc:310] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, c8a139e6be04411cafa08fa475b4a949; no voters: I0401 16:41:42.477010 14289 raft_consensus.cc:340] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.477159 14289 raft_consensus.cc:366] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.477190 14289 raft_consensus.cc:705] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.471632 14288 consensus_queue.cc:229] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.478211 14164 raft_consensus.cc:2346] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 0. I0401 16:41:42.478636 14288 ts_tablet_manager.cc:1081] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.013s user 0.001s sys 0.001s I0401 16:41:42.478843 14288 tablet_bootstrap.cc:439] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949: Bootstrap starting. I0401 16:41:42.480747 14295 raft_consensus.cc:494] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.477360 14289 consensus_queue.cc:229] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.476542 14242 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "265f9ab062db4a7993f0dec921bf7c89" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.482084 14242 raft_consensus.cc:2346] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 0. I0401 16:41:42.483060 14295 leader_election.cc:296] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 election: Requested vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.483445 14286 raft_consensus.cc:340] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.483677 14289 ts_tablet_manager.cc:1081] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s I0401 16:41:42.483692 14286 raft_consensus.cc:366] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.484025 14286 raft_consensus.cc:705] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.484230 14289 tablet_bootstrap.cc:439] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.484176 14286 consensus_queue.cc:229] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.486879 14295 raft_consensus.cc:472] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.483764 14164 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "676a5ec766f84ebebe099001cd7401a9" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" I0401 16:41:42.489063 14164 raft_consensus.cc:2886] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.486989 14295 raft_consensus.cc:494] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.493815 14294 raft_consensus.cc:472] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.493923 14294 raft_consensus.cc:494] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.494499 14294 leader_election.cc:296] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.494904 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "97c087eb8f4a49a8aab7f45d389073bd" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true I0401 16:41:42.495283 14242 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "97c087eb8f4a49a8aab7f45d389073bd" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.495407 14242 raft_consensus.cc:2346] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8a139e6be04411cafa08fa475b4a949 in term 0. I0401 16:41:42.495774 14124 leader_election.cc:310] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949; no voters: I0401 16:41:42.496039 14294 raft_consensus.cc:2640] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.496093 14294 raft_consensus.cc:472] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.496145 14294 raft_consensus.cc:2886] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.496928 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "97c087eb8f4a49a8aab7f45d389073bd" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.497936 14164 raft_consensus.cc:2346] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 1. I0401 16:41:42.498250 14207 leader_election.cc:310] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949; no voters: I0401 16:41:42.496347 14295 leader_election.cc:296] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141) I0401 16:41:42.498625 14321 raft_consensus.cc:2640] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.500294 14321 raft_consensus.cc:667] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 LEADER]: Becoming Leader. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Running, Role: LEADER I0401 16:41:42.502256 14294 raft_consensus.cc:494] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.502549 14163 raft_consensus.cc:2276] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in current term 1: Already voted for candidate c8a139e6be04411cafa08fa475b4a949 in this term. I0401 16:41:42.504125 14294 leader_election.cc:296] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Requested vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.504457 14289 tablet_bootstrap.cc:590] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.501873 14321 consensus_queue.cc:206] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.505147 14242 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "97c087eb8f4a49a8aab7f45d389073bd" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" I0401 16:41:42.505281 14242 raft_consensus.cc:2886] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.505584 14286 ts_tablet_manager.cc:1081] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.029s user 0.000s sys 0.007s I0401 16:41:42.505543 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "97c087eb8f4a49a8aab7f45d389073bd" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" W0401 16:41:42.505725 14124 leader_election.cc:348] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Illegal state: must be running to vote when last-logged opid is not known W0401 16:41:42.506059 14124 leader_election.cc:348] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.506297 14286 tablet_bootstrap.cc:439] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.508431 14290 raft_consensus.cc:494] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.508863 14290 leader_election.cc:296] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 election: Requested vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.508987 14290 raft_consensus.cc:2640] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.509027 14290 raft_consensus.cc:472] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.509068 14290 raft_consensus.cc:2886] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.509238 14243 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f3a8c8f94f44477aa2aba69e0834cd23" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" I0401 16:41:42.509359 14243 raft_consensus.cc:2886] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.511438 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "676a5ec766f84ebebe099001cd7401a9" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" I0401 16:41:42.511618 14090 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "97c087eb8f4a49a8aab7f45d389073bd" candidate_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true W0401 16:41:42.514780 14204 leader_election.cc:348] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.515424 14089 raft_consensus.cc:2886] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.516072 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f3a8c8f94f44477aa2aba69e0834cd23" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" I0401 16:41:42.514217 14327 raft_consensus.cc:472] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.517585 14204 leader_election.cc:310] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f56a852ff774ae3bf4b2db3fdd9e794; no voters: 3b217a135438461a92af851b0ff0e3b1, c8a139e6be04411cafa08fa475b4a949 W0401 16:41:42.519788 14054 leader_election.cc:348] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.519584 14327 raft_consensus.cc:494] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.521499 14327 leader_election.cc:296] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.521495 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c436001f027647dfa8569052010729a6" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.521754 14243 raft_consensus.cc:2346] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 1. I0401 16:41:42.522049 14051 leader_election.cc:310] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, 7f56a852ff774ae3bf4b2db3fdd9e794; no voters: c8a139e6be04411cafa08fa475b4a949 I0401 16:41:42.522339 14163 raft_consensus.cc:2346] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 0. I0401 16:41:42.523190 14054 leader_election.cc:310] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, c8a139e6be04411cafa08fa475b4a949; no voters: I0401 16:41:42.523187 14241 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c436001f027647dfa8569052010729a6" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.523605 14241 raft_consensus.cc:2346] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 0. I0401 16:41:42.523710 14089 raft_consensus.cc:2346] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in term 1. I0401 16:41:42.525432 14327 raft_consensus.cc:2640] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.525933 14242 raft_consensus.cc:2346] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8a139e6be04411cafa08fa475b4a949 in term 1. I0401 16:41:42.525394 14325 raft_consensus.cc:2640] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.526729 14295 raft_consensus.cc:2588] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:42.527005 14288 tablet_bootstrap.cc:590] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949: No blocks or log segments found. Creating new log. I0401 16:41:42.527122 14124 leader_election.cc:310] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949; no voters: 3b217a135438461a92af851b0ff0e3b1 I0401 16:41:42.527483 14294 raft_consensus.cc:2640] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.528643 14294 raft_consensus.cc:667] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Becoming Leader. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Running, Role: LEADER I0401 16:41:42.528592 13888 catalog_manager.cc:3977] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 reported cstate change: term changed from 0 to 1, leader changed from to 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: HEALTHY } } } I0401 16:41:42.528987 14294 consensus_queue.cc:206] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.530202 14325 raft_consensus.cc:472] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.530498 14325 raft_consensus.cc:2886] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.532285 14327 raft_consensus.cc:667] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Running, Role: LEADER I0401 16:41:42.537026 14286 tablet_bootstrap.cc:590] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.536701 14327 consensus_queue.cc:206] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.540891 13890 catalog_manager.cc:3977] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 reported cstate change: term changed from 0 to 1, leader changed from to c8a139e6be04411cafa08fa475b4a949 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "c8a139e6be04411cafa08fa475b4a949" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: UNKNOWN } } } I0401 16:41:42.542984 14290 raft_consensus.cc:494] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.544661 14294 raft_consensus.cc:472] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.545078 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "265f9ab062db4a7993f0dec921bf7c89" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" I0401 16:41:42.545728 14290 leader_election.cc:296] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 election: Requested vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.545311 14242 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "265f9ab062db4a7993f0dec921bf7c89" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" I0401 16:41:42.547610 14294 raft_consensus.cc:494] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.548244 14289 tablet_bootstrap.cc:439] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.548483 14163 raft_consensus.cc:2886] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.549726 14242 raft_consensus.cc:2886] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.552810 14289 ts_tablet_manager.cc:1053] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.064s user 0.003s sys 0.003s I0401 16:41:42.553253 14294 leader_election.cc:296] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.558041 14241 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "13a6988475ce40e693996f0f56711a1a" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.558212 14309 raft_consensus.cc:472] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.558660 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "13a6988475ce40e693996f0f56711a1a" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true W0401 16:41:42.561033 14124 leader_election.cc:348] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.561692 14089 raft_consensus.cc:2346] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8a139e6be04411cafa08fa475b4a949 in term 0. I0401 16:41:42.560390 14309 raft_consensus.cc:494] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.563081 14124 leader_election.cc:310] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, c8a139e6be04411cafa08fa475b4a949; no voters: 7f56a852ff774ae3bf4b2db3fdd9e794 I0401 16:41:42.564638 14294 raft_consensus.cc:2640] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.565326 14294 raft_consensus.cc:472] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.565210 14241 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d854a8d5225f43a7a40cfcec0bd9c1d5" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.565742 14289 raft_consensus.cc:340] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.565999 14294 raft_consensus.cc:2886] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.566001 14241 raft_consensus.cc:2346] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c8a139e6be04411cafa08fa475b4a949 in term 0. I0401 16:41:42.566329 14309 leader_election.cc:296] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.567324 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d854a8d5225f43a7a40cfcec0bd9c1d5" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true I0401 16:41:42.567991 14124 leader_election.cc:310] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949; no voters: I0401 16:41:42.567994 13890 catalog_manager.cc:3977] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 reported cstate change: term changed from 0 to 1, leader changed from to 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "3b217a135438461a92af851b0ff0e3b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: UNKNOWN } } } W0401 16:41:42.568446 14124 leader_election.cc:348] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.568630 14288 tablet_bootstrap.cc:439] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949: No bootstrap required, opened a new log I0401 16:41:42.569231 14288 ts_tablet_manager.cc:1053] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949: Time spent bootstrapping tablet: real 0.090s user 0.001s sys 0.006s I0401 16:41:42.569231 14309 raft_consensus.cc:2640] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:42.570214 14289 raft_consensus.cc:366] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.572134 14309 raft_consensus.cc:472] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:42.572288 14309 raft_consensus.cc:2886] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.573351 14288 raft_consensus.cc:340] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.576977 14242 raft_consensus.cc:2346] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 1. I0401 16:41:42.569620 14325 raft_consensus.cc:494] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.579391 14163 raft_consensus.cc:2346] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 1. I0401 16:41:42.580777 14288 raft_consensus.cc:366] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.580832 14309 raft_consensus.cc:494] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.581136 14289 raft_consensus.cc:705] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.582289 14051 leader_election.cc:310] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, 7f56a852ff774ae3bf4b2db3fdd9e794; no voters: I0401 16:41:42.582670 14288 raft_consensus.cc:705] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Initialized, Role: FOLLOWER I0401 16:41:42.582809 14294 raft_consensus.cc:494] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.583355 14327 raft_consensus.cc:2640] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.583381 14325 leader_election.cc:296] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 election: Requested vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.583529 14327 raft_consensus.cc:667] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Running, Role: LEADER I0401 16:41:42.584344 14294 leader_election.cc:296] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Requested vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.584347 14327 consensus_queue.cc:206] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.584609 14289 consensus_queue.cc:229] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.584347 14089 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d854a8d5225f43a7a40cfcec0bd9c1d5" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" I0401 16:41:42.585340 14309 leader_election.cc:296] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Requested vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.590374 14288 consensus_queue.cc:229] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.591583 14289 ts_tablet_manager.cc:1081] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.033s user 0.002s sys 0.000s I0401 16:41:42.590363 14241 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c436001f027647dfa8569052010729a6" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" I0401 16:41:42.590785 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c436001f027647dfa8569052010729a6" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" I0401 16:41:42.592811 14242 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d854a8d5225f43a7a40cfcec0bd9c1d5" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" I0401 16:41:42.593436 14090 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "13a6988475ce40e693996f0f56711a1a" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" I0401 16:41:42.593632 14090 raft_consensus.cc:2886] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.593878 14243 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "13a6988475ce40e693996f0f56711a1a" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" W0401 16:41:42.594316 14124 leader_election.cc:348] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.594760 14241 raft_consensus.cc:2886] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.595769 14286 tablet_bootstrap.cc:439] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.596097 14286 ts_tablet_manager.cc:1053] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.090s user 0.005s sys 0.015s I0401 16:41:42.598304 14163 raft_consensus.cc:2886] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.599618 14241 raft_consensus.cc:2346] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 1. I0401 16:41:42.599856 14242 raft_consensus.cc:2886] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.600133 14051 leader_election.cc:310] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, 7f56a852ff774ae3bf4b2db3fdd9e794; no voters: I0401 16:41:42.600533 14325 raft_consensus.cc:2640] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader election won for term 1 W0401 16:41:42.600908 14124 leader_election.cc:348] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:42.597616 14289 tablet_bootstrap.cc:439] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794: Bootstrap starting. I0401 16:41:42.601177 14288 ts_tablet_manager.cc:1081] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949: Time spent starting tablet: real 0.024s user 0.002s sys 0.001s I0401 16:41:42.601562 14090 raft_consensus.cc:2346] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8a139e6be04411cafa08fa475b4a949 in term 1. I0401 16:41:42.602468 14124 leader_election.cc:310] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1, c8a139e6be04411cafa08fa475b4a949; no voters: 7f56a852ff774ae3bf4b2db3fdd9e794 I0401 16:41:42.602986 14286 raft_consensus.cc:340] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.603343 14309 raft_consensus.cc:2640] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.603519 14309 raft_consensus.cc:667] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Becoming Leader. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Running, Role: LEADER I0401 16:41:42.604130 14309 consensus_queue.cc:206] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.605123 14163 raft_consensus.cc:2346] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b217a135438461a92af851b0ff0e3b1 in term 1. I0401 16:41:42.603937 14325 raft_consensus.cc:667] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 1 LEADER]: Becoming Leader. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Running, Role: LEADER I0401 16:41:42.605962 14286 raft_consensus.cc:366] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.606768 14242 raft_consensus.cc:2346] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c8a139e6be04411cafa08fa475b4a949 in term 1. I0401 16:41:42.607455 14124 leader_election.cc:310] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949; no voters: 3b217a135438461a92af851b0ff0e3b1 I0401 16:41:42.607337 13890 catalog_manager.cc:3977] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 reported cstate change: term changed from 0 to 1, leader changed from to 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "3b217a135438461a92af851b0ff0e3b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: UNKNOWN } } } I0401 16:41:42.608311 14325 consensus_queue.cc:206] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.609844 14294 raft_consensus.cc:2640] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:42.610043 14294 raft_consensus.cc:667] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Becoming Leader. State: Replica: c8a139e6be04411cafa08fa475b4a949, State: Running, Role: LEADER I0401 16:41:42.610414 14286 raft_consensus.cc:705] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.610812 14294 consensus_queue.cc:206] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.611572 14286 consensus_queue.cc:229] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.616725 14286 ts_tablet_manager.cc:1081] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s I0401 16:41:42.617388 14289 tablet_bootstrap.cc:590] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794: No blocks or log segments found. Creating new log. I0401 16:41:42.619134 13888 catalog_manager.cc:3977] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 reported cstate change: term changed from 0 to 1, leader changed from to c8a139e6be04411cafa08fa475b4a949 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "c8a139e6be04411cafa08fa475b4a949" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: UNKNOWN } } } I0401 16:41:42.621045 14286 tablet_bootstrap.cc:439] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1: Bootstrap starting. I0401 16:41:42.627230 13890 catalog_manager.cc:3977] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 reported cstate change: term changed from 0 to 1, leader changed from to 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "3b217a135438461a92af851b0ff0e3b1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: UNKNOWN } } } I0401 16:41:42.628008 13888 catalog_manager.cc:3977] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 reported cstate change: term changed from 0 to 1, leader changed from to c8a139e6be04411cafa08fa475b4a949 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "c8a139e6be04411cafa08fa475b4a949" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } health_report { overall_health: UNKNOWN } } } I0401 16:41:42.629735 14289 tablet_bootstrap.cc:439] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794: No bootstrap required, opened a new log I0401 16:41:42.629989 14289 ts_tablet_manager.cc:1053] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent bootstrapping tablet: real 0.038s user 0.003s sys 0.003s I0401 16:41:42.631100 14286 tablet_bootstrap.cc:590] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1: No blocks or log segments found. Creating new log. I0401 16:41:42.631100 14289 raft_consensus.cc:340] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.631541 14289 raft_consensus.cc:366] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.631723 14289 raft_consensus.cc:705] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f56a852ff774ae3bf4b2db3fdd9e794, State: Initialized, Role: FOLLOWER I0401 16:41:42.632470 14289 consensus_queue.cc:229] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.636725 14289 ts_tablet_manager.cc:1081] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794: Time spent starting tablet: real 0.005s user 0.002s sys 0.001s I0401 16:41:42.641374 14286 tablet_bootstrap.cc:439] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1: No bootstrap required, opened a new log I0401 16:41:42.641551 14286 ts_tablet_manager.cc:1053] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.005s I0401 16:41:42.642354 14286 raft_consensus.cc:340] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.642669 14286 raft_consensus.cc:366] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:42.643100 14286 raft_consensus.cc:705] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b217a135438461a92af851b0ff0e3b1, State: Initialized, Role: FOLLOWER I0401 16:41:42.643328 14286 consensus_queue.cc:229] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.644140 14286 ts_tablet_manager.cc:1081] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s I0401 16:41:42.696018 14294 raft_consensus.cc:472] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.696180 14294 raft_consensus.cc:494] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.696899 14294 leader_election.cc:296] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.697302 14242 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f3a8c8f94f44477aa2aba69e0834cd23" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.697300 14090 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f3a8c8f94f44477aa2aba69e0834cd23" candidate_uuid: "c8a139e6be04411cafa08fa475b4a949" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b217a135438461a92af851b0ff0e3b1" is_pre_election: true I0401 16:41:42.697561 14090 raft_consensus.cc:2307] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate c8a139e6be04411cafa08fa475b4a949 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:42.697566 14242 raft_consensus.cc:2276] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c8a139e6be04411cafa08fa475b4a949 in current term 1: Already voted for candidate 3b217a135438461a92af851b0ff0e3b1 in this term. I0401 16:41:42.698009 14124 leader_election.cc:310] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c8a139e6be04411cafa08fa475b4a949; no voters: 3b217a135438461a92af851b0ff0e3b1, 7f56a852ff774ae3bf4b2db3fdd9e794 I0401 16:41:42.698245 14294 raft_consensus.cc:2886] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.699728 14294 raft_consensus.cc:2588] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:42.795846 14242 raft_consensus.cc:2886] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.799296 14242 raft_consensus.cc:1181] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Refusing update from remote peer c8a139e6be04411cafa08fa475b4a949: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.800233 14294 consensus_queue.cc:984] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:42.823722 14090 raft_consensus.cc:1181] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Refusing update from remote peer c8a139e6be04411cafa08fa475b4a949: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.825898 14294 consensus_queue.cc:984] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s I0401 16:41:42.832980 14325 raft_consensus.cc:472] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.833118 14325 raft_consensus.cc:494] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.834105 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d854a8d5225f43a7a40cfcec0bd9c1d5" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.834308 14325 leader_election.cc:296] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.834524 14163 raft_consensus.cc:2307] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 3b217a135438461a92af851b0ff0e3b1 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:42.834655 14242 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d854a8d5225f43a7a40cfcec0bd9c1d5" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.836555 14242 raft_consensus.cc:2276] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b217a135438461a92af851b0ff0e3b1 in current term 1: Already voted for candidate c8a139e6be04411cafa08fa475b4a949 in this term. I0401 16:41:42.837970 14051 leader_election.cc:310] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1; no voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949 I0401 16:41:42.838295 14327 raft_consensus.cc:2886] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.838335 14325 raft_consensus.cc:472] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:42.838986 14325 raft_consensus.cc:494] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 } } peers { permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 } } peers { permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 } } I0401 16:41:42.839654 14325 leader_election.cc:296] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141), 7f56a852ff774ae3bf4b2db3fdd9e794 (127.11.224.3:41734) I0401 16:41:42.840131 14242 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b037d993bb1c4d0e973c88f5232fcec4" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" is_pre_election: true I0401 16:41:42.840664 14242 raft_consensus.cc:2307] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 3b217a135438461a92af851b0ff0e3b1 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:42.840662 14163 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b037d993bb1c4d0e973c88f5232fcec4" candidate_uuid: "3b217a135438461a92af851b0ff0e3b1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c8a139e6be04411cafa08fa475b4a949" is_pre_election: true I0401 16:41:42.840914 14163 raft_consensus.cc:2276] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b217a135438461a92af851b0ff0e3b1 in current term 1: Already voted for candidate 7f56a852ff774ae3bf4b2db3fdd9e794 in this term. I0401 16:41:42.841931 14054 leader_election.cc:310] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b217a135438461a92af851b0ff0e3b1; no voters: 7f56a852ff774ae3bf4b2db3fdd9e794, c8a139e6be04411cafa08fa475b4a949 I0401 16:41:42.842087 14327 raft_consensus.cc:2588] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:42.842269 14327 raft_consensus.cc:2886] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:42.847156 14327 raft_consensus.cc:2588] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:42.855401 14045 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13: acquiring CA information for follower catalog manager: success I0401 16:41:42.857924 14045 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:42.877583 14090 raft_consensus.cc:1181] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Refusing update from remote peer 7f56a852ff774ae3bf4b2db3fdd9e794: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.878612 14295 consensus_queue.cc:984] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:42.883543 14048 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1: acquiring CA information for follower catalog manager: success I0401 16:41:42.890766 14163 raft_consensus.cc:1181] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Refusing update from remote peer 7f56a852ff774ae3bf4b2db3fdd9e794: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.892081 14048 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:42.892201 14295 consensus_queue.cc:984] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:42.901916 14164 raft_consensus.cc:1181] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Refusing update from remote peer 7f56a852ff774ae3bf4b2db3fdd9e794: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.902951 14295 consensus_queue.cc:984] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:42.917245 14090 raft_consensus.cc:1181] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Refusing update from remote peer 7f56a852ff774ae3bf4b2db3fdd9e794: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.918702 14316 consensus_queue.cc:984] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:42.980033 14163 raft_consensus.cc:1181] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Refusing update from remote peer 7f56a852ff774ae3bf4b2db3fdd9e794: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.980816 14316 consensus_queue.cc:984] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:42.993721 14090 raft_consensus.cc:1181] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Refusing update from remote peer 7f56a852ff774ae3bf4b2db3fdd9e794: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.995328 14316 consensus_queue.cc:984] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:42.997786 14163 raft_consensus.cc:1181] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Refusing update from remote peer 3b217a135438461a92af851b0ff0e3b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:42.998464 14327 consensus_queue.cc:984] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.016702 14242 raft_consensus.cc:1181] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Refusing update from remote peer 3b217a135438461a92af851b0ff0e3b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.018290 14327 consensus_queue.cc:984] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:43.035223 14089 raft_consensus.cc:1181] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Refusing update from remote peer c8a139e6be04411cafa08fa475b4a949: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.036134 14294 consensus_queue.cc:984] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:43.038571 14241 raft_consensus.cc:1181] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Refusing update from remote peer c8a139e6be04411cafa08fa475b4a949: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.039243 14294 consensus_queue.cc:984] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.040653 14241 raft_consensus.cc:1181] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Refusing update from remote peer c8a139e6be04411cafa08fa475b4a949: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.041996 14294 consensus_queue.cc:984] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.048032 14243 raft_consensus.cc:2886] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:43.052878 14243 raft_consensus.cc:1181] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Refusing update from remote peer c8a139e6be04411cafa08fa475b4a949: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.054040 14308 consensus_queue.cc:984] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:43.057596 14243 raft_consensus.cc:1181] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Refusing update from remote peer 3b217a135438461a92af851b0ff0e3b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.058167 14327 consensus_queue.cc:984] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.069597 14089 raft_consensus.cc:2886] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:43.074620 14163 raft_consensus.cc:1181] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Refusing update from remote peer 3b217a135438461a92af851b0ff0e3b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.077296 14327 consensus_queue.cc:984] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:43.083825 14090 raft_consensus.cc:1181] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Refusing update from remote peer c8a139e6be04411cafa08fa475b4a949: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.084764 14089 raft_consensus.cc:1181] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Refusing update from remote peer c8a139e6be04411cafa08fa475b4a949: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.084692 14309 consensus_queue.cc:984] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.086381 14309 consensus_queue.cc:984] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b217a135438461a92af851b0ff0e3b1" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 60190 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.165629 14163 raft_consensus.cc:1181] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Refusing update from remote peer 3b217a135438461a92af851b0ff0e3b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.167845 14327 consensus_queue.cc:984] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c8a139e6be04411cafa08fa475b4a949" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 56141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.177827 14240 raft_consensus.cc:1181] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Refusing update from remote peer 3b217a135438461a92af851b0ff0e3b1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:43.178289 14327 consensus_queue.cc:984] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f56a852ff774ae3bf4b2db3fdd9e794" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 41734 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.286231 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:43.304220 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:43.304323 12160 tablet_replica.cc:264] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.304435 12160 raft_consensus.cc:2143] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.304527 12160 raft_consensus.cc:2170] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.305454 12160 tablet_replica.cc:264] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.305604 12160 raft_consensus.cc:2143] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.305680 12160 raft_consensus.cc:2170] T 97c087eb8f4a49a8aab7f45d389073bd P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.306373 12160 tablet_replica.cc:264] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.306453 12160 raft_consensus.cc:2143] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.306545 12160 raft_consensus.cc:2170] T 13a6988475ce40e693996f0f56711a1a P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.307267 12160 tablet_replica.cc:264] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.307346 12160 raft_consensus.cc:2143] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.307533 12160 raft_consensus.cc:2170] T 265f9ab062db4a7993f0dec921bf7c89 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.308162 12160 tablet_replica.cc:264] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.308236 12160 raft_consensus.cc:2143] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.308302 12160 raft_consensus.cc:2170] T f7b07c95350a4913ac25ac4e7fe1d56f P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.308814 12160 tablet_replica.cc:264] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.308910 12160 raft_consensus.cc:2143] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.309046 12160 raft_consensus.cc:2170] T c436001f027647dfa8569052010729a6 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.309592 12160 tablet_replica.cc:264] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.309662 12160 raft_consensus.cc:2143] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.309726 12160 raft_consensus.cc:2170] T 676a5ec766f84ebebe099001cd7401a9 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.310237 12160 tablet_replica.cc:264] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.310309 12160 raft_consensus.cc:2143] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.310374 12160 raft_consensus.cc:2170] T 25462a2724aa4e57b7b90498c8c2fade P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.311034 12160 tablet_replica.cc:264] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.311105 12160 raft_consensus.cc:2143] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.311169 12160 raft_consensus.cc:2170] T b037d993bb1c4d0e973c88f5232fcec4 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.311892 12160 tablet_replica.cc:264] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1: stopping tablet replica I0401 16:41:43.311980 12160 raft_consensus.cc:2143] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.312130 12160 raft_consensus.cc:2170] T f3a8c8f94f44477aa2aba69e0834cd23 P 3b217a135438461a92af851b0ff0e3b1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.320363 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:43.320415 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:43.320550 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:43.325196 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:43.348752 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:43.348868 12160 tablet_replica.cc:264] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.349004 12160 raft_consensus.cc:2143] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.349143 12160 raft_consensus.cc:2170] T 265f9ab062db4a7993f0dec921bf7c89 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.350720 12160 tablet_replica.cc:264] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.350847 12160 raft_consensus.cc:2143] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.350965 12160 raft_consensus.cc:2170] T c436001f027647dfa8569052010729a6 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.351692 12160 tablet_replica.cc:264] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.351783 12160 raft_consensus.cc:2143] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.351862 12160 raft_consensus.cc:2170] T f7b07c95350a4913ac25ac4e7fe1d56f P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.352517 12160 tablet_replica.cc:264] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.352607 12160 raft_consensus.cc:2143] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.352782 12160 raft_consensus.cc:2170] T 97c087eb8f4a49a8aab7f45d389073bd P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.353370 12160 tablet_replica.cc:264] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.353459 12160 raft_consensus.cc:2143] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.353601 12160 raft_consensus.cc:2170] T d854a8d5225f43a7a40cfcec0bd9c1d5 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.354200 12160 tablet_replica.cc:264] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.354285 12160 raft_consensus.cc:2143] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.354431 12160 raft_consensus.cc:2170] T 13a6988475ce40e693996f0f56711a1a P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.355063 12160 tablet_replica.cc:264] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.355149 12160 raft_consensus.cc:2143] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.355224 12160 raft_consensus.cc:2170] T f3a8c8f94f44477aa2aba69e0834cd23 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.355782 12160 tablet_replica.cc:264] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.355871 12160 raft_consensus.cc:2143] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.355963 12160 raft_consensus.cc:2170] T b037d993bb1c4d0e973c88f5232fcec4 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.356570 12160 tablet_replica.cc:264] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.356652 12160 raft_consensus.cc:2143] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.356726 12160 raft_consensus.cc:2170] T 676a5ec766f84ebebe099001cd7401a9 P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.357241 12160 tablet_replica.cc:264] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949: stopping tablet replica I0401 16:41:43.357336 12160 raft_consensus.cc:2143] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.357482 12160 raft_consensus.cc:2170] T 25462a2724aa4e57b7b90498c8c2fade P c8a139e6be04411cafa08fa475b4a949 [term 1 FOLLOWER]: Raft consensus is shut down! W0401 16:41:43.363237 14207 consensus_peers.cc:457] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 -> Peer c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141): Couldn't send request to peer c8a139e6be04411cafa08fa475b4a949. Status: Network error: recv got EOF from 127.11.224.2:56141 (error 108). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:43.374624 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:43.374680 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:43.374851 12160 tablet_server.cc:179] TabletServer shutdown complete. W0401 16:41:43.379426 14204 consensus_peers.cc:457] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 -> Peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Couldn't send request to peer 3b217a135438461a92af851b0ff0e3b1. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:60190: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:43.380117 12160 tablet_server.cc:165] TabletServer shutting down... W0401 16:41:43.390962 14207 consensus_peers.cc:457] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 -> Peer c8a139e6be04411cafa08fa475b4a949 (127.11.224.2:56141): Couldn't send request to peer c8a139e6be04411cafa08fa475b4a949. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.2:56141: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. W0401 16:41:43.392369 14204 consensus_peers.cc:457] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 -> Peer 3b217a135438461a92af851b0ff0e3b1 (127.11.224.1:60190): Couldn't send request to peer 3b217a135438461a92af851b0ff0e3b1. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:60190: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:43.393450 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:43.393540 12160 tablet_replica.cc:264] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.393652 12160 raft_consensus.cc:2143] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.393743 12160 raft_consensus.cc:2170] T 13a6988475ce40e693996f0f56711a1a P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.394570 12160 tablet_replica.cc:264] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.394645 12160 raft_consensus.cc:2143] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.394742 12160 raft_consensus.cc:2170] T 265f9ab062db4a7993f0dec921bf7c89 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.395449 12160 tablet_replica.cc:264] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.395529 12160 raft_consensus.cc:2143] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.395593 12160 raft_consensus.cc:2170] T d854a8d5225f43a7a40cfcec0bd9c1d5 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.396253 12160 tablet_replica.cc:264] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.396328 12160 raft_consensus.cc:2143] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.396394 12160 raft_consensus.cc:2170] T 97c087eb8f4a49a8aab7f45d389073bd P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.397032 12160 tablet_replica.cc:264] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.397104 12160 raft_consensus.cc:2143] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.397171 12160 raft_consensus.cc:2170] T c436001f027647dfa8569052010729a6 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.397809 12160 tablet_replica.cc:264] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.397898 12160 raft_consensus.cc:2143] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.398007 12160 raft_consensus.cc:2170] T 25462a2724aa4e57b7b90498c8c2fade P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.398515 12160 tablet_replica.cc:264] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.398587 12160 raft_consensus.cc:2143] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.398753 12160 raft_consensus.cc:2170] T 676a5ec766f84ebebe099001cd7401a9 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.399375 12160 tablet_replica.cc:264] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.399447 12160 raft_consensus.cc:2143] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.399582 12160 raft_consensus.cc:2170] T b037d993bb1c4d0e973c88f5232fcec4 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.400122 12160 tablet_replica.cc:264] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.400192 12160 raft_consensus.cc:2143] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.400255 12160 raft_consensus.cc:2170] T f3a8c8f94f44477aa2aba69e0834cd23 P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.400847 12160 tablet_replica.cc:264] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794: stopping tablet replica I0401 16:41:43.400923 12160 raft_consensus.cc:2143] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.401057 12160 raft_consensus.cc:2170] T f7b07c95350a4913ac25ac4e7fe1d56f P 7f56a852ff774ae3bf4b2db3fdd9e794 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.416921 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:43.416963 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:43.417098 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:43.420414 12160 master.cc:270] Master@127.11.224.62:54067 shutting down... I0401 16:41:43.438971 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:43.439249 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.439316 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 945cfa77e0464ef7908600619e1eacde: stopping tablet replica I0401 16:41:43.452877 12160 master.cc:281] Master@127.11.224.62:54067 shutdown complete. I0401 16:41:43.455555 12160 master.cc:270] Master@127.11.224.61:43507 shutting down... I0401 16:41:43.464586 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.464711 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.464769 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 7add0c01d1c845d6af1e6612d46558c1: stopping tablet replica I0401 16:41:43.478251 12160 master.cc:281] Master@127.11.224.61:43507 shutdown complete. I0401 16:41:43.480837 12160 master.cc:270] Master@127.11.224.60:55817 shutting down... I0401 16:41:43.491405 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:43.491564 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:43.491636 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 8b91977a995b40aeb8aa0beaa589da13: stopping tablet replica I0401 16:41:43.505122 12160 master.cc:281] Master@127.11.224.60:55817 shutdown complete. [ OK ] RemoteKsckTest.TestTableConsistency (1840 ms) [ RUN ] RemoteKsckTest.TestChecksum I0401 16:41:43.523216 12160 test_util.cc:212] Using random seed: -1877305461 I0401 16:41:43.523713 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:49328,127.11.224.61:50234,127.11.224.60:37435 I0401 16:41:43.527024 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 841931us I0401 16:41:43.527184 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:43.527220 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:43.527304 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:43.527333 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:43.527745 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "6dd1566ed5614f3495f174d0c2cd95ca" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.531991 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s I0401 16:41:43.532661 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:43.534400 12160 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0401 16:41:43.534445 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-0-root uuid: "6dd1566ed5614f3495f174d0c2cd95ca" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.534516 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:43.579735 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:49328 I0401 16:41:43.580442 12160 webserver.cc:308] Webserver started at http://127.11.224.62:40522/ using document root and password file I0401 16:41:43.581459 14499 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:43.583474 14499 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:43.584187 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 841931us I0401 16:41:43.584358 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:43.584395 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:43.584511 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:43.584537 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:43.585634 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "c95f2f61d77f4869a667c1d8210ed34c" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.594408 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.008s user 0.002s sys 0.002s I0401 16:41:43.595618 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:43.596295 14499 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:43.597098 14499 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:50234: Network error: Client connection negotiation failed: client connection to 127.11.224.61:50234: connect: Connection refused (error 111) I0401 16:41:43.597836 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:43.597903 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-1-root uuid: "c95f2f61d77f4869a667c1d8210ed34c" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.598007 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:43.620303 14499 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } attempt: 1 W0401 16:41:43.621194 14499 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:50234: Network error: Client connection negotiation failed: client connection to 127.11.224.61:50234: connect: Connection refused (error 111) I0401 16:41:43.637109 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:50234 I0401 16:41:43.637771 12160 webserver.cc:308] Webserver started at http://127.11.224.61:42456/ using document root and password file I0401 16:41:43.638691 14556 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:43.640535 14556 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:43.641953 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 841931us I0401 16:41:43.642134 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:43.642189 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:43.642283 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:43.642310 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:43.645696 14556 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:43.650753 14556 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:43.651382 14556 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:37435: Network error: Client connection negotiation failed: client connection to 127.11.224.60:37435: connect: Connection refused (error 111) I0401 16:41:43.654924 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "3554ae29f8ea452790970952916fbb67" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.658756 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s I0401 16:41:43.659384 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:43.661401 12160 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0401 16:41:43.661447 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-2-root uuid: "3554ae29f8ea452790970952916fbb67" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.661523 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:43.676594 14556 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } attempt: 1 W0401 16:41:43.677559 14556 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:37435: Network error: Client connection negotiation failed: client connection to 127.11.224.60:37435: connect: Connection refused (error 111) I0401 16:41:43.695462 14499 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } attempt: 2 I0401 16:41:43.700109 14499 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:43.700806 14499 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:37435: Network error: Client connection negotiation failed: client connection to 127.11.224.60:37435: connect: Connection refused (error 111) I0401 16:41:43.722643 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:37435 I0401 16:41:43.723331 12160 webserver.cc:308] Webserver started at http://127.11.224.60:55379/ using document root and password file I0401 16:41:43.723656 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:43.724429 14613 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:43.726263 14613 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:43.730613 14613 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:43.733876 14613 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:43.737923 14499 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } attempt: 1 I0401 16:41:43.740257 14613 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67: Bootstrap starting. I0401 16:41:43.741722 14613 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67: No blocks or log segments found. Creating new log. I0401 16:41:43.743450 14499 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca: Bootstrap starting. I0401 16:41:43.743630 14613 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67: No bootstrap required, opened a new log I0401 16:41:43.744374 14613 raft_consensus.cc:340] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } I0401 16:41:43.744552 14613 raft_consensus.cc:366] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:43.744591 14613 raft_consensus.cc:705] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3554ae29f8ea452790970952916fbb67, State: Initialized, Role: FOLLOWER I0401 16:41:43.744787 14499 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca: No blocks or log segments found. Creating new log. I0401 16:41:43.744747 14613 consensus_queue.cc:229] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } I0401 16:41:43.745296 14613 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.745512 14613 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.745427 14617 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.745697 14617 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.745995 14613 sys_catalog.cc:424] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:43.746378 14499 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca: No bootstrap required, opened a new log I0401 16:41:43.746841 14499 raft_consensus.cc:340] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } I0401 16:41:43.746976 14499 raft_consensus.cc:366] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:43.746999 14499 raft_consensus.cc:705] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dd1566ed5614f3495f174d0c2cd95ca, State: Initialized, Role: FOLLOWER I0401 16:41:43.747130 14499 consensus_queue.cc:229] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } W0401 16:41:43.747306 14619 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:43.747357 14619 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:43.747587 14499 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.747750 14499 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.747750 14556 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } attempt: 2 I0401 16:41:43.747684 14620 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.748044 14620 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.748513 14499 sys_catalog.cc:424] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:43.748916 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 W0401 16:41:43.749944 14621 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:43.749991 14621 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:43.752951 14556 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c: Bootstrap starting. I0401 16:41:43.753821 14556 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c: No blocks or log segments found. Creating new log. I0401 16:41:43.755043 14556 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c: No bootstrap required, opened a new log I0401 16:41:43.755515 14556 raft_consensus.cc:340] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } I0401 16:41:43.755635 14556 raft_consensus.cc:366] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:43.755663 14556 raft_consensus.cc:705] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95f2f61d77f4869a667c1d8210ed34c, State: Initialized, Role: FOLLOWER I0401 16:41:43.755795 14556 consensus_queue.cc:229] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } I0401 16:41:43.756208 14556 sys_catalog.cc:337] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.756331 14556 sys_catalog.cc:340] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.756264 14623 sys_catalog.cc:337] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.756383 14623 sys_catalog.cc:340] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.756655 14556 sys_catalog.cc:424] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:43.756942 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:43.758014 14624 catalog_manager.cc:1113] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:43.758052 14624 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:43.761477 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 841931us I0401 16:41:43.761612 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:43.761641 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:43.761732 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:43.761759 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:43.762156 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "0d05f40568e743aca4798bfc0dc47a8f" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.765821 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.003s sys 0.001s I0401 16:41:43.766466 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:43.768631 12160 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0401 16:41:43.768677 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-0-root uuid: "0d05f40568e743aca4798bfc0dc47a8f" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.768746 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:43.780594 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:43.780635 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:43.795521 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:56369 I0401 16:41:43.796308 12160 webserver.cc:308] Webserver started at http://127.11.224.1:45948/ using document root and password file I0401 16:41:43.808919 14690 heartbeater.cc:345] Connected to a master server at 127.11.224.61:50234 I0401 16:41:43.809007 14690 heartbeater.cc:426] Registering TS with master... I0401 16:41:43.809196 14690 heartbeater.cc:475] Master 127.11.224.61:50234 requested a full tablet report, sending... I0401 16:41:43.810314 14523 ts_manager.cc:159] Registered new tserver with Master: 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369) I0401 16:41:43.810714 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 841931us I0401 16:41:43.810910 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:43.810950 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:43.810953 14691 heartbeater.cc:345] Connected to a master server at 127.11.224.62:49328 I0401 16:41:43.811012 14691 heartbeater.cc:426] Registering TS with master... I0401 16:41:43.811045 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:43.811070 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:43.811327 14689 heartbeater.cc:345] Connected to a master server at 127.11.224.60:37435 I0401 16:41:43.811357 14691 heartbeater.cc:475] Master 127.11.224.62:49328 requested a full tablet report, sending... I0401 16:41:43.811375 14689 heartbeater.cc:426] Registering TS with master... I0401 16:41:43.811581 14689 heartbeater.cc:475] Master 127.11.224.60:37435 requested a full tablet report, sending... I0401 16:41:43.811671 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "fea15e44a97e4adda7ae903b7a1ee269" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.812486 14466 ts_manager.cc:159] Registered new tserver with Master: 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369) I0401 16:41:43.812566 14580 ts_manager.cc:159] Registered new tserver with Master: 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369) I0401 16:41:43.815966 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s I0401 16:41:43.816635 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:43.819099 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:43.819145 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-1-root uuid: "fea15e44a97e4adda7ae903b7a1ee269" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.819218 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:43.820993 14623 raft_consensus.cc:472] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:43.821091 14623 raft_consensus.cc:494] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } I0401 16:41:43.821732 14623 leader_election.cc:296] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dd1566ed5614f3495f174d0c2cd95ca (127.11.224.62:49328), 3554ae29f8ea452790970952916fbb67 (127.11.224.60:37435) I0401 16:41:43.822257 14476 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95f2f61d77f4869a667c1d8210ed34c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" is_pre_election: true I0401 16:41:43.822271 14590 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95f2f61d77f4869a667c1d8210ed34c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3554ae29f8ea452790970952916fbb67" is_pre_election: true I0401 16:41:43.822587 14476 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95f2f61d77f4869a667c1d8210ed34c in term 0. I0401 16:41:43.822654 14590 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95f2f61d77f4869a667c1d8210ed34c in term 0. I0401 16:41:43.822949 14507 leader_election.cc:310] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554ae29f8ea452790970952916fbb67, c95f2f61d77f4869a667c1d8210ed34c; no voters: I0401 16:41:43.823132 14623 raft_consensus.cc:2640] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:43.823174 14623 raft_consensus.cc:472] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:43.823220 14623 raft_consensus.cc:2886] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:43.825412 14623 raft_consensus.cc:494] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } I0401 16:41:43.825945 14623 leader_election.cc:296] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [CANDIDATE]: Term 1 election: Requested vote from peers 6dd1566ed5614f3495f174d0c2cd95ca (127.11.224.62:49328), 3554ae29f8ea452790970952916fbb67 (127.11.224.60:37435) I0401 16:41:43.826232 14476 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95f2f61d77f4869a667c1d8210ed34c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" I0401 16:41:43.826263 14590 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c95f2f61d77f4869a667c1d8210ed34c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3554ae29f8ea452790970952916fbb67" I0401 16:41:43.826333 14476 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:43.826365 14590 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:43.828357 14590 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95f2f61d77f4869a667c1d8210ed34c in term 1. I0401 16:41:43.828357 14476 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95f2f61d77f4869a667c1d8210ed34c in term 1. I0401 16:41:43.828702 14507 leader_election.cc:310] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3554ae29f8ea452790970952916fbb67, c95f2f61d77f4869a667c1d8210ed34c; no voters: I0401 16:41:43.828908 14623 raft_consensus.cc:2640] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:43.829416 14623 raft_consensus.cc:667] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 1 LEADER]: Becoming Leader. State: Replica: c95f2f61d77f4869a667c1d8210ed34c, State: Running, Role: LEADER I0401 16:41:43.829638 14623 consensus_queue.cc:206] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } I0401 16:41:43.830961 14702 sys_catalog.cc:337] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95f2f61d77f4869a667c1d8210ed34c. Latest consensus state: current_term: 1 leader_uuid: "c95f2f61d77f4869a667c1d8210ed34c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.831228 14702 sys_catalog.cc:340] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: This master's current role is: LEADER I0401 16:41:43.831981 14704 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:43.833822 14704 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:43.845000 14590 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 1 FOLLOWER]: Refusing update from remote peer c95f2f61d77f4869a667c1d8210ed34c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:43.845276 14476 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 1 FOLLOWER]: Refusing update from remote peer c95f2f61d77f4869a667c1d8210ed34c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:43.845436 14702 consensus_queue.cc:984] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.845693 14623 consensus_queue.cc:984] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:43.848515 14620 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95f2f61d77f4869a667c1d8210ed34c. Latest consensus state: current_term: 1 leader_uuid: "c95f2f61d77f4869a667c1d8210ed34c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.848690 14620 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.851169 14623 sys_catalog.cc:337] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c95f2f61d77f4869a667c1d8210ed34c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.851330 14623 sys_catalog.cc:340] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: This master's current role is: LEADER I0401 16:41:43.852113 14704 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:43.853590 14704 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:43.856101 14620 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c95f2f61d77f4869a667c1d8210ed34c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.856256 14620 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.861112 14617 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c95f2f61d77f4869a667c1d8210ed34c. Latest consensus state: current_term: 1 leader_uuid: "c95f2f61d77f4869a667c1d8210ed34c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.861279 14617 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.861734 14623 sys_catalog.cc:337] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c95f2f61d77f4869a667c1d8210ed34c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.861929 14623 sys_catalog.cc:340] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [sys.catalog]: This master's current role is: LEADER I0401 16:41:43.863386 14617 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c95f2f61d77f4869a667c1d8210ed34c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6dd1566ed5614f3495f174d0c2cd95ca" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 49328 } } peers { permanent_uuid: "c95f2f61d77f4869a667c1d8210ed34c" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 50234 } } peers { permanent_uuid: "3554ae29f8ea452790970952916fbb67" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 37435 } } } I0401 16:41:43.863551 14617 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:43.866883 14704 catalog_manager.cc:4281] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c: Generated new TSK 0 I0401 16:41:43.869276 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:43.869312 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:43.880654 14523 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:41631 I0401 16:41:43.887323 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:42396 I0401 16:41:43.888099 12160 webserver.cc:308] Webserver started at http://127.11.224.2:37915/ using document root and password file I0401 16:41:43.892598 14690 heartbeater.cc:467] Master 127.11.224.61:50234 was elected leader, sending a full tablet report... I0401 16:41:43.900689 14772 heartbeater.cc:345] Connected to a master server at 127.11.224.60:37435 I0401 16:41:43.900789 14772 heartbeater.cc:426] Registering TS with master... I0401 16:41:43.901218 14772 heartbeater.cc:475] Master 127.11.224.60:37435 requested a full tablet report, sending... I0401 16:41:43.901803 14774 heartbeater.cc:345] Connected to a master server at 127.11.224.62:49328 I0401 16:41:43.901865 14774 heartbeater.cc:426] Registering TS with master... I0401 16:41:43.902143 14774 heartbeater.cc:475] Master 127.11.224.62:49328 requested a full tablet report, sending... I0401 16:41:43.902346 14580 ts_manager.cc:159] Registered new tserver with Master: fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396) I0401 16:41:43.902534 14773 heartbeater.cc:345] Connected to a master server at 127.11.224.61:50234 I0401 16:41:43.902601 14773 heartbeater.cc:426] Registering TS with master... I0401 16:41:43.902771 14773 heartbeater.cc:475] Master 127.11.224.61:50234 requested a full tablet report, sending... I0401 16:41:43.903079 14466 ts_manager.cc:159] Registered new tserver with Master: fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396) I0401 16:41:43.903586 14523 ts_manager.cc:159] Registered new tserver with Master: fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396) I0401 16:41:43.904479 14523 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:41635 I0401 16:41:43.908792 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 841931us I0401 16:41:43.908972 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:43.909004 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:43.909072 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:43.909096 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:43.909529 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "283c2ec6589f41e3ae8293860db57d2d" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.914235 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.004s sys 0.001s I0401 16:41:43.915017 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:43.916617 14773 heartbeater.cc:467] Master 127.11.224.61:50234 was elected leader, sending a full tablet report... I0401 16:41:43.918658 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:43.918707 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-2-root uuid: "283c2ec6589f41e3ae8293860db57d2d" format_stamp: "Formatted at 2019-04-01 23:41:43 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:43.918782 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksum.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:43.996359 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:43.996403 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:44.013675 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:37505 I0401 16:41:44.014470 12160 webserver.cc:308] Webserver started at http://127.11.224.3:42302/ using document root and password file I0401 16:41:44.030423 14843 heartbeater.cc:345] Connected to a master server at 127.11.224.60:37435 I0401 16:41:44.030511 14843 heartbeater.cc:426] Registering TS with master... I0401 16:41:44.030758 14844 heartbeater.cc:345] Connected to a master server at 127.11.224.61:50234 I0401 16:41:44.030822 14843 heartbeater.cc:475] Master 127.11.224.60:37435 requested a full tablet report, sending... I0401 16:41:44.030844 14844 heartbeater.cc:426] Registering TS with master... I0401 16:41:44.031016 14844 heartbeater.cc:475] Master 127.11.224.61:50234 requested a full tablet report, sending... I0401 16:41:44.031719 14579 ts_manager.cc:159] Registered new tserver with Master: 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.031720 14523 ts_manager.cc:159] Registered new tserver with Master: 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.031988 14845 heartbeater.cc:345] Connected to a master server at 127.11.224.62:49328 I0401 16:41:44.032047 14845 heartbeater.cc:426] Registering TS with master... I0401 16:41:44.032197 14845 heartbeater.cc:475] Master 127.11.224.62:49328 requested a full tablet report, sending... I0401 16:41:44.032927 14466 ts_manager.cc:159] Registered new tserver with Master: 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.032923 14523 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:41637 I0401 16:41:44.033939 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.010336444s I0401 16:41:44.044203 14844 heartbeater.cc:467] Master 127.11.224.61:50234 was elected leader, sending a full tablet report... I0401 16:41:44.047890 14522 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.61:41640: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:44.048648 14522 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:44.081516 14656 tablet_service.cc:1006] Processing CreateTablet for tablet 541db4e418a0469eb8411e03991af88a (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:44.081650 14653 tablet_service.cc:1006] Processing CreateTablet for tablet 387632c6220140579a2af626e0d32b27 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:44.082056 14653 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 387632c6220140579a2af626e0d32b27. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.082212 14656 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 541db4e418a0469eb8411e03991af88a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.081485 14655 tablet_service.cc:1006] Processing CreateTablet for tablet bce6fca53cd74d1f8df1788e9c0e021e (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:44.082506 14655 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bce6fca53cd74d1f8df1788e9c0e021e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.082581 14654 tablet_service.cc:1006] Processing CreateTablet for tablet d85f21b57325444f83daa076c12958c6 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:44.082947 14654 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d85f21b57325444f83daa076c12958c6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.085283 14651 tablet_service.cc:1006] Processing CreateTablet for tablet a0fbe7cbf8074d36affe7823f6e106e8 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:44.085543 14651 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a0fbe7cbf8074d36affe7823f6e106e8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.082123 14650 tablet_service.cc:1006] Processing CreateTablet for tablet 1198d0b3a3dd4b5e8b73d7f0db45b0c6 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:44.087301 14652 tablet_service.cc:1006] Processing CreateTablet for tablet a1871f71f942419aa8e00e2299cdaf51 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:44.087931 14647 tablet_service.cc:1006] Processing CreateTablet for tablet 9635e9b10d42466d8a5a46be8762b3f0 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:44.088095 14652 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a1871f71f942419aa8e00e2299cdaf51. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.088186 14648 tablet_service.cc:1006] Processing CreateTablet for tablet f4022cf548804d9fa764b8b6e861569c (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:44.088518 14647 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9635e9b10d42466d8a5a46be8762b3f0. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.089013 14650 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1198d0b3a3dd4b5e8b73d7f0db45b0c6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.089499 14648 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f4022cf548804d9fa764b8b6e861569c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.091167 14649 tablet_service.cc:1006] Processing CreateTablet for tablet 45c9acddafbe4259a83368d1018f5f78 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:44.091624 14649 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 45c9acddafbe4259a83368d1018f5f78. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.104377 14863 tablet_bootstrap.cc:439] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.105953 14810 tablet_service.cc:1006] Processing CreateTablet for tablet 541db4e418a0469eb8411e03991af88a (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:44.106142 14809 tablet_service.cc:1006] Processing CreateTablet for tablet bce6fca53cd74d1f8df1788e9c0e021e (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:44.106370 14810 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 541db4e418a0469eb8411e03991af88a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.106618 14809 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bce6fca53cd74d1f8df1788e9c0e021e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.109192 14738 tablet_service.cc:1006] Processing CreateTablet for tablet bce6fca53cd74d1f8df1788e9c0e021e (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:44.109472 14738 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bce6fca53cd74d1f8df1788e9c0e021e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.109524 14736 tablet_service.cc:1006] Processing CreateTablet for tablet 387632c6220140579a2af626e0d32b27 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:44.109943 14736 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 387632c6220140579a2af626e0d32b27. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.110157 14739 tablet_service.cc:1006] Processing CreateTablet for tablet 541db4e418a0469eb8411e03991af88a (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:44.110502 14739 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 541db4e418a0469eb8411e03991af88a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.112577 14730 tablet_service.cc:1006] Processing CreateTablet for tablet 9635e9b10d42466d8a5a46be8762b3f0 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:44.112577 14735 tablet_service.cc:1006] Processing CreateTablet for tablet a1871f71f942419aa8e00e2299cdaf51 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:44.113054 14737 tablet_service.cc:1006] Processing CreateTablet for tablet d85f21b57325444f83daa076c12958c6 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:44.113183 14734 tablet_service.cc:1006] Processing CreateTablet for tablet a0fbe7cbf8074d36affe7823f6e106e8 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:44.113893 14733 tablet_service.cc:1006] Processing CreateTablet for tablet 1198d0b3a3dd4b5e8b73d7f0db45b0c6 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:44.113900 14808 tablet_service.cc:1006] Processing CreateTablet for tablet d85f21b57325444f83daa076c12958c6 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:44.114212 14808 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d85f21b57325444f83daa076c12958c6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.114440 14732 tablet_service.cc:1006] Processing CreateTablet for tablet 45c9acddafbe4259a83368d1018f5f78 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:44.115099 14731 tablet_service.cc:1006] Processing CreateTablet for tablet f4022cf548804d9fa764b8b6e861569c (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:44.116742 14865 tablet_bootstrap.cc:439] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.117552 14863 tablet_bootstrap.cc:590] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.118995 14730 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9635e9b10d42466d8a5a46be8762b3f0. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.119510 14737 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d85f21b57325444f83daa076c12958c6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.120416 14735 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a1871f71f942419aa8e00e2299cdaf51. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.120550 14734 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a0fbe7cbf8074d36affe7823f6e106e8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.122905 14733 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1198d0b3a3dd4b5e8b73d7f0db45b0c6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.123495 14807 tablet_service.cc:1006] Processing CreateTablet for tablet 387632c6220140579a2af626e0d32b27 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:44.123978 14807 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 387632c6220140579a2af626e0d32b27. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.134809 14732 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 45c9acddafbe4259a83368d1018f5f78. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.151386 14731 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f4022cf548804d9fa764b8b6e861569c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.151654 14865 tablet_bootstrap.cc:590] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.153117 14806 tablet_service.cc:1006] Processing CreateTablet for tablet a1871f71f942419aa8e00e2299cdaf51 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:44.153616 14806 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a1871f71f942419aa8e00e2299cdaf51. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.156394 14805 tablet_service.cc:1006] Processing CreateTablet for tablet 1198d0b3a3dd4b5e8b73d7f0db45b0c6 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:44.156879 14805 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1198d0b3a3dd4b5e8b73d7f0db45b0c6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.157631 14804 tablet_service.cc:1006] Processing CreateTablet for tablet 45c9acddafbe4259a83368d1018f5f78 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:44.157994 14804 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 45c9acddafbe4259a83368d1018f5f78. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.161324 14803 tablet_service.cc:1006] Processing CreateTablet for tablet f4022cf548804d9fa764b8b6e861569c (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:44.162138 14808 tablet_service.cc:1006] Processing CreateTablet for tablet a0fbe7cbf8074d36affe7823f6e106e8 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:44.162395 14808 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a0fbe7cbf8074d36affe7823f6e106e8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.164762 14803 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f4022cf548804d9fa764b8b6e861569c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.166913 14802 tablet_service.cc:1006] Processing CreateTablet for tablet 9635e9b10d42466d8a5a46be8762b3f0 (table=ksck-test-table [id=ba9f723145854329a93e61b5e9776b62]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:44.168282 14802 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9635e9b10d42466d8a5a46be8762b3f0. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:44.175704 14864 tablet_bootstrap.cc:439] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.179287 14863 tablet_bootstrap.cc:439] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.179404 14863 ts_tablet_manager.cc:1053] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.075s user 0.003s sys 0.012s I0401 16:41:44.179831 14864 tablet_bootstrap.cc:590] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.180095 14863 raft_consensus.cc:340] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.180275 14863 raft_consensus.cc:366] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.180318 14863 raft_consensus.cc:705] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.180481 14863 consensus_queue.cc:229] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.180966 14865 tablet_bootstrap.cc:439] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.181061 14865 ts_tablet_manager.cc:1053] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.064s user 0.002s sys 0.001s I0401 16:41:44.181901 14863 ts_tablet_manager.cc:1081] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:44.182111 14863 tablet_bootstrap.cc:439] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.183949 14863 tablet_bootstrap.cc:590] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.184172 14864 tablet_bootstrap.cc:439] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.184139 14865 raft_consensus.cc:340] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.184372 14865 raft_consensus.cc:366] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.184396 14864 ts_tablet_manager.cc:1053] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s I0401 16:41:44.184412 14865 raft_consensus.cc:705] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.184556 14865 consensus_queue.cc:229] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.184993 14864 raft_consensus.cc:340] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.185273 14864 raft_consensus.cc:366] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.185303 14865 ts_tablet_manager.cc:1081] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:44.185326 14864 raft_consensus.cc:705] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.185643 14864 consensus_queue.cc:229] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.186779 14865 tablet_bootstrap.cc:439] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.190330 14865 tablet_bootstrap.cc:590] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.191143 14863 tablet_bootstrap.cc:439] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.191241 14863 ts_tablet_manager.cc:1053] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s I0401 16:41:44.191937 14863 raft_consensus.cc:340] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.192181 14863 raft_consensus.cc:366] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.192242 14863 raft_consensus.cc:705] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.192414 14863 consensus_queue.cc:229] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.193414 14864 ts_tablet_manager.cc:1081] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.009s user 0.003s sys 0.004s I0401 16:41:44.194092 14864 tablet_bootstrap.cc:439] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.196574 14864 tablet_bootstrap.cc:590] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.197130 14865 tablet_bootstrap.cc:439] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.197239 14865 ts_tablet_manager.cc:1053] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.002s I0401 16:41:44.198074 14865 raft_consensus.cc:340] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.198236 14865 raft_consensus.cc:366] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.198271 14865 raft_consensus.cc:705] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.198411 14865 consensus_queue.cc:229] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.198864 14865 ts_tablet_manager.cc:1081] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:44.199084 14865 tablet_bootstrap.cc:439] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.200426 14865 tablet_bootstrap.cc:590] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.202052 14863 ts_tablet_manager.cc:1081] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s I0401 16:41:44.202371 14863 tablet_bootstrap.cc:439] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.203755 14863 tablet_bootstrap.cc:590] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.205422 14864 tablet_bootstrap.cc:439] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.205596 14864 ts_tablet_manager.cc:1053] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.001s I0401 16:41:44.205837 14863 tablet_bootstrap.cc:439] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.205957 14863 ts_tablet_manager.cc:1053] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0401 16:41:44.206342 14864 raft_consensus.cc:340] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.206612 14864 raft_consensus.cc:366] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.206513 14863 raft_consensus.cc:340] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.206662 14863 raft_consensus.cc:366] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.206701 14863 raft_consensus.cc:705] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.206894 14863 consensus_queue.cc:229] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.207098 14865 tablet_bootstrap.cc:439] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.207199 14865 ts_tablet_manager.cc:1053] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s I0401 16:41:44.207401 14863 ts_tablet_manager.cc:1081] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:44.207612 14863 tablet_bootstrap.cc:439] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.208032 14865 raft_consensus.cc:340] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.208225 14865 raft_consensus.cc:366] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.208261 14865 raft_consensus.cc:705] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.208398 14865 consensus_queue.cc:229] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.209053 14863 tablet_bootstrap.cc:590] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.209322 14865 ts_tablet_manager.cc:1081] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:41:44.209538 14865 tablet_bootstrap.cc:439] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.210665 14864 raft_consensus.cc:705] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.211547 14865 tablet_bootstrap.cc:590] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.210944 14864 consensus_queue.cc:229] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.212877 14864 ts_tablet_manager.cc:1081] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s I0401 16:41:44.213126 14864 tablet_bootstrap.cc:439] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.215322 14864 tablet_bootstrap.cc:590] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.216948 14863 tablet_bootstrap.cc:439] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.217058 14863 ts_tablet_manager.cc:1053] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s I0401 16:41:44.217342 14864 tablet_bootstrap.cc:439] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.217432 14864 ts_tablet_manager.cc:1053] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s I0401 16:41:44.217702 14863 raft_consensus.cc:340] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.217890 14863 raft_consensus.cc:366] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.217934 14863 raft_consensus.cc:705] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.217881 14864 raft_consensus.cc:340] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.218035 14864 raft_consensus.cc:366] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.218098 14864 raft_consensus.cc:705] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.218089 14863 consensus_queue.cc:229] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.218231 14864 consensus_queue.cc:229] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.218564 14863 ts_tablet_manager.cc:1081] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s I0401 16:41:44.218796 14863 tablet_bootstrap.cc:439] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.219311 14864 ts_tablet_manager.cc:1081] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:44.219569 14864 tablet_bootstrap.cc:439] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.220044 14871 raft_consensus.cc:472] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.220149 14871 raft_consensus.cc:494] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.221032 14871 leader_election.cc:296] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.221369 14864 tablet_bootstrap.cc:590] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.224797 14863 tablet_bootstrap.cc:590] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.228670 14872 raft_consensus.cc:472] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.228762 14872 raft_consensus.cc:494] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.229426 14864 tablet_bootstrap.cc:439] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.229490 14872 leader_election.cc:296] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396) I0401 16:41:44.229543 14864 ts_tablet_manager.cc:1053] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s I0401 16:41:44.229429 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "387632c6220140579a2af626e0d32b27" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" is_pre_election: true W0401 16:41:44.230216 14698 leader_election.cc:348] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:44.230741 14864 raft_consensus.cc:340] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.230998 14864 raft_consensus.cc:366] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.231070 14864 raft_consensus.cc:705] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.232050 14820 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "387632c6220140579a2af626e0d32b27" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" is_pre_election: true I0401 16:41:44.231284 14864 consensus_queue.cc:229] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.232296 14820 raft_consensus.cc:2346] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 0. I0401 16:41:44.232939 14699 leader_election.cc:310] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: 0d05f40568e743aca4798bfc0dc47a8f I0401 16:41:44.233201 14864 ts_tablet_manager.cc:1081] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:44.233523 14871 raft_consensus.cc:2640] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.233592 14871 raft_consensus.cc:472] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.233649 14871 raft_consensus.cc:2886] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.235800 14863 tablet_bootstrap.cc:439] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.235935 14871 raft_consensus.cc:494] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.236086 14863 ts_tablet_manager.cc:1053] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.006s I0401 16:41:44.236896 14864 tablet_bootstrap.cc:439] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.236765 14749 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d85f21b57325444f83daa076c12958c6" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" is_pre_election: true I0401 16:41:44.237751 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "387632c6220140579a2af626e0d32b27" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" I0401 16:41:44.238032 14871 leader_election.cc:296] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Requested vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) W0401 16:41:44.238178 14698 leader_election.cc:348] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369): Illegal state: must be running to vote when last-logged opid is not known W0401 16:41:44.238286 14783 leader_election.cc:348] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:44.238649 14863 raft_consensus.cc:340] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.240187 14864 tablet_bootstrap.cc:590] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.240188 14863 raft_consensus.cc:366] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.240301 14863 raft_consensus.cc:705] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.240556 14820 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "387632c6220140579a2af626e0d32b27" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" I0401 16:41:44.240712 14820 raft_consensus.cc:2886] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.240538 14863 consensus_queue.cc:229] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.242192 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d85f21b57325444f83daa076c12958c6" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" is_pre_election: true I0401 16:41:44.242326 14666 raft_consensus.cc:2346] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 0. I0401 16:41:44.242638 14781 leader_election.cc:310] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, 283c2ec6589f41e3ae8293860db57d2d; no voters: fea15e44a97e4adda7ae903b7a1ee269 I0401 16:41:44.243003 14820 raft_consensus.cc:2346] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 1. I0401 16:41:44.243171 14865 tablet_bootstrap.cc:439] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.243304 14865 ts_tablet_manager.cc:1053] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.034s user 0.004s sys 0.003s I0401 16:41:44.243492 14872 raft_consensus.cc:2640] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.243546 14872 raft_consensus.cc:472] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.243609 14872 raft_consensus.cc:2886] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.244098 14699 leader_election.cc:310] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: 0d05f40568e743aca4798bfc0dc47a8f I0401 16:41:44.244266 14865 raft_consensus.cc:340] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.244524 14865 raft_consensus.cc:366] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.244582 14865 raft_consensus.cc:705] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.244793 14865 consensus_queue.cc:229] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.245131 14871 raft_consensus.cc:2640] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.245535 14863 ts_tablet_manager.cc:1081] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s I0401 16:41:44.245746 14863 tablet_bootstrap.cc:439] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.245762 14872 raft_consensus.cc:494] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.246431 14872 leader_election.cc:296] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 election: Requested vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396) I0401 16:41:44.246726 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d85f21b57325444f83daa076c12958c6" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" I0401 16:41:44.246860 14666 raft_consensus.cc:2886] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.248553 14749 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d85f21b57325444f83daa076c12958c6" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" W0401 16:41:44.249361 14783 leader_election.cc:348] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:44.249573 14666 raft_consensus.cc:2346] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 1. I0401 16:41:44.249853 14781 leader_election.cc:310] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, 283c2ec6589f41e3ae8293860db57d2d; no voters: fea15e44a97e4adda7ae903b7a1ee269 I0401 16:41:44.250172 14872 raft_consensus.cc:2640] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.251217 14863 tablet_bootstrap.cc:590] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.251893 14872 raft_consensus.cc:667] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 LEADER]: Becoming Leader. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Running, Role: LEADER I0401 16:41:44.252275 14872 consensus_queue.cc:206] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.252964 14871 raft_consensus.cc:667] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Becoming Leader. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Running, Role: LEADER I0401 16:41:44.253710 14865 ts_tablet_manager.cc:1081] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.010s user 0.002s sys 0.003s I0401 16:41:44.253943 14865 tablet_bootstrap.cc:439] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.255071 14865 tablet_bootstrap.cc:590] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.254648 14871 consensus_queue.cc:206] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.256448 14863 tablet_bootstrap.cc:439] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.256546 14863 ts_tablet_manager.cc:1053] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s I0401 16:41:44.262125 14863 raft_consensus.cc:340] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.262284 14863 raft_consensus.cc:366] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.262313 14863 raft_consensus.cc:705] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.262437 14863 consensus_queue.cc:229] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.262883 14863 ts_tablet_manager.cc:1081] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s I0401 16:41:44.263069 14863 tablet_bootstrap.cc:439] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.268062 14863 tablet_bootstrap.cc:590] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.272403 14521 catalog_manager.cc:3977] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d reported cstate change: term changed from 0 to 1, leader changed from to 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3). New cstate: current_term: 1 leader_uuid: "283c2ec6589f41e3ae8293860db57d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: HEALTHY } } } I0401 16:41:44.275333 14522 catalog_manager.cc:3977] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 reported cstate change: term changed from 0 to 1, leader changed from to fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "fea15e44a97e4adda7ae903b7a1ee269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: UNKNOWN } } } I0401 16:41:44.276245 14864 tablet_bootstrap.cc:439] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.276770 14864 ts_tablet_manager.cc:1053] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.043s user 0.002s sys 0.016s I0401 16:41:44.278429 14863 tablet_bootstrap.cc:439] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.278534 14863 ts_tablet_manager.cc:1053] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.016s user 0.001s sys 0.002s I0401 16:41:44.279024 14864 raft_consensus.cc:340] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.279243 14864 raft_consensus.cc:366] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.281147 14864 raft_consensus.cc:705] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.281270 14865 tablet_bootstrap.cc:439] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.281863 14865 ts_tablet_manager.cc:1053] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.028s user 0.004s sys 0.016s I0401 16:41:44.281410 14864 consensus_queue.cc:229] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.282621 14865 raft_consensus.cc:340] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.279227 14863 raft_consensus.cc:340] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.282827 14863 raft_consensus.cc:366] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.283232 14864 ts_tablet_manager.cc:1081] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s I0401 16:41:44.283298 14863 raft_consensus.cc:705] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.283524 14864 tablet_bootstrap.cc:439] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.283457 14863 consensus_queue.cc:229] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.285209 14863 ts_tablet_manager.cc:1081] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s I0401 16:41:44.285434 14863 tablet_bootstrap.cc:439] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.286864 14863 tablet_bootstrap.cc:590] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.288003 14865 raft_consensus.cc:366] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.288080 14865 raft_consensus.cc:705] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.288280 14865 consensus_queue.cc:229] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.289235 14865 ts_tablet_manager.cc:1081] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.007s user 0.000s sys 0.001s I0401 16:41:44.289489 14865 tablet_bootstrap.cc:439] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.290693 14864 tablet_bootstrap.cc:590] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.291121 14865 tablet_bootstrap.cc:590] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.292636 14863 tablet_bootstrap.cc:439] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.292728 14863 ts_tablet_manager.cc:1053] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.000s I0401 16:41:44.293222 14865 tablet_bootstrap.cc:439] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.293344 14865 ts_tablet_manager.cc:1053] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0401 16:41:44.293437 14863 raft_consensus.cc:340] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.293632 14863 raft_consensus.cc:366] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.293699 14863 raft_consensus.cc:705] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.293961 14863 consensus_queue.cc:229] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.293994 14865 raft_consensus.cc:340] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.294206 14865 raft_consensus.cc:366] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.294270 14865 raft_consensus.cc:705] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.295130 14863 ts_tablet_manager.cc:1081] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:44.295379 14863 tablet_bootstrap.cc:439] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.295629 14865 consensus_queue.cc:229] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.298396 14863 tablet_bootstrap.cc:590] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.302137 14865 ts_tablet_manager.cc:1081] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.009s user 0.000s sys 0.001s I0401 16:41:44.302160 14864 tablet_bootstrap.cc:439] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.302418 14864 ts_tablet_manager.cc:1053] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.019s user 0.002s sys 0.008s I0401 16:41:44.302443 14865 tablet_bootstrap.cc:439] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.303055 14864 raft_consensus.cc:340] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.303175 14864 raft_consensus.cc:366] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.303225 14864 raft_consensus.cc:705] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.303391 14864 consensus_queue.cc:229] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.304106 14865 tablet_bootstrap.cc:590] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.304116 14864 ts_tablet_manager.cc:1081] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:44.304386 14864 tablet_bootstrap.cc:439] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.306486 14864 tablet_bootstrap.cc:590] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.307273 14865 tablet_bootstrap.cc:439] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.307507 14863 tablet_bootstrap.cc:439] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.307613 14863 ts_tablet_manager.cc:1053] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.003s I0401 16:41:44.308010 14865 ts_tablet_manager.cc:1053] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s I0401 16:41:44.309020 14863 raft_consensus.cc:340] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.309182 14863 raft_consensus.cc:366] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.309212 14863 raft_consensus.cc:705] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.309348 14863 consensus_queue.cc:229] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.310111 14863 ts_tablet_manager.cc:1081] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:44.310344 14863 tablet_bootstrap.cc:439] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f: Bootstrap starting. I0401 16:41:44.312258 14863 tablet_bootstrap.cc:590] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f: No blocks or log segments found. Creating new log. I0401 16:41:44.314584 14864 tablet_bootstrap.cc:439] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.314499 14865 raft_consensus.cc:340] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.314754 14865 raft_consensus.cc:366] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.314844 14865 raft_consensus.cc:705] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.314688 14864 ts_tablet_manager.cc:1053] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.003s I0401 16:41:44.315224 14863 tablet_bootstrap.cc:439] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f: No bootstrap required, opened a new log I0401 16:41:44.315089 14865 consensus_queue.cc:229] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.315321 14863 ts_tablet_manager.cc:1053] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s I0401 16:41:44.315589 14864 raft_consensus.cc:340] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.315762 14864 raft_consensus.cc:366] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.315795 14864 raft_consensus.cc:705] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.315951 14864 consensus_queue.cc:229] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.316179 14863 raft_consensus.cc:340] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.316328 14863 raft_consensus.cc:366] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.316357 14863 raft_consensus.cc:705] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Initialized, Role: FOLLOWER I0401 16:41:44.316511 14864 ts_tablet_manager.cc:1081] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:44.316515 14863 consensus_queue.cc:229] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.316733 14864 tablet_bootstrap.cc:439] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.317261 14871 raft_consensus.cc:472] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.317345 14871 raft_consensus.cc:494] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.317991 14864 tablet_bootstrap.cc:590] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.318099 14871 leader_election.cc:296] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.318801 14820 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bce6fca53cd74d1f8df1788e9c0e021e" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" is_pre_election: true I0401 16:41:44.318979 14820 raft_consensus.cc:2346] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 0. I0401 16:41:44.319885 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bce6fca53cd74d1f8df1788e9c0e021e" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" is_pre_election: true I0401 16:41:44.320052 14666 raft_consensus.cc:2346] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 0. I0401 16:41:44.320140 14699 leader_election.cc:310] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.320448 14871 raft_consensus.cc:2640] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.320492 14871 raft_consensus.cc:472] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.320627 14871 raft_consensus.cc:2886] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.322202 14863 ts_tablet_manager.cc:1081] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s I0401 16:41:44.322783 14871 raft_consensus.cc:494] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.323424 14871 leader_election.cc:296] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Requested vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.324106 14820 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bce6fca53cd74d1f8df1788e9c0e021e" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" I0401 16:41:44.324245 14820 raft_consensus.cc:2886] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.324349 14865 ts_tablet_manager.cc:1081] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.016s user 0.001s sys 0.000s I0401 16:41:44.324786 14865 tablet_bootstrap.cc:439] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.325033 14864 tablet_bootstrap.cc:439] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.325143 14864 ts_tablet_manager.cc:1053] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.008s user 0.001s sys 0.002s I0401 16:41:44.325656 14864 raft_consensus.cc:340] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.325775 14864 raft_consensus.cc:366] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.325839 14864 raft_consensus.cc:705] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.326015 14864 consensus_queue.cc:229] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.326118 14865 tablet_bootstrap.cc:590] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.326321 14820 raft_consensus.cc:2346] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 1. I0401 16:41:44.326807 14699 leader_election.cc:310] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.327343 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bce6fca53cd74d1f8df1788e9c0e021e" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" I0401 16:41:44.327474 14666 raft_consensus.cc:2886] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.327548 14871 raft_consensus.cc:2640] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.327628 14871 raft_consensus.cc:667] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Becoming Leader. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Running, Role: LEADER I0401 16:41:44.327811 14871 consensus_queue.cc:206] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.329460 14666 raft_consensus.cc:2346] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 1. I0401 16:41:44.330703 14523 catalog_manager.cc:3977] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 reported cstate change: term changed from 0 to 1, leader changed from to fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "fea15e44a97e4adda7ae903b7a1ee269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: UNKNOWN } } } I0401 16:41:44.331185 14864 ts_tablet_manager.cc:1081] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s I0401 16:41:44.331696 14864 tablet_bootstrap.cc:439] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.333097 14864 tablet_bootstrap.cc:590] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.337940 14864 tablet_bootstrap.cc:439] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.338099 14864 ts_tablet_manager.cc:1053] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s I0401 16:41:44.338472 14865 tablet_bootstrap.cc:439] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.338575 14865 ts_tablet_manager.cc:1053] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.004s I0401 16:41:44.338922 14864 raft_consensus.cc:340] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.339118 14864 raft_consensus.cc:366] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.339152 14864 raft_consensus.cc:705] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.339215 14865 raft_consensus.cc:340] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.339371 14865 raft_consensus.cc:366] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.339417 14865 raft_consensus.cc:705] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.339565 14865 consensus_queue.cc:229] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.339438 14864 consensus_queue.cc:229] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.340061 14865 ts_tablet_manager.cc:1081] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.001s user 0.002s sys 0.000s I0401 16:41:44.340487 14865 tablet_bootstrap.cc:439] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.342418 14865 tablet_bootstrap.cc:590] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.342875 14864 ts_tablet_manager.cc:1081] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I0401 16:41:44.343478 14864 tablet_bootstrap.cc:439] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d: Bootstrap starting. I0401 16:41:44.344632 14864 tablet_bootstrap.cc:590] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d: No blocks or log segments found. Creating new log. I0401 16:41:44.345352 14865 tablet_bootstrap.cc:439] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.345445 14865 ts_tablet_manager.cc:1053] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s I0401 16:41:44.346050 14864 tablet_bootstrap.cc:439] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d: No bootstrap required, opened a new log I0401 16:41:44.346020 14865 raft_consensus.cc:340] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.346210 14865 raft_consensus.cc:366] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.346249 14865 raft_consensus.cc:705] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.346160 14864 ts_tablet_manager.cc:1053] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s I0401 16:41:44.346382 14865 consensus_queue.cc:229] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.347375 14865 ts_tablet_manager.cc:1081] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:44.347599 14865 tablet_bootstrap.cc:439] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269: Bootstrap starting. I0401 16:41:44.347110 14864 raft_consensus.cc:340] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.347849 14864 raft_consensus.cc:366] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.347931 14864 raft_consensus.cc:705] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Initialized, Role: FOLLOWER I0401 16:41:44.348096 14864 consensus_queue.cc:229] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.348798 14864 ts_tablet_manager.cc:1081] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:44.349256 14865 tablet_bootstrap.cc:590] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269: No blocks or log segments found. Creating new log. I0401 16:41:44.350857 14872 raft_consensus.cc:472] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.350940 14872 raft_consensus.cc:494] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.351588 14865 tablet_bootstrap.cc:439] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269: No bootstrap required, opened a new log I0401 16:41:44.351600 14872 leader_election.cc:296] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396) I0401 16:41:44.351773 14865 ts_tablet_manager.cc:1053] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0401 16:41:44.352041 14749 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9635e9b10d42466d8a5a46be8762b3f0" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" is_pre_election: true I0401 16:41:44.352185 14749 raft_consensus.cc:2346] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 0. I0401 16:41:44.352185 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9635e9b10d42466d8a5a46be8762b3f0" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" is_pre_election: true I0401 16:41:44.352311 14666 raft_consensus.cc:2346] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 0. I0401 16:41:44.352372 14865 raft_consensus.cc:340] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.352524 14865 raft_consensus.cc:366] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:44.352502 14783 leader_election.cc:310] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.352870 14872 raft_consensus.cc:2640] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.352911 14872 raft_consensus.cc:472] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.352957 14872 raft_consensus.cc:2886] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.354493 14872 raft_consensus.cc:494] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.354940 14874 raft_consensus.cc:472] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.354954 14872 leader_election.cc:296] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 election: Requested vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396) I0401 16:41:44.354995 14865 raft_consensus.cc:705] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Initialized, Role: FOLLOWER I0401 16:41:44.355026 14874 raft_consensus.cc:494] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.355161 14865 consensus_queue.cc:229] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.355347 14749 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9635e9b10d42466d8a5a46be8762b3f0" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" I0401 16:41:44.355458 14749 raft_consensus.cc:2886] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.355696 14874 leader_election.cc:296] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.356158 14865 ts_tablet_manager.cc:1081] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s I0401 16:41:44.362267 14749 raft_consensus.cc:2346] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 1. I0401 16:41:44.362572 14783 leader_election.cc:310] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.362784 14872 raft_consensus.cc:2640] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.362906 14872 raft_consensus.cc:667] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 1 LEADER]: Becoming Leader. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Running, Role: LEADER I0401 16:41:44.363112 14872 consensus_queue.cc:206] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.366209 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9635e9b10d42466d8a5a46be8762b3f0" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" I0401 16:41:44.366336 14666 raft_consensus.cc:2886] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.366170 14523 catalog_manager.cc:3977] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d reported cstate change: term changed from 0 to 1, leader changed from to 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3). New cstate: current_term: 1 leader_uuid: "283c2ec6589f41e3ae8293860db57d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: HEALTHY } } } I0401 16:41:44.368590 14666 raft_consensus.cc:2346] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 1. I0401 16:41:44.372058 14749 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f4022cf548804d9fa764b8b6e861569c" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" is_pre_election: true I0401 16:41:44.372181 14749 raft_consensus.cc:2346] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 0. I0401 16:41:44.372476 14874 raft_consensus.cc:472] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.372553 14874 raft_consensus.cc:494] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.373148 14629 leader_election.cc:310] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.373216 14874 leader_election.cc:296] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.373348 14874 raft_consensus.cc:2640] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.373387 14874 raft_consensus.cc:472] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.373425 14874 raft_consensus.cc:2886] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.375165 14874 raft_consensus.cc:494] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.375582 14874 leader_election.cc:296] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 election: Requested vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.376121 14749 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "387632c6220140579a2af626e0d32b27" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" is_pre_election: true I0401 16:41:44.376294 14749 raft_consensus.cc:2307] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 0d05f40568e743aca4798bfc0dc47a8f for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:44.376263 14748 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f4022cf548804d9fa764b8b6e861569c" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" I0401 16:41:44.376376 14748 raft_consensus.cc:2886] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.377066 14820 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f4022cf548804d9fa764b8b6e861569c" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" is_pre_election: true I0401 16:41:44.377203 14820 raft_consensus.cc:2346] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 0. I0401 16:41:44.377192 14819 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "387632c6220140579a2af626e0d32b27" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" is_pre_election: true I0401 16:41:44.377420 14819 raft_consensus.cc:2276] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d05f40568e743aca4798bfc0dc47a8f in current term 1: Already voted for candidate fea15e44a97e4adda7ae903b7a1ee269 in this term. I0401 16:41:44.377645 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "f4022cf548804d9fa764b8b6e861569c" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" I0401 16:41:44.377764 14818 raft_consensus.cc:2886] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.377835 14628 leader_election.cc:310] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f; no voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269 I0401 16:41:44.378023 14874 raft_consensus.cc:2886] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.379271 14818 raft_consensus.cc:2346] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 1. I0401 16:41:44.379557 14628 leader_election.cc:310] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, 283c2ec6589f41e3ae8293860db57d2d; no voters: I0401 16:41:44.379582 14748 raft_consensus.cc:2346] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 1. I0401 16:41:44.379626 14874 raft_consensus.cc:2588] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:44.379770 14874 raft_consensus.cc:2640] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.380579 14874 raft_consensus.cc:667] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 1 LEADER]: Becoming Leader. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Running, Role: LEADER I0401 16:41:44.380887 14874 consensus_queue.cc:206] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.383934 14521 catalog_manager.cc:3977] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f reported cstate change: term changed from 0 to 1, leader changed from to 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1). New cstate: current_term: 1 leader_uuid: "0d05f40568e743aca4798bfc0dc47a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: UNKNOWN } } } I0401 16:41:44.440340 14874 raft_consensus.cc:472] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.440510 14874 raft_consensus.cc:494] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.441504 14874 leader_election.cc:296] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.441789 14748 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a0fbe7cbf8074d36affe7823f6e106e8" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" is_pre_election: true I0401 16:41:44.441859 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a0fbe7cbf8074d36affe7823f6e106e8" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" is_pre_election: true I0401 16:41:44.441977 14748 raft_consensus.cc:2346] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 0. I0401 16:41:44.441993 14818 raft_consensus.cc:2346] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 0. I0401 16:41:44.442243 14629 leader_election.cc:310] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.442437 14874 raft_consensus.cc:2640] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.442478 14874 raft_consensus.cc:472] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.442544 14874 raft_consensus.cc:2886] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.444483 14874 raft_consensus.cc:494] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.445066 14874 leader_election.cc:296] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 election: Requested vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.445335 14748 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a0fbe7cbf8074d36affe7823f6e106e8" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" I0401 16:41:44.445431 14748 raft_consensus.cc:2886] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.445410 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a0fbe7cbf8074d36affe7823f6e106e8" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" I0401 16:41:44.445506 14818 raft_consensus.cc:2886] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.447037 14748 raft_consensus.cc:2346] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 1. I0401 16:41:44.447299 14629 leader_election.cc:310] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.447367 14818 raft_consensus.cc:2346] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 1. I0401 16:41:44.447628 14874 raft_consensus.cc:2640] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.447746 14874 raft_consensus.cc:667] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 LEADER]: Becoming Leader. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Running, Role: LEADER I0401 16:41:44.448091 14874 consensus_queue.cc:206] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.450732 14521 catalog_manager.cc:3977] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f reported cstate change: term changed from 0 to 1, leader changed from to 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1). New cstate: current_term: 1 leader_uuid: "0d05f40568e743aca4798bfc0dc47a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: UNKNOWN } } } I0401 16:41:44.452841 14871 raft_consensus.cc:472] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.452940 14871 raft_consensus.cc:494] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.453547 14871 leader_election.cc:296] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.454176 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a1871f71f942419aa8e00e2299cdaf51" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" is_pre_election: true I0401 16:41:44.454321 14818 raft_consensus.cc:2346] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 0. I0401 16:41:44.454582 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a1871f71f942419aa8e00e2299cdaf51" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" is_pre_election: true I0401 16:41:44.454655 14699 leader_election.cc:310] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.454721 14666 raft_consensus.cc:2346] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 0. I0401 16:41:44.454869 14871 raft_consensus.cc:2640] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.454912 14871 raft_consensus.cc:472] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.454962 14871 raft_consensus.cc:2886] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.456900 14871 raft_consensus.cc:494] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.457550 14871 leader_election.cc:296] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Requested vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.457805 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a1871f71f942419aa8e00e2299cdaf51" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" I0401 16:41:44.457921 14666 raft_consensus.cc:2886] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.457948 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a1871f71f942419aa8e00e2299cdaf51" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" I0401 16:41:44.458045 14818 raft_consensus.cc:2886] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.459233 14666 raft_consensus.cc:2346] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 1. I0401 16:41:44.459400 14818 raft_consensus.cc:2346] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 1. I0401 16:41:44.459477 14698 leader_election.cc:310] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.459661 14871 raft_consensus.cc:2640] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.459738 14871 raft_consensus.cc:667] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Becoming Leader. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Running, Role: LEADER I0401 16:41:44.459962 14871 consensus_queue.cc:206] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.463140 14521 catalog_manager.cc:3977] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 reported cstate change: term changed from 0 to 1, leader changed from to fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "fea15e44a97e4adda7ae903b7a1ee269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: UNKNOWN } } } I0401 16:41:44.482983 14871 raft_consensus.cc:472] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.483098 14871 raft_consensus.cc:494] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.483786 14871 leader_election.cc:296] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.484225 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1198d0b3a3dd4b5e8b73d7f0db45b0c6" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" is_pre_election: true I0401 16:41:44.484395 14818 raft_consensus.cc:2346] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 0. I0401 16:41:44.484385 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1198d0b3a3dd4b5e8b73d7f0db45b0c6" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" is_pre_election: true I0401 16:41:44.484516 14666 raft_consensus.cc:2346] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 0. I0401 16:41:44.484659 14699 leader_election.cc:310] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.484882 14871 raft_consensus.cc:2640] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.484941 14871 raft_consensus.cc:472] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.484983 14871 raft_consensus.cc:2886] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.486670 14871 raft_consensus.cc:494] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.487154 14871 leader_election.cc:296] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Requested vote from peers 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.487470 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1198d0b3a3dd4b5e8b73d7f0db45b0c6" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" I0401 16:41:44.487488 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1198d0b3a3dd4b5e8b73d7f0db45b0c6" candidate_uuid: "fea15e44a97e4adda7ae903b7a1ee269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" I0401 16:41:44.487576 14666 raft_consensus.cc:2886] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.487588 14818 raft_consensus.cc:2886] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.489105 14666 raft_consensus.cc:2346] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 1. I0401 16:41:44.489338 14874 raft_consensus.cc:472] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.489363 14698 leader_election.cc:310] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.489405 14818 raft_consensus.cc:2346] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fea15e44a97e4adda7ae903b7a1ee269 in term 1. I0401 16:41:44.489684 14871 raft_consensus.cc:2640] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.489493 14874 raft_consensus.cc:494] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.490252 14871 raft_consensus.cc:667] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Becoming Leader. State: Replica: fea15e44a97e4adda7ae903b7a1ee269, State: Running, Role: LEADER I0401 16:41:44.490485 14871 consensus_queue.cc:206] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.491168 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "541db4e418a0469eb8411e03991af88a" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" is_pre_election: true I0401 16:41:44.491012 14748 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "541db4e418a0469eb8411e03991af88a" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" is_pre_election: true I0401 16:41:44.491304 14818 raft_consensus.cc:2346] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 0. I0401 16:41:44.491353 14748 raft_consensus.cc:2346] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 0. I0401 16:41:44.491037 14874 leader_election.cc:296] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.491619 14629 leader_election.cc:310] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.491832 14874 raft_consensus.cc:2640] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.491896 14874 raft_consensus.cc:472] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.491945 14874 raft_consensus.cc:2886] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.493587 14521 catalog_manager.cc:3977] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 reported cstate change: term changed from 0 to 1, leader changed from to fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "fea15e44a97e4adda7ae903b7a1ee269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: UNKNOWN } } } I0401 16:41:44.493932 14874 raft_consensus.cc:494] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.494494 14874 leader_election.cc:296] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 election: Requested vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3:37505) I0401 16:41:44.494771 14748 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "541db4e418a0469eb8411e03991af88a" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" I0401 16:41:44.494884 14748 raft_consensus.cc:2886] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.494941 14818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "541db4e418a0469eb8411e03991af88a" candidate_uuid: "0d05f40568e743aca4798bfc0dc47a8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "283c2ec6589f41e3ae8293860db57d2d" I0401 16:41:44.495100 14818 raft_consensus.cc:2886] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.496783 14748 raft_consensus.cc:2346] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 1. I0401 16:41:44.497066 14629 leader_election.cc:310] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d05f40568e743aca4798bfc0dc47a8f, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.497460 14818 raft_consensus.cc:2346] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d05f40568e743aca4798bfc0dc47a8f in term 1. I0401 16:41:44.498155 14874 raft_consensus.cc:2640] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.498961 14874 raft_consensus.cc:667] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 1 LEADER]: Becoming Leader. State: Replica: 0d05f40568e743aca4798bfc0dc47a8f, State: Running, Role: LEADER I0401 16:41:44.499338 14874 consensus_queue.cc:206] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.502568 14521 catalog_manager.cc:3977] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f reported cstate change: term changed from 0 to 1, leader changed from to 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1). New cstate: current_term: 1 leader_uuid: "0d05f40568e743aca4798bfc0dc47a8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: UNKNOWN } } } I0401 16:41:44.524495 14872 raft_consensus.cc:472] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:44.524617 14872 raft_consensus.cc:494] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.525336 14872 leader_election.cc:296] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369) I0401 16:41:44.525621 14748 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "45c9acddafbe4259a83368d1018f5f78" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" is_pre_election: true I0401 16:41:44.525760 14748 raft_consensus.cc:2346] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 0. I0401 16:41:44.525794 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "45c9acddafbe4259a83368d1018f5f78" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" is_pre_election: true I0401 16:41:44.525946 14666 raft_consensus.cc:2346] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 0. I0401 16:41:44.526243 14783 leader_election.cc:310] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.526578 14872 raft_consensus.cc:2640] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:44.526620 14872 raft_consensus.cc:472] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:44.526680 14872 raft_consensus.cc:2886] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.528327 14872 raft_consensus.cc:494] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.528928 14872 leader_election.cc:296] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 election: Requested vote from peers fea15e44a97e4adda7ae903b7a1ee269 (127.11.224.2:42396), 0d05f40568e743aca4798bfc0dc47a8f (127.11.224.1:56369) I0401 16:41:44.529235 14748 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "45c9acddafbe4259a83368d1018f5f78" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fea15e44a97e4adda7ae903b7a1ee269" I0401 16:41:44.529276 14666 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "45c9acddafbe4259a83368d1018f5f78" candidate_uuid: "283c2ec6589f41e3ae8293860db57d2d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d05f40568e743aca4798bfc0dc47a8f" I0401 16:41:44.529336 14748 raft_consensus.cc:2886] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.529407 14666 raft_consensus.cc:2886] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.531010 14666 raft_consensus.cc:2346] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 1. I0401 16:41:44.531025 14748 raft_consensus.cc:2346] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 283c2ec6589f41e3ae8293860db57d2d in term 1. I0401 16:41:44.531257 14783 leader_election.cc:310] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 283c2ec6589f41e3ae8293860db57d2d, fea15e44a97e4adda7ae903b7a1ee269; no voters: I0401 16:41:44.531442 14872 raft_consensus.cc:2640] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:44.531536 14872 raft_consensus.cc:667] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 1 LEADER]: Becoming Leader. State: Replica: 283c2ec6589f41e3ae8293860db57d2d, State: Running, Role: LEADER I0401 16:41:44.531749 14872 consensus_queue.cc:206] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } } I0401 16:41:44.533726 14523 catalog_manager.cc:3977] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d reported cstate change: term changed from 0 to 1, leader changed from to 283c2ec6589f41e3ae8293860db57d2d (127.11.224.3). New cstate: current_term: 1 leader_uuid: "283c2ec6589f41e3ae8293860db57d2d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 } health_report { overall_health: HEALTHY } } } I0401 16:41:44.554515 12160 ksck_remote-test.cc:319] Generating row writes... I0401 16:41:44.596148 14818 raft_consensus.cc:1181] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Refusing update from remote peer 0d05f40568e743aca4798bfc0dc47a8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.596678 14874 consensus_queue.cc:984] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.599095 14748 raft_consensus.cc:1181] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Refusing update from remote peer 0d05f40568e743aca4798bfc0dc47a8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.599908 14748 raft_consensus.cc:2886] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:44.600170 14874 consensus_queue.cc:984] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.603238 14819 raft_consensus.cc:1181] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Refusing update from remote peer 0d05f40568e743aca4798bfc0dc47a8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.603260 14666 raft_consensus.cc:1181] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Refusing update from remote peer 283c2ec6589f41e3ae8293860db57d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.603327 14665 raft_consensus.cc:1181] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Refusing update from remote peer 283c2ec6589f41e3ae8293860db57d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.603682 14874 consensus_queue.cc:984] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.604629 14872 consensus_queue.cc:984] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.604938 14748 raft_consensus.cc:1181] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Refusing update from remote peer 283c2ec6589f41e3ae8293860db57d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.609596 14872 consensus_queue.cc:984] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.610802 14748 raft_consensus.cc:1181] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Refusing update from remote peer 283c2ec6589f41e3ae8293860db57d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.611620 14872 consensus_queue.cc:984] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.612946 14872 consensus_queue.cc:984] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.613310 14747 raft_consensus.cc:1181] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Refusing update from remote peer 0d05f40568e743aca4798bfc0dc47a8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.614323 14820 raft_consensus.cc:1181] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Refusing update from remote peer 0d05f40568e743aca4798bfc0dc47a8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.614713 14874 consensus_queue.cc:984] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.615285 14664 raft_consensus.cc:1181] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Refusing update from remote peer 283c2ec6589f41e3ae8293860db57d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.613732 14869 consensus_queue.cc:984] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0401 16:41:44.617377 14745 raft_consensus.cc:1181] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Refusing update from remote peer 0d05f40568e743aca4798bfc0dc47a8f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.617445 14746 raft_consensus.cc:1181] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Refusing update from remote peer 283c2ec6589f41e3ae8293860db57d2d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.615917 14886 consensus_queue.cc:984] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s I0401 16:41:44.622053 14872 consensus_queue.cc:984] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.622335 14874 consensus_queue.cc:984] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "fea15e44a97e4adda7ae903b7a1ee269" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42396 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.670382 14817 raft_consensus.cc:1181] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Refusing update from remote peer fea15e44a97e4adda7ae903b7a1ee269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.672188 14871 consensus_queue.cc:984] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.683697 14663 raft_consensus.cc:1181] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Refusing update from remote peer fea15e44a97e4adda7ae903b7a1ee269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.684797 14816 raft_consensus.cc:1181] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Refusing update from remote peer fea15e44a97e4adda7ae903b7a1ee269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.686056 14885 consensus_queue.cc:984] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.688171 14885 consensus_queue.cc:984] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.699380 14666 raft_consensus.cc:1181] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Refusing update from remote peer fea15e44a97e4adda7ae903b7a1ee269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.699961 14871 consensus_queue.cc:984] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.706117 14815 raft_consensus.cc:1181] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Refusing update from remote peer fea15e44a97e4adda7ae903b7a1ee269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.708667 14871 consensus_queue.cc:984] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.724516 14661 raft_consensus.cc:1181] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Refusing update from remote peer fea15e44a97e4adda7ae903b7a1ee269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.725201 14871 consensus_queue.cc:984] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.730008 14814 raft_consensus.cc:1181] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Refusing update from remote peer fea15e44a97e4adda7ae903b7a1ee269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.730468 14871 consensus_queue.cc:984] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "283c2ec6589f41e3ae8293860db57d2d" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 37505 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.733433 14660 raft_consensus.cc:1181] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Refusing update from remote peer fea15e44a97e4adda7ae903b7a1ee269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:44.733930 14885 consensus_queue.cc:984] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d05f40568e743aca4798bfc0dc47a8f" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 56369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:44.796694 14621 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca: acquiring CA information for follower catalog manager: success I0401 16:41:44.824060 14619 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67: acquiring CA information for follower catalog manager: success I0401 16:41:44.836732 14621 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:44.845979 14619 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 W0401 16:41:44.847040 14698 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.224.1:56369, user_credentials={real_user=jenkins}} blocked reactor thread for 61892.9us W0401 16:41:44.851938 14781 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.224.1:56369, user_credentials={real_user=jenkins}} blocked reactor thread for 63292.5us I0401 16:41:44.885826 14944 mvcc.cc:203] Tried to move safe_time back from 6365847980443377664 to 6365847980034469888. Current Snapshot: MvccSnapshot[committed={T|T < 6365847980443377664}] I0401 16:41:45.110209 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:45.133610 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:45.133724 12160 tablet_replica.cc:264] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.133855 12160 raft_consensus.cc:2143] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.133987 12160 raft_consensus.cc:2170] T 387632c6220140579a2af626e0d32b27 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.135226 12160 tablet_replica.cc:264] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.135360 12160 raft_consensus.cc:2143] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.135582 12160 raft_consensus.cc:2170] T a1871f71f942419aa8e00e2299cdaf51 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.136451 12160 tablet_replica.cc:264] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.136541 12160 raft_consensus.cc:2143] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.136618 12160 raft_consensus.cc:2170] T 9635e9b10d42466d8a5a46be8762b3f0 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.137291 12160 tablet_replica.cc:264] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.137378 12160 raft_consensus.cc:2143] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.137464 12160 raft_consensus.cc:2170] T 45c9acddafbe4259a83368d1018f5f78 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.138515 12160 tablet_replica.cc:264] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.138650 12160 raft_consensus.cc:2143] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.139253 12160 raft_consensus.cc:2170] T f4022cf548804d9fa764b8b6e861569c P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.140139 12160 tablet_replica.cc:264] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.140229 12160 raft_consensus.cc:2143] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.140311 12160 raft_consensus.cc:2170] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.140986 12160 tablet_replica.cc:264] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.141083 12160 raft_consensus.cc:2143] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.141230 12160 raft_consensus.cc:2170] T a0fbe7cbf8074d36affe7823f6e106e8 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.141929 12160 tablet_replica.cc:264] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.142031 12160 raft_consensus.cc:2143] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.142117 12160 raft_consensus.cc:2170] T d85f21b57325444f83daa076c12958c6 P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.143234 12160 tablet_replica.cc:264] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.143317 12160 raft_consensus.cc:2143] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.143467 12160 raft_consensus.cc:2170] T 541db4e418a0469eb8411e03991af88a P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.144215 12160 tablet_replica.cc:264] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f: stopping tablet replica I0401 16:41:45.144299 12160 raft_consensus.cc:2143] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.144384 12160 raft_consensus.cc:2170] T bce6fca53cd74d1f8df1788e9c0e021e P 0d05f40568e743aca4798bfc0dc47a8f [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.164266 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:45.164351 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:45.164500 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:45.169894 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:45.193852 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:45.213735 12160 tablet_replica.cc:264] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.214108 12160 raft_consensus.cc:2143] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.214257 12160 raft_consensus.cc:2170] T 45c9acddafbe4259a83368d1018f5f78 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.215447 12160 tablet_replica.cc:264] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.215556 12160 raft_consensus.cc:2143] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.215636 12160 raft_consensus.cc:2170] T f4022cf548804d9fa764b8b6e861569c P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.216339 12160 tablet_replica.cc:264] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.216445 12160 raft_consensus.cc:2143] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.216537 12160 raft_consensus.cc:2170] T 9635e9b10d42466d8a5a46be8762b3f0 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.217239 12160 tablet_replica.cc:264] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.217344 12160 raft_consensus.cc:2143] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.217530 12160 raft_consensus.cc:2170] T a1871f71f942419aa8e00e2299cdaf51 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.218283 12160 tablet_replica.cc:264] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.218372 12160 raft_consensus.cc:2143] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.218521 12160 raft_consensus.cc:2170] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.219233 12160 tablet_replica.cc:264] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.219321 12160 raft_consensus.cc:2143] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.219398 12160 raft_consensus.cc:2170] T a0fbe7cbf8074d36affe7823f6e106e8 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.220638 12160 tablet_replica.cc:264] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.220763 12160 raft_consensus.cc:2143] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.220886 12160 raft_consensus.cc:2170] T d85f21b57325444f83daa076c12958c6 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.221993 12160 tablet_replica.cc:264] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.222304 12160 raft_consensus.cc:2143] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.222384 12160 raft_consensus.cc:2170] T 541db4e418a0469eb8411e03991af88a P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.223043 12160 tablet_replica.cc:264] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.223129 12160 raft_consensus.cc:2143] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.223289 12160 raft_consensus.cc:2170] T 387632c6220140579a2af626e0d32b27 P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.224005 12160 tablet_replica.cc:264] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269: stopping tablet replica I0401 16:41:45.224092 12160 raft_consensus.cc:2143] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.224238 12160 raft_consensus.cc:2170] T bce6fca53cd74d1f8df1788e9c0e021e P fea15e44a97e4adda7ae903b7a1ee269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.237175 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:45.237221 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:45.237352 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:45.241119 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:45.258509 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:45.258622 12160 tablet_replica.cc:264] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.258747 12160 raft_consensus.cc:2143] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.258989 12160 raft_consensus.cc:2170] T 45c9acddafbe4259a83368d1018f5f78 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.259882 12160 tablet_replica.cc:264] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.259981 12160 raft_consensus.cc:2143] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.260061 12160 raft_consensus.cc:2170] T f4022cf548804d9fa764b8b6e861569c P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.260838 12160 tablet_replica.cc:264] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.260948 12160 raft_consensus.cc:2143] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.261104 12160 raft_consensus.cc:2170] T 9635e9b10d42466d8a5a46be8762b3f0 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.261835 12160 tablet_replica.cc:264] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.261929 12160 raft_consensus.cc:2143] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.262020 12160 raft_consensus.cc:2170] T a1871f71f942419aa8e00e2299cdaf51 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.262778 12160 tablet_replica.cc:264] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.262895 12160 raft_consensus.cc:2143] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.262975 12160 raft_consensus.cc:2170] T a0fbe7cbf8074d36affe7823f6e106e8 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.263677 12160 tablet_replica.cc:264] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.263764 12160 raft_consensus.cc:2143] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.263859 12160 raft_consensus.cc:2170] T 1198d0b3a3dd4b5e8b73d7f0db45b0c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.264495 12160 tablet_replica.cc:264] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.264590 12160 raft_consensus.cc:2143] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.264700 12160 raft_consensus.cc:2170] T 387632c6220140579a2af626e0d32b27 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.265434 12160 tablet_replica.cc:264] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.265522 12160 raft_consensus.cc:2143] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.265599 12160 raft_consensus.cc:2170] T 541db4e418a0469eb8411e03991af88a P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.266291 12160 tablet_replica.cc:264] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.266374 12160 raft_consensus.cc:2143] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.266531 12160 raft_consensus.cc:2170] T d85f21b57325444f83daa076c12958c6 P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.267220 12160 tablet_replica.cc:264] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d: stopping tablet replica I0401 16:41:45.267302 12160 raft_consensus.cc:2143] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.267388 12160 raft_consensus.cc:2170] T bce6fca53cd74d1f8df1788e9c0e021e P 283c2ec6589f41e3ae8293860db57d2d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.285281 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:45.285336 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:45.285502 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:45.289448 12160 master.cc:270] Master@127.11.224.62:49328 shutting down... I0401 16:41:45.312667 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.312830 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.312925 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 6dd1566ed5614f3495f174d0c2cd95ca: stopping tablet replica I0401 16:41:45.327186 12160 master.cc:281] Master@127.11.224.62:49328 shutdown complete. I0401 16:41:45.329967 12160 master.cc:270] Master@127.11.224.61:50234 shutting down... I0401 16:41:45.343703 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:45.344017 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.344094 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P c95f2f61d77f4869a667c1d8210ed34c: stopping tablet replica I0401 16:41:45.358497 12160 master.cc:281] Master@127.11.224.61:50234 shutdown complete. I0401 16:41:45.361724 12160 master.cc:270] Master@127.11.224.60:37435 shutting down... I0401 16:41:45.374209 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:45.374338 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:45.374398 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 3554ae29f8ea452790970952916fbb67: stopping tablet replica I0401 16:41:45.397007 12160 master.cc:281] Master@127.11.224.60:37435 shutdown complete. [ OK ] RemoteKsckTest.TestChecksum (1901 ms) [ RUN ] RemoteKsckTest.TestChecksumTimeout I0401 16:41:45.424932 12160 test_util.cc:212] Using random seed: -1875403745 I0401 16:41:45.425495 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:46307,127.11.224.61:41024,127.11.224.60:45270 I0401 16:41:45.429049 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 842931us I0401 16:41:45.429209 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:45.429244 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:45.429342 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:45.429369 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:45.429832 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "eb648a2ef68b4313979717f88e363b20" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.434422 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.000s sys 0.004s I0401 16:41:45.435171 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:45.437283 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:45.437328 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-0-root uuid: "eb648a2ef68b4313979717f88e363b20" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.437404 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:45.471691 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:46307 I0401 16:41:45.472604 12160 webserver.cc:308] Webserver started at http://127.11.224.62:58524/ using document root and password file I0401 16:41:45.473830 15057 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.476652 15057 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:45.478149 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 842931us I0401 16:41:45.478348 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:45.478401 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:45.478508 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:45.478550 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:45.479063 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "17d307571a004ef88f4d3c1a723610be" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.483557 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s I0401 16:41:45.484571 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:45.485438 15057 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:45.486404 15057 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:41024: Network error: Client connection negotiation failed: client connection to 127.11.224.61:41024: connect: Connection refused (error 111) I0401 16:41:45.487308 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s I0401 16:41:45.487356 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-1-root uuid: "17d307571a004ef88f4d3c1a723610be" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.487437 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:45.551597 15057 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } attempt: 1 W0401 16:41:45.552570 15057 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:41024: Network error: Client connection negotiation failed: client connection to 127.11.224.61:41024: connect: Connection refused (error 111) I0401 16:41:45.556960 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:41024 I0401 16:41:45.557584 12160 webserver.cc:308] Webserver started at http://127.11.224.61:34270/ using document root and password file I0401 16:41:45.558531 15114 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.560302 15114 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:45.561589 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 842931us I0401 16:41:45.561727 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:45.561766 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:45.561941 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:45.561975 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:45.562466 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "866eb3aa863645639487aa432aefaa71" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.565404 15114 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:45.567134 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s I0401 16:41:45.568006 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:45.570230 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:45.570276 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-2-root uuid: "866eb3aa863645639487aa432aefaa71" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.570335 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:45.570564 15114 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:45.571220 15114 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:45270: Network error: Client connection negotiation failed: client connection to 127.11.224.60:45270: connect: Connection refused (error 111) I0401 16:41:45.601207 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:45270 I0401 16:41:45.601938 12160 webserver.cc:308] Webserver started at http://127.11.224.60:47370/ using document root and password file I0401 16:41:45.602249 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:45.602824 15171 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.604660 15171 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:45.608968 15171 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:45.612596 15171 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:45.618609 15171 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71: Bootstrap starting. I0401 16:41:45.619779 15171 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71: No blocks or log segments found. Creating new log. I0401 16:41:45.621423 15114 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } attempt: 1 I0401 16:41:45.621539 15171 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71: No bootstrap required, opened a new log I0401 16:41:45.622659 15171 raft_consensus.cc:340] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.622822 15171 raft_consensus.cc:366] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:45.622896 15171 raft_consensus.cc:705] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 866eb3aa863645639487aa432aefaa71, State: Initialized, Role: FOLLOWER I0401 16:41:45.623164 15171 consensus_queue.cc:229] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.623689 15171 sys_catalog.cc:337] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.623921 15171 sys_catalog.cc:340] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.623863 15175 sys_catalog.cc:337] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.624215 15175 sys_catalog.cc:340] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.624502 15171 sys_catalog.cc:424] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:45.627197 15114 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be: Bootstrap starting. I0401 16:41:45.628463 15114 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be: No blocks or log segments found. Creating new log. I0401 16:41:45.628784 15057 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } attempt: 2 W0401 16:41:45.629920 15176 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:45.629971 15176 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:45.630571 15114 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be: No bootstrap required, opened a new log I0401 16:41:45.632516 15114 raft_consensus.cc:340] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.632711 15114 raft_consensus.cc:366] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:45.632747 15114 raft_consensus.cc:705] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 17d307571a004ef88f4d3c1a723610be, State: Initialized, Role: FOLLOWER I0401 16:41:45.633113 15114 consensus_queue.cc:229] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.633200 15057 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:45.633625 15114 sys_catalog.cc:337] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.633854 15114 sys_catalog.cc:340] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.634011 15178 sys_catalog.cc:337] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.634219 15178 sys_catalog.cc:340] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.634411 15114 sys_catalog.cc:424] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: configured and running, proceeding with master startup. W0401 16:41:45.636134 15179 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:45.636178 15179 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:45.639084 15057 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20: Bootstrap starting. I0401 16:41:45.639972 15057 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20: No blocks or log segments found. Creating new log. I0401 16:41:45.641163 15057 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20: No bootstrap required, opened a new log I0401 16:41:45.641623 15057 raft_consensus.cc:340] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.641741 15057 raft_consensus.cc:366] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:45.641762 15057 raft_consensus.cc:705] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb648a2ef68b4313979717f88e363b20, State: Initialized, Role: FOLLOWER I0401 16:41:45.641878 15057 consensus_queue.cc:229] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.642240 15057 sys_catalog.cc:337] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.642355 15057 sys_catalog.cc:340] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.642292 15181 sys_catalog.cc:337] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.642478 15181 sys_catalog.cc:340] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.642650 15057 sys_catalog.cc:424] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:45.642953 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:41:45.642982 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:45.643733 15182 catalog_manager.cc:1113] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:45.643775 15182 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:45.647166 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 842931us I0401 16:41:45.647294 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:45.647322 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:45.647379 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:45.647403 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:45.647755 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "9989560c1599415ab25ad0d9a55163bc" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.651360 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s I0401 16:41:45.651998 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:45.654176 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:45.654215 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-0-root uuid: "9989560c1599415ab25ad0d9a55163bc" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.654275 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:45.682811 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:45.682857 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:45.696164 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:34448 I0401 16:41:45.696875 12160 webserver.cc:308] Webserver started at http://127.11.224.1:47379/ using document root and password file I0401 16:41:45.709678 15247 heartbeater.cc:345] Connected to a master server at 127.11.224.60:45270 I0401 16:41:45.709782 15247 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.710037 15247 heartbeater.cc:475] Master 127.11.224.60:45270 requested a full tablet report, sending... I0401 16:41:45.710405 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 842931us I0401 16:41:45.711112 15138 ts_manager.cc:159] Registered new tserver with Master: 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448) I0401 16:41:45.711578 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:45.711621 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:45.711741 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:45.711767 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:45.712425 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.712723 15248 heartbeater.cc:345] Connected to a master server at 127.11.224.61:41024 I0401 16:41:45.712787 15248 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.713034 15248 heartbeater.cc:475] Master 127.11.224.61:41024 requested a full tablet report, sending... I0401 16:41:45.713241 15249 heartbeater.cc:345] Connected to a master server at 127.11.224.62:46307 I0401 16:41:45.713306 15249 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.713449 15249 heartbeater.cc:475] Master 127.11.224.62:46307 requested a full tablet report, sending... I0401 16:41:45.714385 15024 ts_manager.cc:159] Registered new tserver with Master: 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448) I0401 16:41:45.714391 15081 ts_manager.cc:159] Registered new tserver with Master: 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448) I0401 16:41:45.717155 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s I0401 16:41:45.717907 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:45.720399 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:45.720449 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-1-root uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.720538 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:45.746923 15175 raft_consensus.cc:472] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:45.747097 15175 raft_consensus.cc:494] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.747313 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:45.747342 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:45.747987 15175 leader_election.cc:296] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb648a2ef68b4313979717f88e363b20 (127.11.224.62:46307), 17d307571a004ef88f4d3c1a723610be (127.11.224.61:41024) I0401 16:41:45.748533 15091 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "866eb3aa863645639487aa432aefaa71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d307571a004ef88f4d3c1a723610be" is_pre_election: true I0401 16:41:45.748690 15091 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 866eb3aa863645639487aa432aefaa71 in term 0. I0401 16:41:45.748824 15034 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "866eb3aa863645639487aa432aefaa71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb648a2ef68b4313979717f88e363b20" is_pre_election: true I0401 16:41:45.748950 15034 raft_consensus.cc:2346] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 866eb3aa863645639487aa432aefaa71 in term 0. I0401 16:41:45.749229 15121 leader_election.cc:310] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d307571a004ef88f4d3c1a723610be, 866eb3aa863645639487aa432aefaa71; no voters: I0401 16:41:45.749462 15175 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:45.749516 15175 raft_consensus.cc:472] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:45.749568 15175 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:45.751541 15175 raft_consensus.cc:494] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.752132 15175 leader_election.cc:296] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [CANDIDATE]: Term 1 election: Requested vote from peers eb648a2ef68b4313979717f88e363b20 (127.11.224.62:46307), 17d307571a004ef88f4d3c1a723610be (127.11.224.61:41024) I0401 16:41:45.752478 15091 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "866eb3aa863645639487aa432aefaa71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "17d307571a004ef88f4d3c1a723610be" I0401 16:41:45.752604 15091 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:45.752683 15034 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "866eb3aa863645639487aa432aefaa71" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb648a2ef68b4313979717f88e363b20" I0401 16:41:45.752771 15034 raft_consensus.cc:2886] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:45.754777 15091 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 866eb3aa863645639487aa432aefaa71 in term 1. I0401 16:41:45.755038 15121 leader_election.cc:310] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 17d307571a004ef88f4d3c1a723610be, 866eb3aa863645639487aa432aefaa71; no voters: I0401 16:41:45.755170 15034 raft_consensus.cc:2346] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 866eb3aa863645639487aa432aefaa71 in term 1. I0401 16:41:45.755226 15175 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:45.756070 15175 raft_consensus.cc:667] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 1 LEADER]: Becoming Leader. State: Replica: 866eb3aa863645639487aa432aefaa71, State: Running, Role: LEADER I0401 16:41:45.756253 15175 consensus_queue.cc:206] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } I0401 16:41:45.757984 15275 sys_catalog.cc:337] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 866eb3aa863645639487aa432aefaa71. Latest consensus state: current_term: 1 leader_uuid: "866eb3aa863645639487aa432aefaa71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.758191 15275 sys_catalog.cc:340] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: This master's current role is: LEADER I0401 16:41:45.760977 15280 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:45.764387 15280 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:45.779171 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:55666 I0401 16:41:45.780215 12160 webserver.cc:308] Webserver started at http://127.11.224.2:44081/ using document root and password file I0401 16:41:45.790261 15321 heartbeater.cc:345] Connected to a master server at 127.11.224.60:45270 I0401 16:41:45.790343 15321 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.791568 15321 heartbeater.cc:475] Master 127.11.224.60:45270 requested a full tablet report, sending... I0401 16:41:45.792486 15138 ts_manager.cc:159] Registered new tserver with Master: 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:45.801168 15322 heartbeater.cc:345] Connected to a master server at 127.11.224.61:41024 I0401 16:41:45.801265 15322 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.801475 15322 heartbeater.cc:475] Master 127.11.224.61:41024 requested a full tablet report, sending... I0401 16:41:45.802613 15081 ts_manager.cc:159] Registered new tserver with Master: 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:45.802605 15091 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 1 FOLLOWER]: Refusing update from remote peer 866eb3aa863645639487aa432aefaa71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:45.802983 15034 raft_consensus.cc:1181] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 1 FOLLOWER]: Refusing update from remote peer 866eb3aa863645639487aa432aefaa71: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:45.803290 15275 consensus_queue.cc:984] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:45.803445 15175 consensus_queue.cc:984] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:45.807736 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 842931us I0401 16:41:45.808109 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:45.808234 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:45.808367 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:45.808583 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:45.808900 15324 heartbeater.cc:345] Connected to a master server at 127.11.224.62:46307 I0401 16:41:45.808962 15324 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.809235 15324 heartbeater.cc:475] Master 127.11.224.62:46307 requested a full tablet report, sending... I0401 16:41:45.809373 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.811761 15178 sys_catalog.cc:337] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 866eb3aa863645639487aa432aefaa71. Latest consensus state: current_term: 1 leader_uuid: "866eb3aa863645639487aa432aefaa71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.811995 15178 sys_catalog.cc:340] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.814182 15175 sys_catalog.cc:337] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "866eb3aa863645639487aa432aefaa71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.814381 15175 sys_catalog.cc:340] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: This master's current role is: LEADER I0401 16:41:45.815547 15280 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:45.816937 15178 sys_catalog.cc:337] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "866eb3aa863645639487aa432aefaa71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.817111 15178 sys_catalog.cc:340] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.817390 15280 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:45.825644 15023 ts_manager.cc:159] Registered new tserver with Master: 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:45.826053 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.016s user 0.002s sys 0.003s I0401 16:41:45.826181 15181 sys_catalog.cc:337] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 866eb3aa863645639487aa432aefaa71. Latest consensus state: current_term: 1 leader_uuid: "866eb3aa863645639487aa432aefaa71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.826452 15181 sys_catalog.cc:340] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.827445 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:45.827919 15175 sys_catalog.cc:337] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "866eb3aa863645639487aa432aefaa71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.828081 15175 sys_catalog.cc:340] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [sys.catalog]: This master's current role is: LEADER I0401 16:41:45.832506 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:45.832607 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-2-root uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" format_stamp: "Formatted at 2019-04-01 23:41:45 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:45.832723 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumTimeout.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:45.833572 15280 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71: Generated new TSK 0 I0401 16:41:45.834564 15181 sys_catalog.cc:337] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "866eb3aa863645639487aa432aefaa71" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb648a2ef68b4313979717f88e363b20" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 46307 } } peers { permanent_uuid: "17d307571a004ef88f4d3c1a723610be" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 41024 } } peers { permanent_uuid: "866eb3aa863645639487aa432aefaa71" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 45270 } } } I0401 16:41:45.834738 15181 sys_catalog.cc:340] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:45.839236 15138 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:35346 I0401 16:41:45.841857 15138 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:35349 I0401 16:41:45.850983 15247 heartbeater.cc:467] Master 127.11.224.60:45270 was elected leader, sending a full tablet report... I0401 16:41:45.853113 15321 heartbeater.cc:467] Master 127.11.224.60:45270 was elected leader, sending a full tablet report... I0401 16:41:45.869406 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:45.869457 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:45.893697 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:50415 I0401 16:41:45.894914 12160 webserver.cc:308] Webserver started at http://127.11.224.3:58939/ using document root and password file I0401 16:41:45.908207 15399 heartbeater.cc:345] Connected to a master server at 127.11.224.60:45270 I0401 16:41:45.908311 15399 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.908668 15399 heartbeater.cc:475] Master 127.11.224.60:45270 requested a full tablet report, sending... I0401 16:41:45.909590 15137 ts_manager.cc:159] Registered new tserver with Master: 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:45.911221 15137 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:35352 I0401 16:41:45.912037 15400 heartbeater.cc:345] Connected to a master server at 127.11.224.61:41024 I0401 16:41:45.912106 15400 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.912406 15400 heartbeater.cc:475] Master 127.11.224.61:41024 requested a full tablet report, sending... I0401 16:41:45.913194 15081 ts_manager.cc:159] Registered new tserver with Master: 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:45.913566 15401 heartbeater.cc:345] Connected to a master server at 127.11.224.62:46307 I0401 16:41:45.913630 15401 heartbeater.cc:426] Registering TS with master... I0401 16:41:45.913796 15401 heartbeater.cc:475] Master 127.11.224.62:46307 requested a full tablet report, sending... I0401 16:41:45.914553 15024 ts_manager.cc:159] Registered new tserver with Master: 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:45.915441 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.011313979s I0401 16:41:45.923504 15399 heartbeater.cc:467] Master 127.11.224.60:45270 was elected leader, sending a full tablet report... I0401 16:41:45.933679 15137 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.60:35357: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:45.934451 15137 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:45.965477 15214 tablet_service.cc:1006] Processing CreateTablet for tablet 64714e1653ba47a0823ad950e06f658a (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:45.966183 15212 tablet_service.cc:1006] Processing CreateTablet for tablet 8dec592d52774f3b84d581cbf80c0139 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:45.966246 15211 tablet_service.cc:1006] Processing CreateTablet for tablet 4c188a2569664da38e94e98cf7c60325 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:45.966313 15213 tablet_service.cc:1006] Processing CreateTablet for tablet 4e3f5387e6e342eab8254c100662c241 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:45.966404 15214 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 64714e1653ba47a0823ad950e06f658a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.966722 15212 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8dec592d52774f3b84d581cbf80c0139. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.966991 15213 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4e3f5387e6e342eab8254c100662c241. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.967700 15211 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4c188a2569664da38e94e98cf7c60325. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.971369 15210 tablet_service.cc:1006] Processing CreateTablet for tablet 54573e3062224e96b91a66dc9df3a535 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:45.971957 15210 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 54573e3062224e96b91a66dc9df3a535. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.973697 15209 tablet_service.cc:1006] Processing CreateTablet for tablet b9d400ec7b0e41a3b952da5c6ca820a3 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:45.974143 15209 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b9d400ec7b0e41a3b952da5c6ca820a3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.974304 15208 tablet_service.cc:1006] Processing CreateTablet for tablet 1831857df7324b18964447ca50f9568e (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:45.974345 15207 tablet_service.cc:1006] Processing CreateTablet for tablet 408d8036689747bf8e4bf31380916ae8 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:45.974683 15208 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1831857df7324b18964447ca50f9568e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.974732 15205 tablet_service.cc:1006] Processing CreateTablet for tablet 40cc2afeb94246a4965b95e72b1bdf1d (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:45.975137 15205 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 40cc2afeb94246a4965b95e72b1bdf1d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.977286 15206 tablet_service.cc:1006] Processing CreateTablet for tablet b5385787b2244d03853e1c7fe8ab2380 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:45.977692 15206 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b5385787b2244d03853e1c7fe8ab2380. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.978554 15207 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 408d8036689747bf8e4bf31380916ae8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.979315 15366 tablet_service.cc:1006] Processing CreateTablet for tablet 64714e1653ba47a0823ad950e06f658a (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:45.979744 15366 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 64714e1653ba47a0823ad950e06f658a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.989742 15419 tablet_bootstrap.cc:439] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:45.990468 15365 tablet_service.cc:1006] Processing CreateTablet for tablet 4e3f5387e6e342eab8254c100662c241 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:45.991672 15362 tablet_service.cc:1006] Processing CreateTablet for tablet 54573e3062224e96b91a66dc9df3a535 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:45.991255 15364 tablet_service.cc:1006] Processing CreateTablet for tablet 8dec592d52774f3b84d581cbf80c0139 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:45.991981 15365 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4e3f5387e6e342eab8254c100662c241. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.991609 15361 tablet_service.cc:1006] Processing CreateTablet for tablet b9d400ec7b0e41a3b952da5c6ca820a3 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:45.991534 15363 tablet_service.cc:1006] Processing CreateTablet for tablet 4c188a2569664da38e94e98cf7c60325 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:45.992173 15364 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8dec592d52774f3b84d581cbf80c0139. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.992365 15361 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b9d400ec7b0e41a3b952da5c6ca820a3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.989742 15420 tablet_bootstrap.cc:439] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:45.996052 15363 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4c188a2569664da38e94e98cf7c60325. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:45.999358 15420 tablet_bootstrap.cc:590] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:45.999613 15419 tablet_bootstrap.cc:590] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.000581 15362 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 54573e3062224e96b91a66dc9df3a535. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.002904 15360 tablet_service.cc:1006] Processing CreateTablet for tablet 40cc2afeb94246a4965b95e72b1bdf1d (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:46.003479 15360 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 40cc2afeb94246a4965b95e72b1bdf1d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.002904 15366 tablet_service.cc:1006] Processing CreateTablet for tablet b5385787b2244d03853e1c7fe8ab2380 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:46.003926 15366 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b5385787b2244d03853e1c7fe8ab2380. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.003916 15365 tablet_service.cc:1006] Processing CreateTablet for tablet 408d8036689747bf8e4bf31380916ae8 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:46.004196 15365 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 408d8036689747bf8e4bf31380916ae8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.005290 15363 tablet_service.cc:1006] Processing CreateTablet for tablet 1831857df7324b18964447ca50f9568e (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:46.005579 15363 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1831857df7324b18964447ca50f9568e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.012048 15288 tablet_service.cc:1006] Processing CreateTablet for tablet 64714e1653ba47a0823ad950e06f658a (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:46.013095 15288 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 64714e1653ba47a0823ad950e06f658a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.013037 15281 tablet_service.cc:1006] Processing CreateTablet for tablet 408d8036689747bf8e4bf31380916ae8 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:46.013156 15284 tablet_service.cc:1006] Processing CreateTablet for tablet 54573e3062224e96b91a66dc9df3a535 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:46.013171 15279 tablet_service.cc:1006] Processing CreateTablet for tablet b5385787b2244d03853e1c7fe8ab2380 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:46.013677 15282 tablet_service.cc:1006] Processing CreateTablet for tablet 1831857df7324b18964447ca50f9568e (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:46.013736 15286 tablet_service.cc:1006] Processing CreateTablet for tablet 8dec592d52774f3b84d581cbf80c0139 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:46.014227 15283 tablet_service.cc:1006] Processing CreateTablet for tablet b9d400ec7b0e41a3b952da5c6ca820a3 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:46.014710 15281 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 408d8036689747bf8e4bf31380916ae8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.014966 15279 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b5385787b2244d03853e1c7fe8ab2380. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.015169 15284 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 54573e3062224e96b91a66dc9df3a535. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.016134 15287 tablet_service.cc:1006] Processing CreateTablet for tablet 4e3f5387e6e342eab8254c100662c241 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:46.016487 15287 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4e3f5387e6e342eab8254c100662c241. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.018108 15285 tablet_service.cc:1006] Processing CreateTablet for tablet 4c188a2569664da38e94e98cf7c60325 (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:46.018497 15285 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4c188a2569664da38e94e98cf7c60325. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.018748 15286 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8dec592d52774f3b84d581cbf80c0139. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.018990 15283 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b9d400ec7b0e41a3b952da5c6ca820a3. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.020579 15277 tablet_service.cc:1006] Processing CreateTablet for tablet 40cc2afeb94246a4965b95e72b1bdf1d (table=ksck-test-table [id=4ca86f7bafe04e81aa8b4bc94d1c0d0f]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:46.021019 15277 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 40cc2afeb94246a4965b95e72b1bdf1d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.023658 15282 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1831857df7324b18964447ca50f9568e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:46.034210 15423 tablet_bootstrap.cc:439] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.034879 15420 tablet_bootstrap.cc:439] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.034997 15420 ts_tablet_manager.cc:1053] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.045s user 0.002s sys 0.004s I0401 16:41:46.035167 15419 tablet_bootstrap.cc:439] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.035277 15419 ts_tablet_manager.cc:1053] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.046s user 0.001s sys 0.002s I0401 16:41:46.035642 15420 raft_consensus.cc:340] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.035841 15420 raft_consensus.cc:366] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.035874 15420 raft_consensus.cc:705] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.035957 15419 raft_consensus.cc:340] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.036128 15419 raft_consensus.cc:366] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.036046 15420 consensus_queue.cc:229] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.036222 15423 tablet_bootstrap.cc:590] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.036204 15419 raft_consensus.cc:705] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.036449 15419 consensus_queue.cc:229] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.037189 15420 ts_tablet_manager.cc:1081] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:46.037389 15420 tablet_bootstrap.cc:439] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.046190 15419 ts_tablet_manager.cc:1081] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.011s user 0.002s sys 0.004s I0401 16:41:46.046591 15419 tablet_bootstrap.cc:439] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.047158 15420 tablet_bootstrap.cc:590] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.047423 15423 tablet_bootstrap.cc:439] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.047554 15423 ts_tablet_manager.cc:1053] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.002s I0401 16:41:46.048243 15419 tablet_bootstrap.cc:590] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.048374 15423 raft_consensus.cc:340] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.048595 15423 raft_consensus.cc:366] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.048667 15423 raft_consensus.cc:705] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.048962 15423 consensus_queue.cc:229] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.049278 15420 tablet_bootstrap.cc:439] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.049386 15420 ts_tablet_manager.cc:1053] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s I0401 16:41:46.049988 15423 ts_tablet_manager.cc:1081] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:46.050086 15419 tablet_bootstrap.cc:439] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.050262 15419 ts_tablet_manager.cc:1053] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0401 16:41:46.050460 15423 tablet_bootstrap.cc:439] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.050238 15420 raft_consensus.cc:340] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.051054 15420 raft_consensus.cc:366] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.051117 15420 raft_consensus.cc:705] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.050921 15419 raft_consensus.cc:340] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.051198 15419 raft_consensus.cc:366] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.051230 15419 raft_consensus.cc:705] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.051373 15419 consensus_queue.cc:229] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.051856 15419 ts_tablet_manager.cc:1081] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:46.052052 15419 tablet_bootstrap.cc:439] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.052621 15423 tablet_bootstrap.cc:590] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.053231 15419 tablet_bootstrap.cc:590] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.054622 15420 consensus_queue.cc:229] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.055935 15420 ts_tablet_manager.cc:1081] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s I0401 16:41:46.057023 15420 tablet_bootstrap.cc:439] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.059151 15420 tablet_bootstrap.cc:590] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.061105 15419 tablet_bootstrap.cc:439] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.061103 15423 tablet_bootstrap.cc:439] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.061213 15419 ts_tablet_manager.cc:1053] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s I0401 16:41:46.061226 15423 ts_tablet_manager.cc:1053] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.001s I0401 16:41:46.061786 15419 raft_consensus.cc:340] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.061810 15423 raft_consensus.cc:340] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.061941 15419 raft_consensus.cc:366] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.061956 15423 raft_consensus.cc:366] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.061980 15419 raft_consensus.cc:705] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.061985 15423 raft_consensus.cc:705] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.062129 15419 consensus_queue.cc:229] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.062145 15423 consensus_queue.cc:229] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.062566 15423 ts_tablet_manager.cc:1081] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:46.062568 15419 ts_tablet_manager.cc:1081] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:46.062855 15419 tablet_bootstrap.cc:439] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.064247 15419 tablet_bootstrap.cc:590] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.064637 15420 tablet_bootstrap.cc:439] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.064710 15420 ts_tablet_manager.cc:1053] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.000s I0401 16:41:46.065497 15423 tablet_bootstrap.cc:439] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.066227 15420 raft_consensus.cc:340] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.066437 15420 raft_consensus.cc:366] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.066589 15420 raft_consensus.cc:705] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.067545 15420 consensus_queue.cc:229] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.068315 15423 tablet_bootstrap.cc:590] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.070652 15420 ts_tablet_manager.cc:1081] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.006s user 0.001s sys 0.000s I0401 16:41:46.071574 15420 tablet_bootstrap.cc:439] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.073086 15420 tablet_bootstrap.cc:590] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.075278 15420 tablet_bootstrap.cc:439] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.075402 15420 ts_tablet_manager.cc:1053] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s I0401 16:41:46.076006 15423 tablet_bootstrap.cc:439] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.076114 15423 ts_tablet_manager.cc:1053] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.005s I0401 16:41:46.076236 15419 tablet_bootstrap.cc:439] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.076335 15419 ts_tablet_manager.cc:1053] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.014s user 0.002s sys 0.007s I0401 16:41:46.076442 15420 raft_consensus.cc:340] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.076953 15423 raft_consensus.cc:340] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.077071 15420 raft_consensus.cc:366] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.076951 15419 raft_consensus.cc:340] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.077317 15420 raft_consensus.cc:705] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.077363 15419 raft_consensus.cc:366] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.077406 15419 raft_consensus.cc:705] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.077612 15419 consensus_queue.cc:229] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.078271 15420 consensus_queue.cc:229] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.077113 15423 raft_consensus.cc:366] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.078938 15423 raft_consensus.cc:705] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.079114 15423 consensus_queue.cc:229] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.079722 15423 ts_tablet_manager.cc:1081] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:46.079998 15423 tablet_bootstrap.cc:439] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.083287 15420 ts_tablet_manager.cc:1081] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.008s user 0.001s sys 0.001s I0401 16:41:46.083526 15420 tablet_bootstrap.cc:439] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.083794 15419 ts_tablet_manager.cc:1081] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s I0401 16:41:46.084014 15419 tablet_bootstrap.cc:439] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.084950 15420 tablet_bootstrap.cc:590] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.085389 15419 tablet_bootstrap.cc:590] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.083539 15423 tablet_bootstrap.cc:590] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.087973 15420 tablet_bootstrap.cc:439] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.088016 15419 tablet_bootstrap.cc:439] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.088080 15420 ts_tablet_manager.cc:1053] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s I0401 16:41:46.088114 15419 ts_tablet_manager.cc:1053] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s I0401 16:41:46.088706 15420 raft_consensus.cc:340] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.088855 15420 raft_consensus.cc:366] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.088747 15419 raft_consensus.cc:340] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.088893 15420 raft_consensus.cc:705] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.088927 15419 raft_consensus.cc:366] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.088955 15423 tablet_bootstrap.cc:439] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.088963 15419 raft_consensus.cc:705] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.089046 15423 ts_tablet_manager.cc:1053] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s I0401 16:41:46.089045 15420 consensus_queue.cc:229] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.089092 15419 consensus_queue.cc:229] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.089553 15419 ts_tablet_manager.cc:1081] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:46.089746 15419 tablet_bootstrap.cc:439] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.091064 15419 tablet_bootstrap.cc:590] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.091074 15423 raft_consensus.cc:340] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.092821 15420 ts_tablet_manager.cc:1081] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:46.093915 15420 tablet_bootstrap.cc:439] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.094264 15423 raft_consensus.cc:366] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.094352 15423 raft_consensus.cc:705] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.094538 15423 consensus_queue.cc:229] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.095345 15420 tablet_bootstrap.cc:590] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.096029 15419 tablet_bootstrap.cc:439] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.096356 15423 ts_tablet_manager.cc:1081] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s I0401 16:41:46.096155 15419 ts_tablet_manager.cc:1053] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.002s I0401 16:41:46.097508 15423 tablet_bootstrap.cc:439] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.098513 15419 raft_consensus.cc:340] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.098918 15419 raft_consensus.cc:366] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.098979 15419 raft_consensus.cc:705] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.099066 15423 tablet_bootstrap.cc:590] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.099187 15419 consensus_queue.cc:229] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.100224 15419 ts_tablet_manager.cc:1081] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0401 16:41:46.100455 15419 tablet_bootstrap.cc:439] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.104816 15419 tablet_bootstrap.cc:590] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.106470 15420 tablet_bootstrap.cc:439] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.106559 15420 ts_tablet_manager.cc:1053] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.008s I0401 16:41:46.107095 15420 raft_consensus.cc:340] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.107208 15420 raft_consensus.cc:366] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.107237 15420 raft_consensus.cc:705] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.107374 15420 consensus_queue.cc:229] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.107892 15420 ts_tablet_manager.cc:1081] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:46.108105 15420 tablet_bootstrap.cc:439] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.109527 15420 tablet_bootstrap.cc:590] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.110184 15423 tablet_bootstrap.cc:439] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.110296 15423 ts_tablet_manager.cc:1053] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.005s I0401 16:41:46.111209 15419 tablet_bootstrap.cc:439] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.111115 15423 raft_consensus.cc:340] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.111342 15419 ts_tablet_manager.cc:1053] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s I0401 16:41:46.111357 15423 raft_consensus.cc:366] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.111469 15423 raft_consensus.cc:705] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.111657 15423 consensus_queue.cc:229] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.112658 15419 raft_consensus.cc:340] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.112862 15419 raft_consensus.cc:366] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.112922 15419 raft_consensus.cc:705] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.113112 15419 consensus_queue.cc:229] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.113924 15423 ts_tablet_manager.cc:1081] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s I0401 16:41:46.114300 15419 ts_tablet_manager.cc:1081] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:46.115195 15419 tablet_bootstrap.cc:439] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.115660 15423 tablet_bootstrap.cc:439] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.117329 15419 tablet_bootstrap.cc:590] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.117333 15423 tablet_bootstrap.cc:590] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.118193 15420 tablet_bootstrap.cc:439] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.118275 15420 ts_tablet_manager.cc:1053] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.001s I0401 16:41:46.119315 15420 raft_consensus.cc:340] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.119495 15420 raft_consensus.cc:366] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.119539 15420 raft_consensus.cc:705] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.119727 15420 consensus_queue.cc:229] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.120254 15419 tablet_bootstrap.cc:439] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.120342 15419 ts_tablet_manager.cc:1053] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.002s I0401 16:41:46.120864 15420 ts_tablet_manager.cc:1081] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:46.121068 15419 raft_consensus.cc:340] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.121258 15419 raft_consensus.cc:366] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.121330 15419 raft_consensus.cc:705] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.121281 15420 tablet_bootstrap.cc:439] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.121549 15419 consensus_queue.cc:229] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.122180 15419 ts_tablet_manager.cc:1081] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:41:46.122735 15419 tablet_bootstrap.cc:439] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.124069 15423 tablet_bootstrap.cc:439] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.124215 15419 tablet_bootstrap.cc:590] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.124295 15423 ts_tablet_manager.cc:1053] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s I0401 16:41:46.126199 15419 tablet_bootstrap.cc:439] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.126299 15419 ts_tablet_manager.cc:1053] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0401 16:41:46.125815 15423 raft_consensus.cc:340] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.126425 15423 raft_consensus.cc:366] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.126472 15423 raft_consensus.cc:705] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.126642 15423 consensus_queue.cc:229] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.127710 15419 raft_consensus.cc:340] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.128036 15419 raft_consensus.cc:366] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.128103 15419 raft_consensus.cc:705] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.128437 15420 tablet_bootstrap.cc:590] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.128417 15419 consensus_queue.cc:229] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.129565 15419 ts_tablet_manager.cc:1081] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s I0401 16:41:46.130383 15419 tablet_bootstrap.cc:439] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc: Bootstrap starting. I0401 16:41:46.131220 15423 ts_tablet_manager.cc:1081] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s I0401 16:41:46.132104 15423 tablet_bootstrap.cc:439] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.132351 15419 tablet_bootstrap.cc:590] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc: No blocks or log segments found. Creating new log. I0401 16:41:46.133643 15423 tablet_bootstrap.cc:590] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.135185 15420 tablet_bootstrap.cc:439] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.135262 15419 tablet_bootstrap.cc:439] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc: No bootstrap required, opened a new log I0401 16:41:46.135411 15419 ts_tablet_manager.cc:1053] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.003s I0401 16:41:46.135453 15420 ts_tablet_manager.cc:1053] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.000s I0401 16:41:46.136189 15420 raft_consensus.cc:340] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.136307 15419 raft_consensus.cc:340] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.136428 15420 raft_consensus.cc:366] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.136433 15419 raft_consensus.cc:366] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.136500 15420 raft_consensus.cc:705] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.136515 15419 raft_consensus.cc:705] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Initialized, Role: FOLLOWER I0401 16:41:46.136677 15423 tablet_bootstrap.cc:439] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.136776 15423 ts_tablet_manager.cc:1053] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:46.136701 15419 consensus_queue.cc:229] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.136703 15420 consensus_queue.cc:229] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.137987 15419 ts_tablet_manager.cc:1081] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:46.139375 15420 ts_tablet_manager.cc:1081] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:46.139596 15420 tablet_bootstrap.cc:439] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.139923 15423 raft_consensus.cc:340] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.140267 15423 raft_consensus.cc:366] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.140461 15423 raft_consensus.cc:705] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.140671 15423 consensus_queue.cc:229] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.141790 15423 ts_tablet_manager.cc:1081] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:46.142045 15423 tablet_bootstrap.cc:439] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.144148 15420 tablet_bootstrap.cc:590] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.144243 15423 tablet_bootstrap.cc:590] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.146107 15420 tablet_bootstrap.cc:439] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.146107 15423 tablet_bootstrap.cc:439] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.146271 15423 ts_tablet_manager.cc:1053] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s I0401 16:41:46.146271 15420 ts_tablet_manager.cc:1053] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s I0401 16:41:46.147087 15423 raft_consensus.cc:340] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.147289 15423 raft_consensus.cc:366] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.147087 15420 raft_consensus.cc:340] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.147351 15423 raft_consensus.cc:705] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.147411 15420 raft_consensus.cc:366] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.147505 15420 raft_consensus.cc:705] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.147609 15423 consensus_queue.cc:229] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.147671 15420 consensus_queue.cc:229] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.148777 15423 ts_tablet_manager.cc:1081] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s I0401 16:41:46.149060 15423 tablet_bootstrap.cc:439] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.150041 15420 ts_tablet_manager.cc:1081] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0401 16:41:46.150861 15423 tablet_bootstrap.cc:590] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.153157 15420 tablet_bootstrap.cc:439] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be: Bootstrap starting. I0401 16:41:46.153720 15424 raft_consensus.cc:472] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.153811 15424 raft_consensus.cc:494] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.154548 15424 leader_election.cc:296] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:46.155407 15420 tablet_bootstrap.cc:590] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be: No blocks or log segments found. Creating new log. I0401 16:41:46.157148 15423 tablet_bootstrap.cc:439] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.157284 15423 ts_tablet_manager.cc:1053] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s I0401 16:41:46.158057 15423 raft_consensus.cc:340] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.158243 15423 raft_consensus.cc:366] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.158298 15423 raft_consensus.cc:705] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.158474 15423 consensus_queue.cc:229] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.159006 15423 ts_tablet_manager.cc:1081] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:46.159204 15423 tablet_bootstrap.cc:439] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364: Bootstrap starting. I0401 16:41:46.160352 15423 tablet_bootstrap.cc:590] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364: No blocks or log segments found. Creating new log. I0401 16:41:46.161682 15224 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "64714e1653ba47a0823ad950e06f658a" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" is_pre_election: true I0401 16:41:46.161823 15298 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "64714e1653ba47a0823ad950e06f658a" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" is_pre_election: true I0401 16:41:46.161954 15224 raft_consensus.cc:2346] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 0. W0401 16:41:46.162355 15338 leader_election.cc:348] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:46.162469 15340 leader_election.cc:310] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: 6e4a71e6f77049ad9ea0cbf7ec69a364 I0401 16:41:46.162683 15424 raft_consensus.cc:2640] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.162727 15424 raft_consensus.cc:472] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.162765 15424 raft_consensus.cc:2886] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.164489 15420 tablet_bootstrap.cc:439] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be: No bootstrap required, opened a new log I0401 16:41:46.164577 15420 ts_tablet_manager.cc:1053] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.001s I0401 16:41:46.164822 15423 tablet_bootstrap.cc:439] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364: No bootstrap required, opened a new log I0401 16:41:46.164918 15423 ts_tablet_manager.cc:1053] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s I0401 16:41:46.165019 15424 raft_consensus.cc:494] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.165318 15420 raft_consensus.cc:340] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.165480 15420 raft_consensus.cc:366] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.165511 15420 raft_consensus.cc:705] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Initialized, Role: FOLLOWER I0401 16:41:46.165660 15424 leader_election.cc:296] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 election: Requested vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:46.165654 15420 consensus_queue.cc:229] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.165990 15224 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "64714e1653ba47a0823ad950e06f658a" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" I0401 16:41:46.166117 15224 raft_consensus.cc:2886] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.166224 15298 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "64714e1653ba47a0823ad950e06f658a" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" I0401 16:41:46.167016 15420 ts_tablet_manager.cc:1081] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:41:46.167891 15424 raft_consensus.cc:472] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.167987 15424 raft_consensus.cc:494] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.168264 15224 raft_consensus.cc:2346] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 1. I0401 16:41:46.168594 15424 leader_election.cc:296] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:46.168745 15340 leader_election.cc:310] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.168998 15424 raft_consensus.cc:2640] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.169077 15424 raft_consensus.cc:667] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 LEADER]: Becoming Leader. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Running, Role: LEADER I0401 16:41:46.165504 15423 raft_consensus.cc:340] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.169286 15423 raft_consensus.cc:366] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:46.169291 15424 consensus_queue.cc:206] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.169489 15224 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "408d8036689747bf8e4bf31380916ae8" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" is_pre_election: true I0401 16:41:46.169612 15224 raft_consensus.cc:2346] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 0. I0401 16:41:46.169353 15423 raft_consensus.cc:705] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Initialized, Role: FOLLOWER I0401 16:41:46.169916 15340 leader_election.cc:310] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.169984 15423 consensus_queue.cc:229] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.170181 15298 raft_consensus.cc:2886] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.170881 15297 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "408d8036689747bf8e4bf31380916ae8" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" is_pre_election: true I0401 16:41:46.171105 15297 raft_consensus.cc:2346] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 0. I0401 16:41:46.172405 15455 raft_consensus.cc:2640] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.172534 15455 raft_consensus.cc:472] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.172585 15455 raft_consensus.cc:2886] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.172722 15298 raft_consensus.cc:2346] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 1. I0401 16:41:46.175268 15455 raft_consensus.cc:494] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.175748 15455 leader_election.cc:296] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 election: Requested vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:46.176152 15298 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "408d8036689747bf8e4bf31380916ae8" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" I0401 16:41:46.176286 15298 raft_consensus.cc:2886] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.176241 15224 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "408d8036689747bf8e4bf31380916ae8" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" I0401 16:41:46.176363 15224 raft_consensus.cc:2886] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.176957 15423 ts_tablet_manager.cc:1081] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s I0401 16:41:46.178241 15298 raft_consensus.cc:2346] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 1. I0401 16:41:46.178876 15224 raft_consensus.cc:2346] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 1. I0401 16:41:46.179648 15338 leader_election.cc:310] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 6e4a71e6f77049ad9ea0cbf7ec69a364; no voters: I0401 16:41:46.179883 15456 raft_consensus.cc:2640] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.179980 15456 raft_consensus.cc:667] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 LEADER]: Becoming Leader. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Running, Role: LEADER I0401 16:41:46.180219 15456 consensus_queue.cc:206] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.183490 15136 catalog_manager.cc:3977] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be reported cstate change: term changed from 0 to 1, leader changed from to 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3). New cstate: current_term: 1 leader_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: HEALTHY } } } I0401 16:41:46.190610 15136 catalog_manager.cc:3977] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be reported cstate change: term changed from 0 to 1, leader changed from to 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3). New cstate: current_term: 1 leader_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: HEALTHY } } } I0401 16:41:46.204994 15425 raft_consensus.cc:472] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.205173 15425 raft_consensus.cc:494] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.205750 15425 leader_election.cc:296] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.211616 15425 raft_consensus.cc:472] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.211700 15425 raft_consensus.cc:494] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.211952 15376 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b9d400ec7b0e41a3b952da5c6ca820a3" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" is_pre_election: true I0401 16:41:46.212098 15376 raft_consensus.cc:2346] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 0. I0401 16:41:46.212301 15425 leader_election.cc:296] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.212586 15188 leader_election.cc:310] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.212851 15425 raft_consensus.cc:2640] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.212893 15425 raft_consensus.cc:472] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.212939 15425 raft_consensus.cc:2886] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.213086 15376 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "54573e3062224e96b91a66dc9df3a535" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" is_pre_election: true I0401 16:41:46.213083 15297 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "54573e3062224e96b91a66dc9df3a535" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" is_pre_election: true I0401 16:41:46.213201 15376 raft_consensus.cc:2346] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 0. I0401 16:41:46.213243 15297 raft_consensus.cc:2346] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 0. I0401 16:41:46.213407 15298 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b9d400ec7b0e41a3b952da5c6ca820a3" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" is_pre_election: true I0401 16:41:46.213523 15298 raft_consensus.cc:2346] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 0. I0401 16:41:46.213541 15188 leader_election.cc:310] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.214156 15459 raft_consensus.cc:2640] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.214262 15459 raft_consensus.cc:472] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.214306 15459 raft_consensus.cc:2886] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.215354 15425 raft_consensus.cc:494] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.216209 15429 raft_consensus.cc:472] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.216403 15425 leader_election.cc:296] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 election: Requested vote from peers 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.216423 15298 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b9d400ec7b0e41a3b952da5c6ca820a3" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" I0401 16:41:46.216536 15298 raft_consensus.cc:2886] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.216385 15429 raft_consensus.cc:494] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.217085 15429 leader_election.cc:296] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.217451 15459 raft_consensus.cc:494] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.218255 15298 raft_consensus.cc:2346] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 1. I0401 16:41:46.218474 15425 raft_consensus.cc:472] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.218546 15376 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b9d400ec7b0e41a3b952da5c6ca820a3" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" I0401 16:41:46.218664 15376 raft_consensus.cc:2886] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.218647 15375 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "54573e3062224e96b91a66dc9df3a535" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" I0401 16:41:46.218767 15375 raft_consensus.cc:2886] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.218590 15425 raft_consensus.cc:494] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.219449 15425 leader_election.cc:296] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.219560 15459 leader_election.cc:296] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 election: Requested vote from peers 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.219643 15374 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8dec592d52774f3b84d581cbf80c0139" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" is_pre_election: true I0401 16:41:46.219774 15374 raft_consensus.cc:2346] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 0. I0401 16:41:46.220314 15188 leader_election.cc:310] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.220717 15376 raft_consensus.cc:2346] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 1. I0401 16:41:46.220752 15375 raft_consensus.cc:2346] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 1. I0401 16:41:46.218457 15297 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "54573e3062224e96b91a66dc9df3a535" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" I0401 16:41:46.221072 15188 leader_election.cc:310] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.221122 15297 raft_consensus.cc:2886] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.221303 15459 raft_consensus.cc:2640] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.221308 15188 leader_election.cc:310] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.221343 15459 raft_consensus.cc:472] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.221387 15459 raft_consensus.cc:2886] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.221911 15298 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8dec592d52774f3b84d581cbf80c0139" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" is_pre_election: true I0401 16:41:46.222607 15298 raft_consensus.cc:2346] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 0. I0401 16:41:46.222710 15425 raft_consensus.cc:2640] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.225236 15297 raft_consensus.cc:2346] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 1. I0401 16:41:46.228760 15375 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4e3f5387e6e342eab8254c100662c241" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" is_pre_election: true I0401 16:41:46.228924 15375 raft_consensus.cc:2346] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 0. I0401 16:41:46.229218 15224 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4e3f5387e6e342eab8254c100662c241" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" is_pre_election: true I0401 16:41:46.229357 15224 raft_consensus.cc:2346] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 0. I0401 16:41:46.229607 15259 leader_election.cc:310] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4a71e6f77049ad9ea0cbf7ec69a364, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.229986 15429 raft_consensus.cc:2640] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.230032 15429 raft_consensus.cc:472] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.230077 15429 raft_consensus.cc:2886] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.229935 15459 raft_consensus.cc:494] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.230650 15460 raft_consensus.cc:2640] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.231149 15375 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8dec592d52774f3b84d581cbf80c0139" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" I0401 16:41:46.230937 15459 leader_election.cc:296] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 election: Requested vote from peers 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.231266 15375 raft_consensus.cc:2886] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.231724 15297 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8dec592d52774f3b84d581cbf80c0139" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" I0401 16:41:46.231866 15297 raft_consensus.cc:2886] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.232547 15429 raft_consensus.cc:494] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.233212 15429 leader_election.cc:296] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 election: Requested vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.233727 15375 raft_consensus.cc:2346] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 1. I0401 16:41:46.233748 15376 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4e3f5387e6e342eab8254c100662c241" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" I0401 16:41:46.233748 15224 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4e3f5387e6e342eab8254c100662c241" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" I0401 16:41:46.233981 15224 raft_consensus.cc:2886] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.234043 15429 raft_consensus.cc:472] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.233916 15376 raft_consensus.cc:2886] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.234117 15429 raft_consensus.cc:494] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.230865 15425 raft_consensus.cc:667] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 1 LEADER]: Becoming Leader. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Running, Role: LEADER I0401 16:41:46.234452 15425 consensus_queue.cc:206] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.234643 15429 leader_election.cc:296] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.235270 15375 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b5385787b2244d03853e1c7fe8ab2380" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" is_pre_election: true I0401 16:41:46.235433 15375 raft_consensus.cc:2346] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 0. I0401 16:41:46.235719 15259 leader_election.cc:310] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 6e4a71e6f77049ad9ea0cbf7ec69a364; no voters: I0401 16:41:46.235787 15224 raft_consensus.cc:2346] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 1. I0401 16:41:46.235997 15429 raft_consensus.cc:2640] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.236035 15376 raft_consensus.cc:2346] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 1. I0401 16:41:46.236023 15188 leader_election.cc:310] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.236176 15259 leader_election.cc:310] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4a71e6f77049ad9ea0cbf7ec69a364, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.236269 15459 raft_consensus.cc:2640] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.236351 15459 raft_consensus.cc:667] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 1 LEADER]: Becoming Leader. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Running, Role: LEADER I0401 16:41:46.236070 15429 raft_consensus.cc:472] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.236485 15429 raft_consensus.cc:2886] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.236676 15223 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b5385787b2244d03853e1c7fe8ab2380" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" is_pre_election: true I0401 16:41:46.237141 15223 raft_consensus.cc:2346] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 0. I0401 16:41:46.237331 15297 raft_consensus.cc:2346] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 1. I0401 16:41:46.236784 15459 consensus_queue.cc:206] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.241155 15463 raft_consensus.cc:2640] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.243386 15429 raft_consensus.cc:494] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.243968 15429 leader_election.cc:296] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 election: Requested vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.244060 15429 raft_consensus.cc:472] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.244125 15429 raft_consensus.cc:494] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.244330 15223 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b5385787b2244d03853e1c7fe8ab2380" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" I0401 16:41:46.244459 15223 raft_consensus.cc:2886] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.244694 15429 leader_election.cc:296] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.245096 15224 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4c188a2569664da38e94e98cf7c60325" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" is_pre_election: true I0401 16:41:46.245236 15224 raft_consensus.cc:2346] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 0. I0401 16:41:46.245558 15259 leader_election.cc:310] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4a71e6f77049ad9ea0cbf7ec69a364, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.245697 15375 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b5385787b2244d03853e1c7fe8ab2380" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" I0401 16:41:46.245815 15375 raft_consensus.cc:2886] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.245820 15376 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4c188a2569664da38e94e98cf7c60325" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" is_pre_election: true I0401 16:41:46.245963 15376 raft_consensus.cc:2346] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 0. I0401 16:41:46.246240 15429 raft_consensus.cc:2640] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.246300 15429 raft_consensus.cc:472] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.246364 15429 raft_consensus.cc:2886] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.253942 15460 raft_consensus.cc:667] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 1 LEADER]: Becoming Leader. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Running, Role: LEADER I0401 16:41:46.255116 15375 raft_consensus.cc:2346] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 1. I0401 16:41:46.255010 15460 consensus_queue.cc:206] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.255254 15223 raft_consensus.cc:2346] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 1. I0401 16:41:46.255630 15259 leader_election.cc:310] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4a71e6f77049ad9ea0cbf7ec69a364, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.256146 15466 raft_consensus.cc:2640] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.258270 15429 raft_consensus.cc:494] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.259042 15466 raft_consensus.cc:667] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Running, Role: LEADER I0401 16:41:46.259299 15223 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4c188a2569664da38e94e98cf7c60325" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" I0401 16:41:46.259439 15223 raft_consensus.cc:2886] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.260861 15429 leader_election.cc:296] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 election: Requested vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.261404 15375 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4c188a2569664da38e94e98cf7c60325" candidate_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" I0401 16:41:46.261575 15463 raft_consensus.cc:667] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Running, Role: LEADER I0401 16:41:46.261526 15375 raft_consensus.cc:2886] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.262678 15136 catalog_manager.cc:3977] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc reported cstate change: term changed from 0 to 1, leader changed from to 9989560c1599415ab25ad0d9a55163bc (127.11.224.1). New cstate: current_term: 1 leader_uuid: "9989560c1599415ab25ad0d9a55163bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: UNKNOWN } } } I0401 16:41:46.263375 15223 raft_consensus.cc:2346] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 1. I0401 16:41:46.261272 15466 consensus_queue.cc:206] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.264627 15375 raft_consensus.cc:2346] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e4a71e6f77049ad9ea0cbf7ec69a364 in term 1. I0401 16:41:46.264943 15259 leader_election.cc:310] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 6e4a71e6f77049ad9ea0cbf7ec69a364; no voters: I0401 16:41:46.265177 15467 raft_consensus.cc:2640] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.266484 15467 raft_consensus.cc:667] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 LEADER]: Becoming Leader. State: Replica: 6e4a71e6f77049ad9ea0cbf7ec69a364, State: Running, Role: LEADER I0401 16:41:46.266656 15467 consensus_queue.cc:206] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.265460 15463 consensus_queue.cc:206] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.274128 15136 catalog_manager.cc:3977] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc reported cstate change: term changed from 0 to 1, leader changed from to 9989560c1599415ab25ad0d9a55163bc (127.11.224.1). New cstate: current_term: 1 leader_uuid: "9989560c1599415ab25ad0d9a55163bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: UNKNOWN } } } I0401 16:41:46.274806 15136 catalog_manager.cc:3977] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc reported cstate change: term changed from 0 to 1, leader changed from to 9989560c1599415ab25ad0d9a55163bc (127.11.224.1). New cstate: current_term: 1 leader_uuid: "9989560c1599415ab25ad0d9a55163bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: UNKNOWN } } } I0401 16:41:46.277007 15137 catalog_manager.cc:3977] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 reported cstate change: term changed from 0 to 1, leader changed from to 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: UNKNOWN } } } I0401 16:41:46.284770 15137 catalog_manager.cc:3977] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 reported cstate change: term changed from 0 to 1, leader changed from to 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: UNKNOWN } } } I0401 16:41:46.285171 15137 catalog_manager.cc:3977] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 reported cstate change: term changed from 0 to 1, leader changed from to 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: UNKNOWN } } } I0401 16:41:46.349316 15424 raft_consensus.cc:472] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.349427 15424 raft_consensus.cc:494] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.350008 15424 leader_election.cc:296] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:46.350353 15223 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "40cc2afeb94246a4965b95e72b1bdf1d" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" is_pre_election: true I0401 16:41:46.350546 15223 raft_consensus.cc:2346] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 0. I0401 16:41:46.350386 15297 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "40cc2afeb94246a4965b95e72b1bdf1d" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" is_pre_election: true I0401 16:41:46.350705 15297 raft_consensus.cc:2346] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 0. I0401 16:41:46.350878 15340 leader_election.cc:310] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.351147 15424 raft_consensus.cc:2640] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.351191 15424 raft_consensus.cc:472] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.351235 15424 raft_consensus.cc:2886] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.352851 15424 raft_consensus.cc:494] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.353307 15424 leader_election.cc:296] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 election: Requested vote from peers 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448), 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666) I0401 16:41:46.353603 15223 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "40cc2afeb94246a4965b95e72b1bdf1d" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9989560c1599415ab25ad0d9a55163bc" I0401 16:41:46.353624 15297 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "40cc2afeb94246a4965b95e72b1bdf1d" candidate_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" I0401 16:41:46.353746 15297 raft_consensus.cc:2886] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.353760 15223 raft_consensus.cc:2886] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.355693 15297 raft_consensus.cc:2346] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 1. I0401 16:41:46.355724 15223 raft_consensus.cc:2346] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3a91cc8c6e76418d88c7fe9c2cca94be in term 1. I0401 16:41:46.355995 15340 leader_election.cc:310] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3a91cc8c6e76418d88c7fe9c2cca94be, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.356204 15424 raft_consensus.cc:2640] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.356297 15424 raft_consensus.cc:667] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 LEADER]: Becoming Leader. State: Replica: 3a91cc8c6e76418d88c7fe9c2cca94be, State: Running, Role: LEADER I0401 16:41:46.356510 15424 consensus_queue.cc:206] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.358922 15136 catalog_manager.cc:3977] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be reported cstate change: term changed from 0 to 1, leader changed from to 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3). New cstate: current_term: 1 leader_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: HEALTHY } } } I0401 16:41:46.387665 15460 raft_consensus.cc:472] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:46.387789 15460 raft_consensus.cc:494] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.388744 15460 leader_election.cc:296] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.388839 15297 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1831857df7324b18964447ca50f9568e" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" is_pre_election: true I0401 16:41:46.389010 15297 raft_consensus.cc:2346] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 0. I0401 16:41:46.388985 15375 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1831857df7324b18964447ca50f9568e" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" is_pre_election: true I0401 16:41:46.389106 15375 raft_consensus.cc:2346] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 0. I0401 16:41:46.389272 15186 leader_election.cc:310] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4a71e6f77049ad9ea0cbf7ec69a364, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.389494 15460 raft_consensus.cc:2640] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:46.389536 15460 raft_consensus.cc:472] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:46.389611 15460 raft_consensus.cc:2886] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.392077 15460 raft_consensus.cc:494] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.393024 15460 leader_election.cc:296] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 election: Requested vote from peers 6e4a71e6f77049ad9ea0cbf7ec69a364 (127.11.224.2:55666), 3a91cc8c6e76418d88c7fe9c2cca94be (127.11.224.3:50415) I0401 16:41:46.393339 15297 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1831857df7324b18964447ca50f9568e" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" I0401 16:41:46.393384 15375 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1831857df7324b18964447ca50f9568e" candidate_uuid: "9989560c1599415ab25ad0d9a55163bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" I0401 16:41:46.393463 15297 raft_consensus.cc:2886] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.393486 15375 raft_consensus.cc:2886] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:46.395107 15297 raft_consensus.cc:2346] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 1. I0401 16:41:46.395112 15375 raft_consensus.cc:2346] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9989560c1599415ab25ad0d9a55163bc in term 1. I0401 16:41:46.395370 15186 leader_election.cc:310] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6e4a71e6f77049ad9ea0cbf7ec69a364, 9989560c1599415ab25ad0d9a55163bc; no voters: I0401 16:41:46.395571 15460 raft_consensus.cc:2640] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:46.395658 15460 raft_consensus.cc:667] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 1 LEADER]: Becoming Leader. State: Replica: 9989560c1599415ab25ad0d9a55163bc, State: Running, Role: LEADER I0401 16:41:46.395840 15460 consensus_queue.cc:206] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } } I0401 16:41:46.398532 15136 catalog_manager.cc:3977] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc reported cstate change: term changed from 0 to 1, leader changed from to 9989560c1599415ab25ad0d9a55163bc (127.11.224.1). New cstate: current_term: 1 leader_uuid: "9989560c1599415ab25ad0d9a55163bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 } health_report { overall_health: UNKNOWN } } } I0401 16:41:46.473534 12160 ksck_remote-test.cc:353] Generating row writes... I0401 16:41:46.584223 15223 raft_consensus.cc:1181] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Refusing update from remote peer 3a91cc8c6e76418d88c7fe9c2cca94be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.584933 15424 consensus_queue.cc:984] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.590384 15297 raft_consensus.cc:1181] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Refusing update from remote peer 3a91cc8c6e76418d88c7fe9c2cca94be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.591415 15456 consensus_queue.cc:984] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.640729 15223 raft_consensus.cc:1181] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Refusing update from remote peer 3a91cc8c6e76418d88c7fe9c2cca94be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.641188 15456 consensus_queue.cc:984] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.641860 15179 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be: acquiring CA information for follower catalog manager: success I0401 16:41:46.644678 15179 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:46.645753 15224 raft_consensus.cc:1181] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Refusing update from remote peer 6e4a71e6f77049ad9ea0cbf7ec69a364: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.646293 15463 consensus_queue.cc:984] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.647490 15182 catalog_manager.cc:1111] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20: acquiring CA information for follower catalog manager: success I0401 16:41:46.649274 15182 catalog_manager.cc:1139] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:46.653368 15297 raft_consensus.cc:1181] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Refusing update from remote peer 3a91cc8c6e76418d88c7fe9c2cca94be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.654168 15424 consensus_queue.cc:984] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.658520 15375 raft_consensus.cc:1181] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Refusing update from remote peer 6e4a71e6f77049ad9ea0cbf7ec69a364: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.659149 15463 consensus_queue.cc:984] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.684573 15297 raft_consensus.cc:1181] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Refusing update from remote peer 9989560c1599415ab25ad0d9a55163bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.684998 15460 consensus_queue.cc:984] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.690912 15375 raft_consensus.cc:1181] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Refusing update from remote peer 9989560c1599415ab25ad0d9a55163bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.691416 15425 consensus_queue.cc:984] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.701457 15375 raft_consensus.cc:1181] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Refusing update from remote peer 9989560c1599415ab25ad0d9a55163bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.701841 15425 consensus_queue.cc:984] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.710156 15297 raft_consensus.cc:1181] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Refusing update from remote peer 9989560c1599415ab25ad0d9a55163bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.711377 15462 consensus_queue.cc:984] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.744349 15297 raft_consensus.cc:1181] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Refusing update from remote peer 3a91cc8c6e76418d88c7fe9c2cca94be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.744398 15224 raft_consensus.cc:1181] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Refusing update from remote peer 6e4a71e6f77049ad9ea0cbf7ec69a364: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.745260 15463 consensus_queue.cc:984] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.745502 15424 consensus_queue.cc:984] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.753228 15375 raft_consensus.cc:1181] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Refusing update from remote peer 6e4a71e6f77049ad9ea0cbf7ec69a364: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.756479 15463 consensus_queue.cc:984] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.758116 15223 raft_consensus.cc:1181] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Refusing update from remote peer 3a91cc8c6e76418d88c7fe9c2cca94be: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.762308 15424 consensus_queue.cc:984] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [LEADER]: Connected to new peer: Peer: permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.774353 15375 raft_consensus.cc:1181] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Refusing update from remote peer 6e4a71e6f77049ad9ea0cbf7ec69a364: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.774973 15463 consensus_queue.cc:984] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.778791 15297 raft_consensus.cc:1181] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Refusing update from remote peer 9989560c1599415ab25ad0d9a55163bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.780568 15425 consensus_queue.cc:984] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.781169 15297 raft_consensus.cc:1181] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Refusing update from remote peer 9989560c1599415ab25ad0d9a55163bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.781687 15376 raft_consensus.cc:1181] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Refusing update from remote peer 9989560c1599415ab25ad0d9a55163bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.782090 15425 consensus_queue.cc:984] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.782507 15224 raft_consensus.cc:1181] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Refusing update from remote peer 6e4a71e6f77049ad9ea0cbf7ec69a364: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.783257 15466 consensus_queue.cc:984] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9989560c1599415ab25ad0d9a55163bc" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 34448 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.783972 15425 consensus_queue.cc:984] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "6e4a71e6f77049ad9ea0cbf7ec69a364" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 55666 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:46.795442 15376 raft_consensus.cc:1181] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Refusing update from remote peer 9989560c1599415ab25ad0d9a55163bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:46.796165 15460 consensus_queue.cc:984] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "3a91cc8c6e76418d88c7fe9c2cca94be" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 50415 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s W0401 16:41:47.248571 15259 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.224.1:34448, user_credentials={real_user=jenkins}} blocked reactor thread for 54584.1us W0401 16:41:48.317685 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.317927 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.318084 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.318236 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.318397 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.318557 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.319330 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.319500 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.319655 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.319830 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.319985 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.320139 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.320736 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.320951 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.321204 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.327553 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. I0401 16:41:48.330128 12160 tablet_server.cc:165] TabletServer shutting down... W0401 16:41:48.347044 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.361119 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.361331 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.369869 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.370363 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.372222 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.373651 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. I0401 16:41:48.382315 15186 messenger.cc:381] Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer W0401 16:41:48.382925 15340 consensus_peers.cc:457] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be -> Peer 9989560c1599415ab25ad0d9a55163bc (127.11.224.1:34448): Couldn't send request to peer 9989560c1599415ab25ad0d9a55163bc. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry. W0401 16:41:48.479424 15475 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. W0401 16:41:48.496059 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. I0401 16:41:48.502467 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:48.502581 12160 tablet_replica.cc:264] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.502712 12160 raft_consensus.cc:2143] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.502833 12160 raft_consensus.cc:2170] T 408d8036689747bf8e4bf31380916ae8 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.503463 12160 tablet_replica.cc:264] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.503558 12160 raft_consensus.cc:2143] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.503743 12160 raft_consensus.cc:2170] T 1831857df7324b18964447ca50f9568e P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.504187 12160 tablet_replica.cc:264] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.504285 12160 raft_consensus.cc:2143] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.504364 12160 raft_consensus.cc:2170] T b5385787b2244d03853e1c7fe8ab2380 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.504822 12160 tablet_replica.cc:264] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.504930 12160 raft_consensus.cc:2143] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.505079 12160 raft_consensus.cc:2170] T 8dec592d52774f3b84d581cbf80c0139 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.505509 12160 tablet_replica.cc:264] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.505599 12160 raft_consensus.cc:2143] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.505745 12160 raft_consensus.cc:2170] T 54573e3062224e96b91a66dc9df3a535 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.506242 12160 tablet_replica.cc:264] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.506345 12160 raft_consensus.cc:2143] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.506423 12160 raft_consensus.cc:2170] T 40cc2afeb94246a4965b95e72b1bdf1d P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.507763 12160 tablet_replica.cc:264] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.508061 12160 raft_consensus.cc:2143] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.508191 12160 raft_consensus.cc:2170] T 4e3f5387e6e342eab8254c100662c241 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.508914 12160 tablet_replica.cc:264] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.509048 12160 raft_consensus.cc:2143] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.509167 12160 raft_consensus.cc:2170] T 64714e1653ba47a0823ad950e06f658a P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.510051 12160 tablet_replica.cc:264] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.510185 12160 raft_consensus.cc:2143] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.510403 12160 raft_consensus.cc:2170] T b9d400ec7b0e41a3b952da5c6ca820a3 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.511153 12160 tablet_replica.cc:264] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc: stopping tablet replica I0401 16:41:48.511288 12160 raft_consensus.cc:2143] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.511405 12160 raft_consensus.cc:2170] T 4c188a2569664da38e94e98cf7c60325 P 9989560c1599415ab25ad0d9a55163bc [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.524206 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:48.524296 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:48.524474 12160 tablet_server.cc:179] TabletServer shutdown complete. W0401 16:41:48.525341 15477 ksck_checksum.cc:286] failed to submit task to start additional tablet checksums: Service unavailable: The pool has been shut down. I0401 16:41:48.528596 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:48.574995 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:48.575127 12160 tablet_replica.cc:264] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.575258 12160 raft_consensus.cc:2143] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.575376 12160 raft_consensus.cc:2170] T 64714e1653ba47a0823ad950e06f658a P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.575956 12160 tablet_replica.cc:264] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.576053 12160 raft_consensus.cc:2143] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.576135 12160 raft_consensus.cc:2170] T 1831857df7324b18964447ca50f9568e P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.576541 12160 tablet_replica.cc:264] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.576635 12160 raft_consensus.cc:2143] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.576817 12160 raft_consensus.cc:2170] T b5385787b2244d03853e1c7fe8ab2380 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.577347 12160 tablet_replica.cc:264] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.577479 12160 raft_consensus.cc:2143] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.577585 12160 raft_consensus.cc:2170] T 8dec592d52774f3b84d581cbf80c0139 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.578161 12160 tablet_replica.cc:264] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.578261 12160 raft_consensus.cc:2143] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.578347 12160 raft_consensus.cc:2170] T 408d8036689747bf8e4bf31380916ae8 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.578783 12160 tablet_replica.cc:264] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.578896 12160 raft_consensus.cc:2143] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.579056 12160 raft_consensus.cc:2170] T 4c188a2569664da38e94e98cf7c60325 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.579469 12160 tablet_replica.cc:264] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.579563 12160 raft_consensus.cc:2143] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.579643 12160 raft_consensus.cc:2170] T b9d400ec7b0e41a3b952da5c6ca820a3 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.580111 12160 tablet_replica.cc:264] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.580231 12160 raft_consensus.cc:2143] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.580478 12160 raft_consensus.cc:2170] T 4e3f5387e6e342eab8254c100662c241 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.580993 12160 tablet_replica.cc:264] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.581111 12160 raft_consensus.cc:2143] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.581192 12160 raft_consensus.cc:2170] T 40cc2afeb94246a4965b95e72b1bdf1d P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.582186 12160 tablet_replica.cc:264] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364: stopping tablet replica I0401 16:41:48.582276 12160 raft_consensus.cc:2143] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.582357 12160 raft_consensus.cc:2170] T 54573e3062224e96b91a66dc9df3a535 P 6e4a71e6f77049ad9ea0cbf7ec69a364 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.591094 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:48.591449 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:48.591821 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:48.597076 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:48.621608 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:48.621727 12160 tablet_replica.cc:264] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.621863 12160 raft_consensus.cc:2143] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.621978 12160 raft_consensus.cc:2170] T 1831857df7324b18964447ca50f9568e P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.622550 12160 tablet_replica.cc:264] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.622647 12160 raft_consensus.cc:2143] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.622725 12160 raft_consensus.cc:2170] T 54573e3062224e96b91a66dc9df3a535 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.623145 12160 tablet_replica.cc:264] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.623234 12160 raft_consensus.cc:2143] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.623402 12160 raft_consensus.cc:2170] T 40cc2afeb94246a4965b95e72b1bdf1d P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.624418 12160 tablet_replica.cc:264] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.624528 12160 raft_consensus.cc:2143] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.624677 12160 raft_consensus.cc:2170] T 408d8036689747bf8e4bf31380916ae8 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.625123 12160 tablet_replica.cc:264] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.625216 12160 raft_consensus.cc:2143] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.625293 12160 raft_consensus.cc:2170] T b5385787b2244d03853e1c7fe8ab2380 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.625694 12160 tablet_replica.cc:264] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.625780 12160 raft_consensus.cc:2143] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.625874 12160 raft_consensus.cc:2170] T 8dec592d52774f3b84d581cbf80c0139 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.626269 12160 tablet_replica.cc:264] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.626356 12160 raft_consensus.cc:2143] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.626432 12160 raft_consensus.cc:2170] T 4e3f5387e6e342eab8254c100662c241 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.626803 12160 tablet_replica.cc:264] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.626912 12160 raft_consensus.cc:2143] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.626991 12160 raft_consensus.cc:2170] T 4c188a2569664da38e94e98cf7c60325 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.627351 12160 tablet_replica.cc:264] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.627435 12160 raft_consensus.cc:2143] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.627511 12160 raft_consensus.cc:2170] T b9d400ec7b0e41a3b952da5c6ca820a3 P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.627936 12160 tablet_replica.cc:264] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be: stopping tablet replica I0401 16:41:48.628018 12160 raft_consensus.cc:2143] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.628167 12160 raft_consensus.cc:2170] T 64714e1653ba47a0823ad950e06f658a P 3a91cc8c6e76418d88c7fe9c2cca94be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.645498 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:48.645543 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:48.645681 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:48.658578 12160 master.cc:270] Master@127.11.224.62:46307 shutting down... I0401 16:41:48.668591 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.668740 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.668817 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P eb648a2ef68b4313979717f88e363b20: stopping tablet replica I0401 16:41:48.682312 12160 master.cc:281] Master@127.11.224.62:46307 shutdown complete. I0401 16:41:48.684942 12160 master.cc:270] Master@127.11.224.61:41024 shutting down... I0401 16:41:48.694392 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:48.694523 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.694594 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 17d307571a004ef88f4d3c1a723610be: stopping tablet replica I0401 16:41:48.707556 12160 master.cc:281] Master@127.11.224.61:41024 shutdown complete. I0401 16:41:48.710050 12160 master.cc:270] Master@127.11.224.60:45270 shutting down... I0401 16:41:48.719748 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:48.720038 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:48.720114 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 866eb3aa863645639487aa432aefaa71: stopping tablet replica I0401 16:41:48.733956 12160 master.cc:281] Master@127.11.224.60:45270 shutdown complete. [ OK ] RemoteKsckTest.TestChecksumTimeout (3327 ms) [ RUN ] RemoteKsckTest.TestChecksumSnapshot I0401 16:41:48.751981 12160 test_util.cc:212] Using random seed: -1872076697 I0401 16:41:48.752496 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:37596,127.11.224.61:58736,127.11.224.60:32872 I0401 16:41:48.755898 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 844431us I0401 16:41:48.756055 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:48.756089 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:48.756168 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:48.756196 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:48.756611 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "f157b39c0d014af294d782407497c377" format_stamp: "Formatted at 2019-04-01 23:41:48 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:48.760767 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s I0401 16:41:48.761422 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:48.763178 12160 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s I0401 16:41:48.763223 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-0-root uuid: "f157b39c0d014af294d782407497c377" format_stamp: "Formatted at 2019-04-01 23:41:48 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:48.763296 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:48.783293 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:37596 I0401 16:41:48.784023 12160 webserver.cc:308] Webserver started at http://127.11.224.62:59235/ using document root and password file I0401 16:41:48.784946 15622 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:48.786872 15622 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:48.787700 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 844431us I0401 16:41:48.787909 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:48.787971 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:48.788089 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:48.788139 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:48.788604 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "c648c7b342d841319c073af14dbe36e5" format_stamp: "Formatted at 2019-04-01 23:41:48 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:48.793241 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s I0401 16:41:48.794167 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:48.797024 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:48.797111 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-1-root uuid: "c648c7b342d841319c073af14dbe36e5" format_stamp: "Formatted at 2019-04-01 23:41:48 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:48.797204 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:48.799299 15622 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:48.800019 15622 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:58736: Network error: Client connection negotiation failed: client connection to 127.11.224.61:58736: connect: Connection refused (error 111) I0401 16:41:48.820232 15622 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } attempt: 1 W0401 16:41:48.821260 15622 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:58736: Network error: Client connection negotiation failed: client connection to 127.11.224.61:58736: connect: Connection refused (error 111) I0401 16:41:48.843570 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:58736 I0401 16:41:48.844202 12160 webserver.cc:308] Webserver started at http://127.11.224.61:40889/ using document root and password file I0401 16:41:48.845118 15679 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:48.846966 15679 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:48.848212 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 844431us I0401 16:41:48.848439 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:48.848477 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:48.848598 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:48.848649 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:48.849167 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "db81944f68db4f41a11ed545fdf4ca28" format_stamp: "Formatted at 2019-04-01 23:41:48 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:48.852128 15679 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:48.853844 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s I0401 16:41:48.854467 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:48.856698 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:48.856730 15679 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:48.856743 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-2-root uuid: "db81944f68db4f41a11ed545fdf4ca28" format_stamp: "Formatted at 2019-04-01 23:41:48 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:48.856827 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0401 16:41:48.857389 15679 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:32872: Network error: Client connection negotiation failed: client connection to 127.11.224.60:32872: connect: Connection refused (error 111) I0401 16:41:48.877460 15622 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } attempt: 2 I0401 16:41:48.881983 15622 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:48.882747 15622 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:32872: Network error: Client connection negotiation failed: client connection to 127.11.224.60:32872: connect: Connection refused (error 111) I0401 16:41:48.895727 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:32872 I0401 16:41:48.896420 12160 webserver.cc:308] Webserver started at http://127.11.224.60:37118/ using document root and password file I0401 16:41:48.896747 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:48.897351 15736 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:48.899199 15736 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:48.903606 15736 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:48.907068 15736 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:48.912791 15736 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28: Bootstrap starting. I0401 16:41:48.913800 15736 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28: No blocks or log segments found. Creating new log. I0401 16:41:48.915426 15736 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28: No bootstrap required, opened a new log I0401 16:41:48.915599 15679 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } attempt: 1 I0401 16:41:48.916455 15736 raft_consensus.cc:340] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:48.916970 15736 raft_consensus.cc:366] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:48.917014 15736 raft_consensus.cc:705] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: db81944f68db4f41a11ed545fdf4ca28, State: Initialized, Role: FOLLOWER I0401 16:41:48.917754 15736 consensus_queue.cc:229] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:48.918335 15736 sys_catalog.cc:337] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:48.918519 15736 sys_catalog.cc:340] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:48.918390 15740 sys_catalog.cc:337] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:48.918610 15740 sys_catalog.cc:340] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:48.919970 15736 sys_catalog.cc:424] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: configured and running, proceeding with master startup. W0401 16:41:48.921284 15741 catalog_manager.cc:1113] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:48.921332 15741 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:48.921725 15679 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5: Bootstrap starting. I0401 16:41:48.922564 15679 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5: No blocks or log segments found. Creating new log. I0401 16:41:48.923753 15679 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5: No bootstrap required, opened a new log I0401 16:41:48.923934 15622 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } attempt: 1 I0401 16:41:48.924664 15679 raft_consensus.cc:340] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:48.924856 15679 raft_consensus.cc:366] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:48.924901 15679 raft_consensus.cc:705] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c648c7b342d841319c073af14dbe36e5, State: Initialized, Role: FOLLOWER I0401 16:41:48.925060 15679 consensus_queue.cc:229] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:48.925559 15679 sys_catalog.cc:337] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:48.925738 15679 sys_catalog.cc:340] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:48.925612 15743 sys_catalog.cc:337] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:48.925840 15743 sys_catalog.cc:340] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:48.926205 15679 sys_catalog.cc:424] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: configured and running, proceeding with master startup. W0401 16:41:48.927858 15744 catalog_manager.cc:1113] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:48.927932 15744 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:48.929725 15622 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377: Bootstrap starting. I0401 16:41:48.930649 15622 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377: No blocks or log segments found. Creating new log. I0401 16:41:48.932020 15622 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377: No bootstrap required, opened a new log I0401 16:41:48.932539 15622 raft_consensus.cc:340] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:48.932672 15622 raft_consensus.cc:366] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:48.932694 15622 raft_consensus.cc:705] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f157b39c0d014af294d782407497c377, State: Initialized, Role: FOLLOWER I0401 16:41:48.932830 15622 consensus_queue.cc:229] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:48.933259 15622 sys_catalog.cc:337] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:48.933383 15622 sys_catalog.cc:340] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:48.933356 15746 sys_catalog.cc:337] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:48.933547 15746 sys_catalog.cc:340] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:48.933715 15622 sys_catalog.cc:424] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:48.934015 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:41:48.934047 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:48.935279 15747 catalog_manager.cc:1113] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:48.935320 15747 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:48.938591 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 844431us I0401 16:41:48.938752 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:48.938809 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:48.938896 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:48.938923 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:48.939326 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "c389c480349f4579bf5e70301b6d4517" format_stamp: "Formatted at 2019-04-01 23:41:48 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:48.942981 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.002s sys 0.001s I0401 16:41:48.943635 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:48.945888 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:48.945935 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-0-root uuid: "c389c480349f4579bf5e70301b6d4517" format_stamp: "Formatted at 2019-04-01 23:41:48 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:48.946008 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:49.044189 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:49.044234 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:49.058722 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:33095 I0401 16:41:49.059523 12160 webserver.cc:308] Webserver started at http://127.11.224.1:43337/ using document root and password file I0401 16:41:49.067694 15812 heartbeater.cc:345] Connected to a master server at 127.11.224.60:32872 I0401 16:41:49.067773 15812 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.068043 15812 heartbeater.cc:475] Master 127.11.224.60:32872 requested a full tablet report, sending... I0401 16:41:49.068977 15703 ts_manager.cc:159] Registered new tserver with Master: c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095) I0401 16:41:49.071382 15813 heartbeater.cc:345] Connected to a master server at 127.11.224.61:58736 I0401 16:41:49.071444 15813 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.071640 15813 heartbeater.cc:475] Master 127.11.224.61:58736 requested a full tablet report, sending... I0401 16:41:49.072032 15746 raft_consensus.cc:472] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.072219 15746 raft_consensus.cc:494] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:49.072707 15646 ts_manager.cc:159] Registered new tserver with Master: c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095) I0401 16:41:49.072919 15746 leader_election.cc:296] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c648c7b342d841319c073af14dbe36e5 (127.11.224.61:58736), db81944f68db4f41a11ed545fdf4ca28 (127.11.224.60:32872) I0401 16:41:49.073056 15814 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37596 I0401 16:41:49.073117 15814 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.073288 15814 heartbeater.cc:475] Master 127.11.224.62:37596 requested a full tablet report, sending... I0401 16:41:49.073303 15656 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f157b39c0d014af294d782407497c377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c648c7b342d841319c073af14dbe36e5" is_pre_election: true I0401 16:41:49.073462 15656 raft_consensus.cc:2346] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f157b39c0d014af294d782407497c377 in term 0. I0401 16:41:49.073352 15713 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f157b39c0d014af294d782407497c377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db81944f68db4f41a11ed545fdf4ca28" is_pre_election: true I0401 16:41:49.073647 15713 raft_consensus.cc:2346] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f157b39c0d014af294d782407497c377 in term 0. I0401 16:41:49.073756 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 844931us I0401 16:41:49.073819 15570 leader_election.cc:310] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c648c7b342d841319c073af14dbe36e5, f157b39c0d014af294d782407497c377; no voters: I0401 16:41:49.073973 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:49.074012 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:49.074127 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:49.074156 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:49.074158 15746 raft_consensus.cc:2640] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.074203 15746 raft_consensus.cc:472] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.074250 15746 raft_consensus.cc:2886] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.074589 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "c49eacb8125f47b5a28548c823edfbf3" format_stamp: "Formatted at 2019-04-01 23:41:49 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:49.075574 15746 raft_consensus.cc:494] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:49.076099 15746 leader_election.cc:296] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [CANDIDATE]: Term 1 election: Requested vote from peers c648c7b342d841319c073af14dbe36e5 (127.11.224.61:58736), db81944f68db4f41a11ed545fdf4ca28 (127.11.224.60:32872) I0401 16:41:49.076159 15589 ts_manager.cc:159] Registered new tserver with Master: c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095) I0401 16:41:49.076604 15713 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f157b39c0d014af294d782407497c377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "db81944f68db4f41a11ed545fdf4ca28" I0401 16:41:49.076716 15713 raft_consensus.cc:2886] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.076782 15656 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f157b39c0d014af294d782407497c377" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c648c7b342d841319c073af14dbe36e5" I0401 16:41:49.076922 15656 raft_consensus.cc:2886] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.078223 15656 raft_consensus.cc:2346] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f157b39c0d014af294d782407497c377 in term 1. I0401 16:41:49.078471 15570 leader_election.cc:310] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c648c7b342d841319c073af14dbe36e5, f157b39c0d014af294d782407497c377; no voters: I0401 16:41:49.078647 15713 raft_consensus.cc:2346] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f157b39c0d014af294d782407497c377 in term 1. I0401 16:41:49.078660 15746 raft_consensus.cc:2640] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.079257 15746 raft_consensus.cc:667] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 1 LEADER]: Becoming Leader. State: Replica: f157b39c0d014af294d782407497c377, State: Running, Role: LEADER I0401 16:41:49.079489 15746 consensus_queue.cc:206] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } I0401 16:41:49.079630 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.001s sys 0.003s I0401 16:41:49.080298 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:49.080799 15820 sys_catalog.cc:337] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f157b39c0d014af294d782407497c377. Latest consensus state: current_term: 1 leader_uuid: "f157b39c0d014af294d782407497c377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:49.081135 15820 sys_catalog.cc:340] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: This master's current role is: LEADER I0401 16:41:49.081856 15822 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:49.083357 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.002s I0401 16:41:49.083403 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-1-root uuid: "c49eacb8125f47b5a28548c823edfbf3" format_stamp: "Formatted at 2019-04-01 23:41:49 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:49.083480 15822 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:49.083467 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:49.108723 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:49.108775 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:49.130319 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:54037 I0401 16:41:49.131268 12160 webserver.cc:308] Webserver started at http://127.11.224.2:52897/ using document root and password file I0401 16:41:49.150277 15886 heartbeater.cc:345] Connected to a master server at 127.11.224.60:32872 I0401 16:41:49.150355 15886 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.150998 15886 heartbeater.cc:475] Master 127.11.224.60:32872 requested a full tablet report, sending... I0401 16:41:49.152240 15703 ts_manager.cc:159] Registered new tserver with Master: c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.154964 15887 heartbeater.cc:345] Connected to a master server at 127.11.224.61:58736 I0401 16:41:49.155014 15887 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.155228 15887 heartbeater.cc:475] Master 127.11.224.61:58736 requested a full tablet report, sending... I0401 16:41:49.156324 15646 ts_manager.cc:159] Registered new tserver with Master: c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.158402 15656 raft_consensus.cc:1181] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 1 FOLLOWER]: Refusing update from remote peer f157b39c0d014af294d782407497c377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:49.158439 15713 raft_consensus.cc:1181] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 1 FOLLOWER]: Refusing update from remote peer f157b39c0d014af294d782407497c377: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:49.158852 15820 consensus_queue.cc:984] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:49.159032 15746 consensus_queue.cc:984] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:49.160235 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 844931us I0401 16:41:49.160432 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:49.160429 15888 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37596 I0401 16:41:49.160476 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:49.160528 15888 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.160603 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:49.160646 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:49.160738 15888 heartbeater.cc:475] Master 127.11.224.62:37596 requested a full tablet report, sending... I0401 16:41:49.161280 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "30b08c36fa41460b84546af2b84601ac" format_stamp: "Formatted at 2019-04-01 23:41:49 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:49.162681 15589 ts_manager.cc:159] Registered new tserver with Master: c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.165311 15743 sys_catalog.cc:337] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f157b39c0d014af294d782407497c377. Latest consensus state: current_term: 1 leader_uuid: "f157b39c0d014af294d782407497c377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:49.165650 15743 sys_catalog.cc:340] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:49.169716 15822 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:49.169718 15820 sys_catalog.cc:337] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f157b39c0d014af294d782407497c377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:49.169922 15820 sys_catalog.cc:340] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: This master's current role is: LEADER I0401 16:41:49.170322 15743 sys_catalog.cc:337] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f157b39c0d014af294d782407497c377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:49.170487 15743 sys_catalog.cc:340] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:49.171281 15822 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:49.171701 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.002s sys 0.005s I0401 16:41:49.172624 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:49.178211 15740 sys_catalog.cc:337] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f157b39c0d014af294d782407497c377. Latest consensus state: current_term: 1 leader_uuid: "f157b39c0d014af294d782407497c377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:49.178477 15740 sys_catalog.cc:340] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:49.180362 15820 sys_catalog.cc:337] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "f157b39c0d014af294d782407497c377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:49.180538 15820 sys_catalog.cc:340] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [sys.catalog]: This master's current role is: LEADER I0401 16:41:49.182076 12160 fs_manager.cc:419] Time spent opening block manager: real 0.006s user 0.000s sys 0.006s I0401 16:41:49.182133 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-2-root uuid: "30b08c36fa41460b84546af2b84601ac" format_stamp: "Formatted at 2019-04-01 23:41:49 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:49.182220 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshot.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:49.183565 15740 sys_catalog.cc:337] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "f157b39c0d014af294d782407497c377" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f157b39c0d014af294d782407497c377" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37596 } } peers { permanent_uuid: "c648c7b342d841319c073af14dbe36e5" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 58736 } } peers { permanent_uuid: "db81944f68db4f41a11ed545fdf4ca28" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 32872 } } } I0401 16:41:49.183836 15740 sys_catalog.cc:340] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:49.186192 15822 catalog_manager.cc:4281] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377: Generated new TSK 0 I0401 16:41:49.190438 15589 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:46327 I0401 16:41:49.197911 15589 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:46330 I0401 16:41:49.201961 15814 heartbeater.cc:467] Master 127.11.224.62:37596 was elected leader, sending a full tablet report... I0401 16:41:49.209658 15888 heartbeater.cc:467] Master 127.11.224.62:37596 was elected leader, sending a full tablet report... I0401 16:41:49.224344 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:49.224388 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:49.243896 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:58821 I0401 16:41:49.244926 12160 webserver.cc:308] Webserver started at http://127.11.224.3:51279/ using document root and password file I0401 16:41:49.255949 15965 heartbeater.cc:345] Connected to a master server at 127.11.224.60:32872 I0401 16:41:49.256024 15965 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.256196 15965 heartbeater.cc:475] Master 127.11.224.60:32872 requested a full tablet report, sending... I0401 16:41:49.256914 15702 ts_manager.cc:159] Registered new tserver with Master: 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.257266 15967 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37596 I0401 16:41:49.257329 15967 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.257464 15967 heartbeater.cc:475] Master 127.11.224.62:37596 requested a full tablet report, sending... I0401 16:41:49.258247 15589 ts_manager.cc:159] Registered new tserver with Master: 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.259454 15589 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:46333 I0401 16:41:49.260154 15966 heartbeater.cc:345] Connected to a master server at 127.11.224.61:58736 I0401 16:41:49.260216 15966 heartbeater.cc:426] Registering TS with master... I0401 16:41:49.260558 15966 heartbeater.cc:475] Master 127.11.224.61:58736 requested a full tablet report, sending... I0401 16:41:49.261467 15646 ts_manager.cc:159] Registered new tserver with Master: 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.261833 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.010634367s I0401 16:41:49.270987 15967 heartbeater.cc:467] Master 127.11.224.62:37596 was elected leader, sending a full tablet report... I0401 16:41:49.276479 15589 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.62:46334: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:49.277096 15589 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:49.306087 15776 tablet_service.cc:1006] Processing CreateTablet for tablet ce18cc20a89f4b0ea5689fa69cd2d573 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:49.306340 15773 tablet_service.cc:1006] Processing CreateTablet for tablet 326662072cb64c93be9293bdd4eb0572 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:49.306627 15776 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ce18cc20a89f4b0ea5689fa69cd2d573. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.306792 15773 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 326662072cb64c93be9293bdd4eb0572. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.306951 15779 tablet_service.cc:1006] Processing CreateTablet for tablet 49c29a4a9ce94cbcb08d3902882f3678 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:49.307245 15779 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 49c29a4a9ce94cbcb08d3902882f3678. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.309962 15778 tablet_service.cc:1006] Processing CreateTablet for tablet c4f59507e08d48648f5f94ca5e6c5276 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:49.310503 15777 tablet_service.cc:1006] Processing CreateTablet for tablet 9e9b6261342841ea8d3a1070c3e553e6 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:49.311036 15775 tablet_service.cc:1006] Processing CreateTablet for tablet 4d3a78e5d640469bacefc38d11a5c554 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:49.311576 15774 tablet_service.cc:1006] Processing CreateTablet for tablet 1d488bd237df4d8693644e766b14820f (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:49.311786 15778 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c4f59507e08d48648f5f94ca5e6c5276. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.311955 15774 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1d488bd237df4d8693644e766b14820f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.312438 15772 tablet_service.cc:1006] Processing CreateTablet for tablet 9996ab620dac4416b7773a41827de2b2 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:49.312999 15771 tablet_service.cc:1006] Processing CreateTablet for tablet 1014e6212c53450aa873880506494b22 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:49.313444 15771 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1014e6212c53450aa873880506494b22. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.314033 15932 tablet_service.cc:1006] Processing CreateTablet for tablet 49c29a4a9ce94cbcb08d3902882f3678 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:49.314695 15926 tablet_service.cc:1006] Processing CreateTablet for tablet 326662072cb64c93be9293bdd4eb0572 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:49.314750 15930 tablet_service.cc:1006] Processing CreateTablet for tablet 9e9b6261342841ea8d3a1070c3e553e6 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:49.315074 15928 tablet_service.cc:1006] Processing CreateTablet for tablet 4d3a78e5d640469bacefc38d11a5c554 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:49.315368 15777 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9e9b6261342841ea8d3a1070c3e553e6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.315299 15927 tablet_service.cc:1006] Processing CreateTablet for tablet 1d488bd237df4d8693644e766b14820f (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:49.315402 15929 tablet_service.cc:1006] Processing CreateTablet for tablet ce18cc20a89f4b0ea5689fa69cd2d573 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:49.315812 15775 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4d3a78e5d640469bacefc38d11a5c554. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.315747 15925 tablet_service.cc:1006] Processing CreateTablet for tablet 9996ab620dac4416b7773a41827de2b2 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:49.316128 15770 tablet_service.cc:1006] Processing CreateTablet for tablet d2920637aa6b4c3c8a9ecf286fd9792e (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:49.316377 15931 tablet_service.cc:1006] Processing CreateTablet for tablet c4f59507e08d48648f5f94ca5e6c5276 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:49.316697 15932 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 49c29a4a9ce94cbcb08d3902882f3678. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.316968 15924 tablet_service.cc:1006] Processing CreateTablet for tablet 1014e6212c53450aa873880506494b22 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:49.317328 15924 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1014e6212c53450aa873880506494b22. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.317924 15928 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4d3a78e5d640469bacefc38d11a5c554. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.318410 15926 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 326662072cb64c93be9293bdd4eb0572. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.316462 15770 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d2920637aa6b4c3c8a9ecf286fd9792e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.319916 15927 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1d488bd237df4d8693644e766b14820f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.321063 15923 tablet_service.cc:1006] Processing CreateTablet for tablet d2920637aa6b4c3c8a9ecf286fd9792e (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:49.321403 15923 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d2920637aa6b4c3c8a9ecf286fd9792e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.322865 15925 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9996ab620dac4416b7773a41827de2b2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.325440 15930 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9e9b6261342841ea8d3a1070c3e553e6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.326239 15772 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9996ab620dac4416b7773a41827de2b2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.329789 15929 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ce18cc20a89f4b0ea5689fa69cd2d573. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.334519 15931 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c4f59507e08d48648f5f94ca5e6c5276. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.345438 15986 tablet_bootstrap.cc:439] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.345680 15985 tablet_bootstrap.cc:439] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.346973 15985 tablet_bootstrap.cc:590] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.347646 15986 tablet_bootstrap.cc:590] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.348124 15853 tablet_service.cc:1006] Processing CreateTablet for tablet 49c29a4a9ce94cbcb08d3902882f3678 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:49.348590 15853 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 49c29a4a9ce94cbcb08d3902882f3678. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.348688 15848 tablet_service.cc:1006] Processing CreateTablet for tablet 1d488bd237df4d8693644e766b14820f (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:49.349028 15851 tablet_service.cc:1006] Processing CreateTablet for tablet 9e9b6261342841ea8d3a1070c3e553e6 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:49.349172 15845 tablet_service.cc:1006] Processing CreateTablet for tablet 1014e6212c53450aa873880506494b22 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:49.349189 15852 tablet_service.cc:1006] Processing CreateTablet for tablet c4f59507e08d48648f5f94ca5e6c5276 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:49.349386 15851 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9e9b6261342841ea8d3a1070c3e553e6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.349565 15846 tablet_service.cc:1006] Processing CreateTablet for tablet 9996ab620dac4416b7773a41827de2b2 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:49.349845 15846 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9996ab620dac4416b7773a41827de2b2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.351791 15850 tablet_service.cc:1006] Processing CreateTablet for tablet ce18cc20a89f4b0ea5689fa69cd2d573 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:49.352277 15849 tablet_service.cc:1006] Processing CreateTablet for tablet 4d3a78e5d640469bacefc38d11a5c554 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:49.352723 15847 tablet_service.cc:1006] Processing CreateTablet for tablet 326662072cb64c93be9293bdd4eb0572 (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:49.353013 15844 tablet_service.cc:1006] Processing CreateTablet for tablet d2920637aa6b4c3c8a9ecf286fd9792e (table=ksck-test-table [id=9b8e2e4d920f451f816980bb93c4e002]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:49.354290 15845 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1014e6212c53450aa873880506494b22. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.359300 15852 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c4f59507e08d48648f5f94ca5e6c5276. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.360750 15850 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ce18cc20a89f4b0ea5689fa69cd2d573. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.363459 15849 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4d3a78e5d640469bacefc38d11a5c554. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.365435 15844 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d2920637aa6b4c3c8a9ecf286fd9792e. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.366616 15847 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 326662072cb64c93be9293bdd4eb0572. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.368734 15848 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1d488bd237df4d8693644e766b14820f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:49.386977 15989 tablet_bootstrap.cc:439] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.388381 15989 tablet_bootstrap.cc:590] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.388525 15985 tablet_bootstrap.cc:439] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.388662 15985 ts_tablet_manager.cc:1053] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.023s I0401 16:41:49.389406 15985 raft_consensus.cc:340] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.389649 15985 raft_consensus.cc:366] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.389708 15985 raft_consensus.cc:705] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.390069 15985 consensus_queue.cc:229] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.390961 15986 tablet_bootstrap.cc:439] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.391103 15986 ts_tablet_manager.cc:1053] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.046s user 0.004s sys 0.015s I0401 16:41:49.391705 15985 ts_tablet_manager.cc:1081] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:49.391949 15985 tablet_bootstrap.cc:439] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.393831 15985 tablet_bootstrap.cc:590] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.394987 15986 raft_consensus.cc:340] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.395121 15986 raft_consensus.cc:366] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.395172 15986 raft_consensus.cc:705] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.395272 15989 tablet_bootstrap.cc:439] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.395364 15989 ts_tablet_manager.cc:1053] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.005s I0401 16:41:49.395509 15986 consensus_queue.cc:229] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.395992 15989 raft_consensus.cc:340] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.396164 15989 raft_consensus.cc:366] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.396199 15989 raft_consensus.cc:705] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.396365 15985 tablet_bootstrap.cc:439] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.396450 15985 ts_tablet_manager.cc:1053] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:49.396342 15989 consensus_queue.cc:229] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.397033 15985 raft_consensus.cc:340] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.397210 15985 raft_consensus.cc:366] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.397265 15985 raft_consensus.cc:705] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.397431 15985 consensus_queue.cc:229] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.399269 15985 ts_tablet_manager.cc:1081] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:49.399500 15985 tablet_bootstrap.cc:439] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.401019 15985 tablet_bootstrap.cc:590] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.402230 15986 ts_tablet_manager.cc:1081] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.011s user 0.001s sys 0.001s I0401 16:41:49.402863 15989 ts_tablet_manager.cc:1081] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.007s user 0.001s sys 0.003s I0401 16:41:49.403105 15989 tablet_bootstrap.cc:439] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.404474 15989 tablet_bootstrap.cc:590] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.405755 15986 tablet_bootstrap.cc:439] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.407143 15986 tablet_bootstrap.cc:590] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.408807 15985 tablet_bootstrap.cc:439] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.408926 15985 ts_tablet_manager.cc:1053] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.005s I0401 16:41:49.409238 15989 tablet_bootstrap.cc:439] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.409238 15986 tablet_bootstrap.cc:439] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.409380 15986 ts_tablet_manager.cc:1053] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0401 16:41:49.409380 15989 ts_tablet_manager.cc:1053] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s I0401 16:41:49.409426 15985 raft_consensus.cc:340] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.409538 15985 raft_consensus.cc:366] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.409556 15985 raft_consensus.cc:705] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.409682 15985 consensus_queue.cc:229] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.410018 15986 raft_consensus.cc:340] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.410188 15986 raft_consensus.cc:366] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.410224 15986 raft_consensus.cc:705] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.410140 15985 ts_tablet_manager.cc:1081] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:49.410352 15986 consensus_queue.cc:229] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.410615 15985 tablet_bootstrap.cc:439] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.410768 15986 ts_tablet_manager.cc:1081] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:49.410982 15986 tablet_bootstrap.cc:439] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.411936 15985 tablet_bootstrap.cc:590] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.412405 15986 tablet_bootstrap.cc:590] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.413117 15989 raft_consensus.cc:340] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.413280 15989 raft_consensus.cc:366] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.413311 15989 raft_consensus.cc:705] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.416162 15989 consensus_queue.cc:229] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.416612 15986 tablet_bootstrap.cc:439] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.416718 15986 ts_tablet_manager.cc:1053] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s I0401 16:41:49.417742 15989 ts_tablet_manager.cc:1081] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.008s user 0.000s sys 0.002s I0401 16:41:49.418013 15989 tablet_bootstrap.cc:439] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.418221 15986 raft_consensus.cc:340] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.418385 15986 raft_consensus.cc:366] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.418447 15986 raft_consensus.cc:705] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.418624 15986 consensus_queue.cc:229] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.419849 15986 ts_tablet_manager.cc:1081] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:49.420078 15986 tablet_bootstrap.cc:439] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.420157 15989 tablet_bootstrap.cc:590] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.422504 15986 tablet_bootstrap.cc:590] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.423183 15985 tablet_bootstrap.cc:439] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.423342 15985 ts_tablet_manager.cc:1053] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.003s I0401 16:41:49.424165 15985 raft_consensus.cc:340] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.424389 15985 raft_consensus.cc:366] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.424456 15985 raft_consensus.cc:705] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.424690 15986 tablet_bootstrap.cc:439] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.424793 15986 ts_tablet_manager.cc:1053] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:49.424669 15985 consensus_queue.cc:229] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.425405 15986 raft_consensus.cc:340] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.425560 15986 raft_consensus.cc:366] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.425592 15986 raft_consensus.cc:705] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.425729 15986 consensus_queue.cc:229] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.425988 15985 ts_tablet_manager.cc:1081] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:49.426271 15986 ts_tablet_manager.cc:1081] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:49.426476 15986 tablet_bootstrap.cc:439] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.426949 15985 tablet_bootstrap.cc:439] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.428007 15985 tablet_bootstrap.cc:590] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.427819 15986 tablet_bootstrap.cc:590] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.432202 15989 tablet_bootstrap.cc:439] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.432327 15989 ts_tablet_manager.cc:1053] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.001s I0401 16:41:49.433019 15989 raft_consensus.cc:340] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.433178 15989 raft_consensus.cc:366] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.433204 15989 raft_consensus.cc:705] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.433342 15989 consensus_queue.cc:229] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.433815 15989 ts_tablet_manager.cc:1081] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:49.434059 15989 tablet_bootstrap.cc:439] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.435350 15989 tablet_bootstrap.cc:590] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.437050 15989 tablet_bootstrap.cc:439] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.437146 15989 ts_tablet_manager.cc:1053] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:49.437196 15985 tablet_bootstrap.cc:439] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.437294 15985 ts_tablet_manager.cc:1053] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.000s I0401 16:41:49.437697 15989 raft_consensus.cc:340] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.437829 15989 raft_consensus.cc:366] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.437850 15989 raft_consensus.cc:705] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.437779 15985 raft_consensus.cc:340] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.437981 15985 raft_consensus.cc:366] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.438050 15985 raft_consensus.cc:705] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.437985 15989 consensus_queue.cc:229] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.438190 15986 tablet_bootstrap.cc:439] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.438309 15986 ts_tablet_manager.cc:1053] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.004s I0401 16:41:49.438266 15985 consensus_queue.cc:229] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.439292 15986 raft_consensus.cc:340] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.439491 15986 raft_consensus.cc:366] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.439563 15986 raft_consensus.cc:705] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.439596 15985 ts_tablet_manager.cc:1081] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:49.439800 15986 consensus_queue.cc:229] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.440971 15986 ts_tablet_manager.cc:1081] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:49.441540 15986 tablet_bootstrap.cc:439] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.441546 15985 tablet_bootstrap.cc:439] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.442931 15986 tablet_bootstrap.cc:590] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.442996 15985 tablet_bootstrap.cc:590] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.445791 15989 ts_tablet_manager.cc:1081] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s I0401 16:41:49.446084 15989 tablet_bootstrap.cc:439] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.447299 15989 tablet_bootstrap.cc:590] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.448664 15989 tablet_bootstrap.cc:439] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.448839 15989 ts_tablet_manager.cc:1053] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:49.449352 15989 raft_consensus.cc:340] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.449474 15989 raft_consensus.cc:366] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.449543 15989 raft_consensus.cc:705] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.449717 15989 consensus_queue.cc:229] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.450037 15986 tablet_bootstrap.cc:439] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.450124 15986 ts_tablet_manager.cc:1053] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.006s I0401 16:41:49.450539 15986 raft_consensus.cc:340] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.450692 15986 raft_consensus.cc:366] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.450722 15986 raft_consensus.cc:705] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.450896 15989 ts_tablet_manager.cc:1081] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:49.450846 15986 consensus_queue.cc:229] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.451092 15989 tablet_bootstrap.cc:439] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.451326 15986 ts_tablet_manager.cc:1081] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s I0401 16:41:49.451525 15986 tablet_bootstrap.cc:439] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.451809 15985 tablet_bootstrap.cc:439] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.451925 15985 ts_tablet_manager.cc:1053] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.006s I0401 16:41:49.452219 15989 tablet_bootstrap.cc:590] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.452471 15985 raft_consensus.cc:340] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.452625 15985 raft_consensus.cc:366] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.452653 15985 raft_consensus.cc:705] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.452733 15986 tablet_bootstrap.cc:590] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.453285 15985 consensus_queue.cc:229] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.458834 15985 ts_tablet_manager.cc:1081] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s I0401 16:41:49.459055 15985 tablet_bootstrap.cc:439] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.460155 15985 tablet_bootstrap.cc:590] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.462350 15985 tablet_bootstrap.cc:439] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.462350 15989 tablet_bootstrap.cc:439] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.462450 15985 ts_tablet_manager.cc:1053] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s I0401 16:41:49.462455 15989 ts_tablet_manager.cc:1053] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.005s I0401 16:41:49.463065 15989 raft_consensus.cc:340] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.463234 15986 tablet_bootstrap.cc:439] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.463060 15985 raft_consensus.cc:340] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.463326 15985 raft_consensus.cc:366] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.463363 15986 ts_tablet_manager.cc:1053] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s I0401 16:41:49.463362 15985 raft_consensus.cc:705] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.463253 15989 raft_consensus.cc:366] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.463456 15989 raft_consensus.cc:705] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.463608 15989 consensus_queue.cc:229] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.464031 15986 raft_consensus.cc:340] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.464131 15985 consensus_queue.cc:229] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.464232 15986 raft_consensus.cc:366] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.464380 15986 raft_consensus.cc:705] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.464586 15986 consensus_queue.cc:229] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.466284 15986 ts_tablet_manager.cc:1081] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:49.466522 15986 tablet_bootstrap.cc:439] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.469244 15986 tablet_bootstrap.cc:590] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.469422 15985 ts_tablet_manager.cc:1081] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s I0401 16:41:49.469660 15985 tablet_bootstrap.cc:439] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.470194 15989 ts_tablet_manager.cc:1081] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s I0401 16:41:49.470436 15989 tablet_bootstrap.cc:439] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.470962 15985 tablet_bootstrap.cc:590] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.471369 15989 tablet_bootstrap.cc:590] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.473013 15986 tablet_bootstrap.cc:439] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.473059 15985 tablet_bootstrap.cc:439] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.473124 15986 ts_tablet_manager.cc:1053] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s I0401 16:41:49.473136 15985 ts_tablet_manager.cc:1053] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:49.473577 15986 raft_consensus.cc:340] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.473598 15985 raft_consensus.cc:340] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.473690 15986 raft_consensus.cc:366] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.473729 15986 raft_consensus.cc:705] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.473698 15985 raft_consensus.cc:366] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.473846 15993 raft_consensus.cc:472] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.473927 15985 raft_consensus.cc:705] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.473888 15986 consensus_queue.cc:229] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.473984 15993 raft_consensus.cc:494] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.474099 15985 consensus_queue.cc:229] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.474844 15993 leader_election.cc:296] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.478127 15986 ts_tablet_manager.cc:1081] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.005s user 0.001s sys 0.002s I0401 16:41:49.478382 15986 tablet_bootstrap.cc:439] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.479604 15986 tablet_bootstrap.cc:590] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.482404 15789 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d488bd237df4d8693644e766b14820f" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.482667 15789 raft_consensus.cc:2346] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.483101 15985 ts_tablet_manager.cc:1081] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s I0401 16:41:49.483194 15989 tablet_bootstrap.cc:439] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.483333 15989 ts_tablet_manager.cc:1053] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.000s I0401 16:41:49.483345 15903 leader_election.cc:310] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517; no voters: I0401 16:41:49.483427 15985 tablet_bootstrap.cc:439] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.483686 16014 raft_consensus.cc:2640] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.483741 16014 raft_consensus.cc:472] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.483853 16014 raft_consensus.cc:2886] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.484230 15989 raft_consensus.cc:340] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.484449 15989 raft_consensus.cc:366] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.484519 15989 raft_consensus.cc:705] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.484699 15989 consensus_queue.cc:229] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.485008 15985 tablet_bootstrap.cc:590] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.485946 15989 ts_tablet_manager.cc:1081] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s I0401 16:41:49.486176 15989 tablet_bootstrap.cc:439] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.487579 15989 tablet_bootstrap.cc:590] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.487825 16014 raft_consensus.cc:494] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.488636 16014 leader_election.cc:296] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Requested vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.488489 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d488bd237df4d8693644e766b14820f" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" is_pre_election: true I0401 16:41:49.489127 15986 tablet_bootstrap.cc:439] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.489264 15986 ts_tablet_manager.cc:1053] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.000s I0401 16:41:49.489338 15789 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d488bd237df4d8693644e766b14820f" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.489464 15789 raft_consensus.cc:2886] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 W0401 16:41:49.489634 15906 leader_election.cc:348] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:49.490803 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d488bd237df4d8693644e766b14820f" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" I0401 16:41:49.490928 15986 raft_consensus.cc:340] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.491084 15986 raft_consensus.cc:366] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.491118 15986 raft_consensus.cc:705] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER W0401 16:41:49.491334 15906 leader_election.cc:348] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:49.491400 15986 consensus_queue.cc:229] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.491633 15789 raft_consensus.cc:2346] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.492036 15903 leader_election.cc:310] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517; no voters: c49eacb8125f47b5a28548c823edfbf3 I0401 16:41:49.492352 15993 raft_consensus.cc:2640] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.494287 15986 ts_tablet_manager.cc:1081] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s I0401 16:41:49.494398 15993 raft_consensus.cc:667] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Becoming Leader. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Running, Role: LEADER I0401 16:41:49.494587 15986 tablet_bootstrap.cc:439] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac: Bootstrap starting. I0401 16:41:49.494596 15993 consensus_queue.cc:206] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.495966 15986 tablet_bootstrap.cc:590] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac: No blocks or log segments found. Creating new log. I0401 16:41:49.497140 15985 tablet_bootstrap.cc:439] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.497294 15985 ts_tablet_manager.cc:1053] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.014s user 0.000s sys 0.006s I0401 16:41:49.497902 15985 raft_consensus.cc:340] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.498078 15985 raft_consensus.cc:366] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.498140 15985 raft_consensus.cc:705] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.498327 15985 consensus_queue.cc:229] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.499790 15985 ts_tablet_manager.cc:1081] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:49.500028 15985 tablet_bootstrap.cc:439] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517: Bootstrap starting. I0401 16:41:49.497320 15588 catalog_manager.cc:3977] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac reported cstate change: term changed from 0 to 1, leader changed from to 30b08c36fa41460b84546af2b84601ac (127.11.224.3). New cstate: current_term: 1 leader_uuid: "30b08c36fa41460b84546af2b84601ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: HEALTHY } } } I0401 16:41:49.503971 15985 tablet_bootstrap.cc:590] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517: No blocks or log segments found. Creating new log. I0401 16:41:49.506177 15986 tablet_bootstrap.cc:439] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac: No bootstrap required, opened a new log I0401 16:41:49.506321 15986 ts_tablet_manager.cc:1053] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.001s I0401 16:41:49.506798 15989 tablet_bootstrap.cc:439] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.506963 15989 ts_tablet_manager.cc:1053] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.009s I0401 16:41:49.507357 15986 raft_consensus.cc:340] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.507477 15986 raft_consensus.cc:366] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.507513 15986 raft_consensus.cc:705] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Initialized, Role: FOLLOWER I0401 16:41:49.507527 15989 raft_consensus.cc:340] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.507661 15989 raft_consensus.cc:366] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.507694 15989 raft_consensus.cc:705] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.507644 15986 consensus_queue.cc:229] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.507818 15989 consensus_queue.cc:229] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.508116 15986 ts_tablet_manager.cc:1081] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:49.509105 15989 ts_tablet_manager.cc:1081] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:49.510510 15989 tablet_bootstrap.cc:439] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.510599 15985 tablet_bootstrap.cc:439] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517: No bootstrap required, opened a new log I0401 16:41:49.510694 15985 ts_tablet_manager.cc:1053] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.002s I0401 16:41:49.511402 15985 raft_consensus.cc:340] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.511512 15985 raft_consensus.cc:366] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.511540 15985 raft_consensus.cc:705] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Initialized, Role: FOLLOWER I0401 16:41:49.511739 15985 consensus_queue.cc:229] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.511991 15989 tablet_bootstrap.cc:590] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.512167 15985 ts_tablet_manager.cc:1081] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:49.514376 15989 tablet_bootstrap.cc:439] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.514468 15989 ts_tablet_manager.cc:1053] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s I0401 16:41:49.514969 15989 raft_consensus.cc:340] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.515147 15989 raft_consensus.cc:366] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.515182 15989 raft_consensus.cc:705] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.515329 15989 consensus_queue.cc:229] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.515640 15989 ts_tablet_manager.cc:1081] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0401 16:41:49.515882 15989 tablet_bootstrap.cc:439] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3: Bootstrap starting. I0401 16:41:49.517364 15989 tablet_bootstrap.cc:590] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3: No blocks or log segments found. Creating new log. I0401 16:41:49.518707 15989 tablet_bootstrap.cc:439] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3: No bootstrap required, opened a new log I0401 16:41:49.518815 15989 ts_tablet_manager.cc:1053] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s I0401 16:41:49.519222 15989 raft_consensus.cc:340] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.519332 15989 raft_consensus.cc:366] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:49.519361 15989 raft_consensus.cc:705] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Initialized, Role: FOLLOWER I0401 16:41:49.519510 15989 consensus_queue.cc:229] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.519937 15989 ts_tablet_manager.cc:1081] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:49.521505 15991 raft_consensus.cc:472] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.521677 15991 raft_consensus.cc:494] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.522333 15991 leader_election.cc:296] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.528720 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ce18cc20a89f4b0ea5689fa69cd2d573" candidate_uuid: "c389c480349f4579bf5e70301b6d4517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" is_pre_election: true I0401 16:41:49.528931 15942 raft_consensus.cc:2346] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c389c480349f4579bf5e70301b6d4517 in term 0. I0401 16:41:49.529359 15753 leader_election.cc:310] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517; no voters: I0401 16:41:49.529598 15991 raft_consensus.cc:2640] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.529642 15991 raft_consensus.cc:472] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.529688 15991 raft_consensus.cc:2886] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.529989 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ce18cc20a89f4b0ea5689fa69cd2d573" candidate_uuid: "c389c480349f4579bf5e70301b6d4517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" is_pre_election: true I0401 16:41:49.530124 15863 raft_consensus.cc:2346] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c389c480349f4579bf5e70301b6d4517 in term 0. I0401 16:41:49.531388 15991 raft_consensus.cc:494] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.531949 15991 leader_election.cc:296] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [CANDIDATE]: Term 1 election: Requested vote from peers c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.532327 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ce18cc20a89f4b0ea5689fa69cd2d573" candidate_uuid: "c389c480349f4579bf5e70301b6d4517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" I0401 16:41:49.532470 15863 raft_consensus.cc:2886] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.532990 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ce18cc20a89f4b0ea5689fa69cd2d573" candidate_uuid: "c389c480349f4579bf5e70301b6d4517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" I0401 16:41:49.533103 15942 raft_consensus.cc:2886] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.534286 15863 raft_consensus.cc:2346] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c389c480349f4579bf5e70301b6d4517 in term 1. I0401 16:41:49.534402 15942 raft_consensus.cc:2346] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c389c480349f4579bf5e70301b6d4517 in term 1. I0401 16:41:49.534548 15753 leader_election.cc:310] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c389c480349f4579bf5e70301b6d4517, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.534873 15991 raft_consensus.cc:2640] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.535677 15991 raft_consensus.cc:667] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 1 LEADER]: Becoming Leader. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Running, Role: LEADER I0401 16:41:49.536041 15991 consensus_queue.cc:206] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.538756 15588 catalog_manager.cc:3977] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 reported cstate change: term changed from 0 to 1, leader changed from to c389c480349f4579bf5e70301b6d4517 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "c389c480349f4579bf5e70301b6d4517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: UNKNOWN } } } I0401 16:41:49.539216 15994 raft_consensus.cc:472] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.539299 15994 raft_consensus.cc:494] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.539813 15994 leader_election.cc:296] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.547202 15789 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9e9b6261342841ea8d3a1070c3e553e6" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.547346 15789 raft_consensus.cc:2346] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 0. I0401 16:41:49.547540 16014 raft_consensus.cc:472] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.547631 15824 leader_election.cc:310] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c389c480349f4579bf5e70301b6d4517, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.547622 16014 raft_consensus.cc:494] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.547852 15994 raft_consensus.cc:2640] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.547894 15994 raft_consensus.cc:472] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.547942 15994 raft_consensus.cc:2886] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.548504 15789 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9e9b6261342841ea8d3a1070c3e553e6" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.548627 15789 raft_consensus.cc:2346] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.548720 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9e9b6261342841ea8d3a1070c3e553e6" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" is_pre_election: true I0401 16:41:49.548852 15942 raft_consensus.cc:2346] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 0. I0401 16:41:49.549051 16014 leader_election.cc:296] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.549170 15903 leader_election.cc:310] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517; no voters: I0401 16:41:49.549229 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9e9b6261342841ea8d3a1070c3e553e6" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" is_pre_election: true I0401 16:41:49.549412 15993 raft_consensus.cc:2640] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.549454 15993 raft_consensus.cc:472] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.549500 15993 raft_consensus.cc:2886] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.549958 15994 raft_consensus.cc:494] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.550323 15863 raft_consensus.cc:2276] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 30b08c36fa41460b84546af2b84601ac in current term 1: Already voted for candidate c49eacb8125f47b5a28548c823edfbf3 in this term. I0401 16:41:49.550547 15994 leader_election.cc:296] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 election: Requested vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.551124 15789 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9e9b6261342841ea8d3a1070c3e553e6" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.551208 15789 raft_consensus.cc:2886] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.551317 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9e9b6261342841ea8d3a1070c3e553e6" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" I0401 16:41:49.551551 15993 raft_consensus.cc:494] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.551776 15942 raft_consensus.cc:2276] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c49eacb8125f47b5a28548c823edfbf3 in current term 1: Already voted for candidate 30b08c36fa41460b84546af2b84601ac in this term. I0401 16:41:49.552094 15993 leader_election.cc:296] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Requested vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.552533 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9e9b6261342841ea8d3a1070c3e553e6" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" I0401 16:41:49.552624 15789 raft_consensus.cc:2346] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 1. I0401 16:41:49.552661 15863 raft_consensus.cc:2276] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 30b08c36fa41460b84546af2b84601ac in current term 1: Already voted for candidate c49eacb8125f47b5a28548c823edfbf3 in this term. I0401 16:41:49.552544 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9e9b6261342841ea8d3a1070c3e553e6" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.552805 15788 raft_consensus.cc:2276] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 30b08c36fa41460b84546af2b84601ac in current term 1: Already voted for candidate c49eacb8125f47b5a28548c823edfbf3 in this term. I0401 16:41:49.553154 15903 leader_election.cc:310] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac; no voters: c389c480349f4579bf5e70301b6d4517, c49eacb8125f47b5a28548c823edfbf3 I0401 16:41:49.553153 15824 leader_election.cc:310] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c389c480349f4579bf5e70301b6d4517, c49eacb8125f47b5a28548c823edfbf3; no voters: 30b08c36fa41460b84546af2b84601ac I0401 16:41:49.553386 15994 raft_consensus.cc:2640] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.553464 15993 raft_consensus.cc:2588] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority I0401 16:41:49.553841 15994 raft_consensus.cc:667] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 1 LEADER]: Becoming Leader. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Running, Role: LEADER I0401 16:41:49.554026 15994 consensus_queue.cc:206] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.554677 16026 raft_consensus.cc:472] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.554754 16026 raft_consensus.cc:494] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.555312 16026 leader_election.cc:296] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.555773 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9996ab620dac4416b7773a41827de2b2" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" is_pre_election: true I0401 16:41:49.555907 15942 raft_consensus.cc:2346] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 0. I0401 16:41:49.556190 15827 leader_election.cc:310] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.556387 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9996ab620dac4416b7773a41827de2b2" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.556525 15788 raft_consensus.cc:2346] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 0. I0401 16:41:49.557304 15589 catalog_manager.cc:3977] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 reported cstate change: term changed from 0 to 1, leader changed from to c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "c49eacb8125f47b5a28548c823edfbf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: UNKNOWN } } } I0401 16:41:49.558200 15994 raft_consensus.cc:2640] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.558269 15994 raft_consensus.cc:472] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.558346 15994 raft_consensus.cc:2886] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.560724 15994 raft_consensus.cc:494] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.562772 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9996ab620dac4416b7773a41827de2b2" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.562911 15788 raft_consensus.cc:2886] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.563038 15994 leader_election.cc:296] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 election: Requested vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.563127 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9996ab620dac4416b7773a41827de2b2" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" I0401 16:41:49.563239 15942 raft_consensus.cc:2886] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.564752 15788 raft_consensus.cc:2346] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 1. I0401 16:41:49.564766 15942 raft_consensus.cc:2346] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 1. I0401 16:41:49.565013 15824 leader_election.cc:310] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c389c480349f4579bf5e70301b6d4517, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.565243 15994 raft_consensus.cc:2640] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.565352 15994 raft_consensus.cc:667] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 1 LEADER]: Becoming Leader. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Running, Role: LEADER I0401 16:41:49.565526 15994 consensus_queue.cc:206] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.568097 15589 catalog_manager.cc:3977] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 reported cstate change: term changed from 0 to 1, leader changed from to c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "c49eacb8125f47b5a28548c823edfbf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: UNKNOWN } } } I0401 16:41:49.573530 15994 raft_consensus.cc:472] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.573616 15994 raft_consensus.cc:494] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.574529 15994 leader_election.cc:296] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.574805 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d488bd237df4d8693644e766b14820f" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.574957 15788 raft_consensus.cc:2276] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c49eacb8125f47b5a28548c823edfbf3 in current term 1: Already voted for candidate 30b08c36fa41460b84546af2b84601ac in this term. I0401 16:41:49.574913 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1d488bd237df4d8693644e766b14820f" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" is_pre_election: true I0401 16:41:49.575054 15942 raft_consensus.cc:2307] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate c49eacb8125f47b5a28548c823edfbf3 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:49.575388 15827 leader_election.cc:310] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c49eacb8125f47b5a28548c823edfbf3; no voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517 I0401 16:41:49.575574 15994 raft_consensus.cc:2886] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.576869 15994 raft_consensus.cc:2588] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:49.612001 15991 raft_consensus.cc:472] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.612123 15991 raft_consensus.cc:494] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.612876 15991 leader_election.cc:296] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.613265 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c4f59507e08d48648f5f94ca5e6c5276" candidate_uuid: "c389c480349f4579bf5e70301b6d4517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" is_pre_election: true I0401 16:41:49.613265 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c4f59507e08d48648f5f94ca5e6c5276" candidate_uuid: "c389c480349f4579bf5e70301b6d4517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" is_pre_election: true I0401 16:41:49.613445 15942 raft_consensus.cc:2346] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c389c480349f4579bf5e70301b6d4517 in term 0. I0401 16:41:49.613456 15863 raft_consensus.cc:2346] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c389c480349f4579bf5e70301b6d4517 in term 0. I0401 16:41:49.613762 15753 leader_election.cc:310] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c389c480349f4579bf5e70301b6d4517, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.613993 15991 raft_consensus.cc:2640] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.614034 15991 raft_consensus.cc:472] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.614079 15991 raft_consensus.cc:2886] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.615993 15991 raft_consensus.cc:494] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.616704 15991 leader_election.cc:296] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [CANDIDATE]: Term 1 election: Requested vote from peers c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037), 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821) I0401 16:41:49.617111 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c4f59507e08d48648f5f94ca5e6c5276" candidate_uuid: "c389c480349f4579bf5e70301b6d4517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" I0401 16:41:49.617230 15863 raft_consensus.cc:2886] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.617275 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c4f59507e08d48648f5f94ca5e6c5276" candidate_uuid: "c389c480349f4579bf5e70301b6d4517" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" I0401 16:41:49.617403 15942 raft_consensus.cc:2886] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.619366 15942 raft_consensus.cc:2346] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c389c480349f4579bf5e70301b6d4517 in term 1. I0401 16:41:49.619441 15863 raft_consensus.cc:2346] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c389c480349f4579bf5e70301b6d4517 in term 1. I0401 16:41:49.619644 15753 leader_election.cc:310] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517; no voters: I0401 16:41:49.619839 15994 raft_consensus.cc:472] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.619879 15991 raft_consensus.cc:2640] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.620026 15991 raft_consensus.cc:667] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 1 LEADER]: Becoming Leader. State: Replica: c389c480349f4579bf5e70301b6d4517, State: Running, Role: LEADER I0401 16:41:49.619980 15994 raft_consensus.cc:494] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.620453 15991 consensus_queue.cc:206] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.620607 15994 leader_election.cc:296] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821), c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095) I0401 16:41:49.620936 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "49c29a4a9ce94cbcb08d3902882f3678" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.621047 15788 raft_consensus.cc:2346] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 0. I0401 16:41:49.621126 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "49c29a4a9ce94cbcb08d3902882f3678" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" is_pre_election: true I0401 16:41:49.621294 15824 leader_election.cc:310] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c389c480349f4579bf5e70301b6d4517, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.621399 15942 raft_consensus.cc:2346] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 0. I0401 16:41:49.621595 15994 raft_consensus.cc:2640] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.621631 15994 raft_consensus.cc:472] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.621744 15994 raft_consensus.cc:2886] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.622619 15588 catalog_manager.cc:3977] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 reported cstate change: term changed from 0 to 1, leader changed from to c389c480349f4579bf5e70301b6d4517 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "c389c480349f4579bf5e70301b6d4517" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: UNKNOWN } } } I0401 16:41:49.625741 15994 raft_consensus.cc:494] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.628391 15942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "49c29a4a9ce94cbcb08d3902882f3678" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30b08c36fa41460b84546af2b84601ac" I0401 16:41:49.628584 15942 raft_consensus.cc:2886] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.629113 15994 leader_election.cc:296] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 election: Requested vote from peers 30b08c36fa41460b84546af2b84601ac (127.11.224.3:58821), c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095) I0401 16:41:49.629679 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "49c29a4a9ce94cbcb08d3902882f3678" candidate_uuid: "c49eacb8125f47b5a28548c823edfbf3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.629822 15788 raft_consensus.cc:2886] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.631408 15942 raft_consensus.cc:2346] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 1. I0401 16:41:49.631780 15827 leader_election.cc:310] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.632092 15788 raft_consensus.cc:2346] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c49eacb8125f47b5a28548c823edfbf3 in term 1. I0401 16:41:49.632105 15994 raft_consensus.cc:2640] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.632237 15994 raft_consensus.cc:667] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 1 LEADER]: Becoming Leader. State: Replica: c49eacb8125f47b5a28548c823edfbf3, State: Running, Role: LEADER I0401 16:41:49.632694 15994 consensus_queue.cc:206] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } I0401 16:41:49.635470 15589 catalog_manager.cc:3977] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 reported cstate change: term changed from 0 to 1, leader changed from to c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "c49eacb8125f47b5a28548c823edfbf3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: UNKNOWN } } } I0401 16:41:49.660729 15993 raft_consensus.cc:472] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.660883 15993 raft_consensus.cc:494] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.661671 15993 leader_election.cc:296] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.662200 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d2920637aa6b4c3c8a9ecf286fd9792e" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.662384 15788 raft_consensus.cc:2346] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.662812 15903 leader_election.cc:310] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517; no voters: I0401 16:41:49.662977 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d2920637aa6b4c3c8a9ecf286fd9792e" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" is_pre_election: true I0401 16:41:49.663110 15863 raft_consensus.cc:2346] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.663157 15993 raft_consensus.cc:2640] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.663203 15993 raft_consensus.cc:472] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.663255 15993 raft_consensus.cc:2886] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.665382 15993 raft_consensus.cc:494] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.665982 15993 leader_election.cc:296] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Requested vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.666311 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d2920637aa6b4c3c8a9ecf286fd9792e" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.666352 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d2920637aa6b4c3c8a9ecf286fd9792e" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" I0401 16:41:49.666422 15788 raft_consensus.cc:2886] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.666455 15863 raft_consensus.cc:2886] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.667743 15863 raft_consensus.cc:2346] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.667868 15788 raft_consensus.cc:2346] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.668129 15903 leader_election.cc:310] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517; no voters: I0401 16:41:49.668406 15993 raft_consensus.cc:2640] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.668537 15993 raft_consensus.cc:667] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Becoming Leader. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Running, Role: LEADER I0401 16:41:49.668781 15993 consensus_queue.cc:206] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.671444 15589 catalog_manager.cc:3977] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac reported cstate change: term changed from 0 to 1, leader changed from to 30b08c36fa41460b84546af2b84601ac (127.11.224.3). New cstate: current_term: 1 leader_uuid: "30b08c36fa41460b84546af2b84601ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: HEALTHY } } } I0401 16:41:49.704840 15993 raft_consensus.cc:472] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.705029 15993 raft_consensus.cc:494] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.705565 15993 leader_election.cc:296] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037), c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095) I0401 16:41:49.705873 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4d3a78e5d640469bacefc38d11a5c554" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" is_pre_election: true I0401 16:41:49.705885 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4d3a78e5d640469bacefc38d11a5c554" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.705999 15863 raft_consensus.cc:2346] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.706019 15788 raft_consensus.cc:2346] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.706248 15906 leader_election.cc:310] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.706447 15993 raft_consensus.cc:2640] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.706488 15993 raft_consensus.cc:472] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.706542 15993 raft_consensus.cc:2886] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.708575 15993 raft_consensus.cc:494] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.709367 15993 leader_election.cc:296] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Requested vote from peers c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037), c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095) I0401 16:41:49.709520 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4d3a78e5d640469bacefc38d11a5c554" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" I0401 16:41:49.709616 15863 raft_consensus.cc:2886] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.709710 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4d3a78e5d640469bacefc38d11a5c554" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.709818 15788 raft_consensus.cc:2886] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.711225 15863 raft_consensus.cc:2346] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.711482 15906 leader_election.cc:310] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.711522 15788 raft_consensus.cc:2346] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.711688 15993 raft_consensus.cc:2640] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.711777 15993 raft_consensus.cc:667] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Becoming Leader. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Running, Role: LEADER I0401 16:41:49.712075 15993 consensus_queue.cc:206] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.714046 15589 catalog_manager.cc:3977] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac reported cstate change: term changed from 0 to 1, leader changed from to 30b08c36fa41460b84546af2b84601ac (127.11.224.3). New cstate: current_term: 1 leader_uuid: "30b08c36fa41460b84546af2b84601ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: HEALTHY } } } I0401 16:41:49.764892 15993 raft_consensus.cc:472] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.764994 15993 raft_consensus.cc:494] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.765549 15993 leader_election.cc:296] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.765841 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1014e6212c53450aa873880506494b22" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.765964 15788 raft_consensus.cc:2346] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.765940 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1014e6212c53450aa873880506494b22" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" is_pre_election: true I0401 16:41:49.766057 15863 raft_consensus.cc:2346] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.766233 15903 leader_election.cc:310] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c389c480349f4579bf5e70301b6d4517; no voters: I0401 16:41:49.766412 15993 raft_consensus.cc:2640] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.766454 15993 raft_consensus.cc:472] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.766505 15993 raft_consensus.cc:2886] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.768023 15993 raft_consensus.cc:494] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.768463 15993 leader_election.cc:296] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Requested vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.768741 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1014e6212c53450aa873880506494b22" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.768826 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "1014e6212c53450aa873880506494b22" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" I0401 16:41:49.768878 15788 raft_consensus.cc:2886] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.768939 15863 raft_consensus.cc:2886] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.770853 15863 raft_consensus.cc:2346] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.771273 15906 leader_election.cc:310] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.771536 15993 raft_consensus.cc:2640] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.771915 15788 raft_consensus.cc:2346] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.772300 15993 raft_consensus.cc:667] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Becoming Leader. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Running, Role: LEADER I0401 16:41:49.772500 15993 consensus_queue.cc:206] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.775951 15589 catalog_manager.cc:3977] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac reported cstate change: term changed from 0 to 1, leader changed from to 30b08c36fa41460b84546af2b84601ac (127.11.224.3). New cstate: current_term: 1 leader_uuid: "30b08c36fa41460b84546af2b84601ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: HEALTHY } } } I0401 16:41:49.829931 15993 raft_consensus.cc:472] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:49.830034 15993 raft_consensus.cc:494] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.830600 15993 leader_election.cc:296] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.831152 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "326662072cb64c93be9293bdd4eb0572" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" is_pre_election: true I0401 16:41:49.831199 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "326662072cb64c93be9293bdd4eb0572" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" is_pre_election: true I0401 16:41:49.831320 15863 raft_consensus.cc:2346] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.831794 15906 leader_election.cc:310] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.831320 15788 raft_consensus.cc:2346] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 0. I0401 16:41:49.832054 15993 raft_consensus.cc:2640] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:49.832163 15993 raft_consensus.cc:472] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:49.832248 15993 raft_consensus.cc:2886] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.834026 15993 raft_consensus.cc:494] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.834555 15993 leader_election.cc:296] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Requested vote from peers c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095), c49eacb8125f47b5a28548c823edfbf3 (127.11.224.2:54037) I0401 16:41:49.834836 15788 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "326662072cb64c93be9293bdd4eb0572" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c389c480349f4579bf5e70301b6d4517" I0401 16:41:49.834902 15863 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "326662072cb64c93be9293bdd4eb0572" candidate_uuid: "30b08c36fa41460b84546af2b84601ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c49eacb8125f47b5a28548c823edfbf3" I0401 16:41:49.834995 15863 raft_consensus.cc:2886] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.834995 15788 raft_consensus.cc:2886] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:49.837013 15863 raft_consensus.cc:2346] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.837272 15906 leader_election.cc:310] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 30b08c36fa41460b84546af2b84601ac, c49eacb8125f47b5a28548c823edfbf3; no voters: I0401 16:41:49.837473 15993 raft_consensus.cc:2640] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:49.837524 15788 raft_consensus.cc:2346] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 30b08c36fa41460b84546af2b84601ac in term 1. I0401 16:41:49.837622 15993 raft_consensus.cc:667] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Becoming Leader. State: Replica: 30b08c36fa41460b84546af2b84601ac, State: Running, Role: LEADER I0401 16:41:49.837885 15993 consensus_queue.cc:206] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } } I0401 16:41:49.840474 15589 catalog_manager.cc:3977] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac reported cstate change: term changed from 0 to 1, leader changed from to 30b08c36fa41460b84546af2b84601ac (127.11.224.3). New cstate: current_term: 1 leader_uuid: "30b08c36fa41460b84546af2b84601ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 } health_report { overall_health: HEALTHY } } } I0401 16:41:49.911801 15942 raft_consensus.cc:1181] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Refusing update from remote peer c49eacb8125f47b5a28548c823edfbf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:49.911808 15788 raft_consensus.cc:1181] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Refusing update from remote peer c49eacb8125f47b5a28548c823edfbf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:49.912305 15994 consensus_queue.cc:984] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:49.912493 16026 consensus_queue.cc:984] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:49.927564 15741 catalog_manager.cc:1111] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28: acquiring CA information for follower catalog manager: success I0401 16:41:49.929466 15741 catalog_manager.cc:1139] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:49.932857 15744 catalog_manager.cc:1111] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5: acquiring CA information for follower catalog manager: success I0401 16:41:49.934417 15744 catalog_manager.cc:1139] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:49.978912 15941 raft_consensus.cc:1181] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Refusing update from remote peer c389c480349f4579bf5e70301b6d4517: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:49.978968 15863 raft_consensus.cc:1181] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Refusing update from remote peer c389c480349f4579bf5e70301b6d4517: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:49.979292 15991 consensus_queue.cc:984] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:49.979465 16024 consensus_queue.cc:984] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.012954 15942 raft_consensus.cc:1181] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Refusing update from remote peer c389c480349f4579bf5e70301b6d4517: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.013927 16024 consensus_queue.cc:984] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.021219 15863 raft_consensus.cc:1181] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Refusing update from remote peer c389c480349f4579bf5e70301b6d4517: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.022359 16024 consensus_queue.cc:984] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.038256 15941 raft_consensus.cc:1181] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Refusing update from remote peer c49eacb8125f47b5a28548c823edfbf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:50.038256 15788 raft_consensus.cc:1181] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Refusing update from remote peer c49eacb8125f47b5a28548c823edfbf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:50.038663 16050 consensus_queue.cc:984] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.039007 16050 consensus_queue.cc:984] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.044880 15862 raft_consensus.cc:1181] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.045367 16044 mvcc.cc:203] Tried to move safe_time back from 6365848002713141248 to 6365848000735494144. Current Snapshot: MvccSnapshot[committed={T|T < 6365848002713141248}] I0401 16:41:50.045789 15993 consensus_queue.cc:984] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.054558 15788 raft_consensus.cc:1181] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.055219 15993 consensus_queue.cc:984] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.057823 15863 raft_consensus.cc:1181] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.058612 15993 consensus_queue.cc:984] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.073205 15788 raft_consensus.cc:1181] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.074443 15993 consensus_queue.cc:984] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.129618 15788 raft_consensus.cc:1181] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Refusing update from remote peer c49eacb8125f47b5a28548c823edfbf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.130272 15994 consensus_queue.cc:984] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.135022 15941 raft_consensus.cc:1181] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Refusing update from remote peer c49eacb8125f47b5a28548c823edfbf3: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.135540 15994 consensus_queue.cc:984] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30b08c36fa41460b84546af2b84601ac" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 58821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.168378 15788 raft_consensus.cc:1181] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:50.168378 15863 raft_consensus.cc:1181] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:50.168977 15993 consensus_queue.cc:984] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.169148 16014 consensus_queue.cc:984] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.204759 15862 raft_consensus.cc:1181] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.206029 16069 consensus_queue.cc:984] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.216292 15788 raft_consensus.cc:1181] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.217602 16069 consensus_queue.cc:984] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.222407 15863 raft_consensus.cc:1181] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.223577 16069 consensus_queue.cc:984] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c49eacb8125f47b5a28548c823edfbf3" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 54037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.232591 15788 raft_consensus.cc:1181] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Refusing update from remote peer 30b08c36fa41460b84546af2b84601ac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:50.233597 16014 consensus_queue.cc:984] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "c389c480349f4579bf5e70301b6d4517" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33095 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:50.953533 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:50.964416 15750 messenger.cc:381] Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer W0401 16:41:50.964699 15824 consensus_peers.cc:457] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 -> Peer c389c480349f4579bf5e70301b6d4517 (127.11.224.1:33095): Couldn't send request to peer c389c480349f4579bf5e70301b6d4517. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry. I0401 16:41:50.973232 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:50.973376 12160 tablet_replica.cc:264] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.973541 12160 raft_consensus.cc:2143] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:50.973803 12160 raft_consensus.cc:2170] T ce18cc20a89f4b0ea5689fa69cd2d573 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.974730 12160 tablet_replica.cc:264] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.974839 12160 raft_consensus.cc:2143] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:50.974937 12160 raft_consensus.cc:2170] T 1d488bd237df4d8693644e766b14820f P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.975488 12160 tablet_replica.cc:264] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.975580 12160 raft_consensus.cc:2143] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:50.975662 12160 raft_consensus.cc:2170] T 49c29a4a9ce94cbcb08d3902882f3678 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.976071 12160 tablet_replica.cc:264] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.976161 12160 raft_consensus.cc:2143] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:50.976238 12160 raft_consensus.cc:2170] T 9996ab620dac4416b7773a41827de2b2 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.976774 12160 tablet_replica.cc:264] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.976884 12160 raft_consensus.cc:2143] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:50.977038 12160 raft_consensus.cc:2170] T c4f59507e08d48648f5f94ca5e6c5276 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.977562 12160 tablet_replica.cc:264] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.977648 12160 raft_consensus.cc:2143] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:50.977726 12160 raft_consensus.cc:2170] T 9e9b6261342841ea8d3a1070c3e553e6 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.978315 12160 tablet_replica.cc:264] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.978400 12160 raft_consensus.cc:2143] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:50.978480 12160 raft_consensus.cc:2170] T 4d3a78e5d640469bacefc38d11a5c554 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.979074 12160 tablet_replica.cc:264] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.979162 12160 raft_consensus.cc:2143] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:50.979239 12160 raft_consensus.cc:2170] T 1014e6212c53450aa873880506494b22 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.980114 12160 tablet_replica.cc:264] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.980604 12160 raft_consensus.cc:2143] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:50.980731 12160 raft_consensus.cc:2170] T d2920637aa6b4c3c8a9ecf286fd9792e P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.981755 12160 tablet_replica.cc:264] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517: stopping tablet replica I0401 16:41:50.981906 12160 raft_consensus.cc:2143] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:50.982017 12160 raft_consensus.cc:2170] T 326662072cb64c93be9293bdd4eb0572 P c389c480349f4579bf5e70301b6d4517 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:50.999071 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:50.999120 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:50.999253 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:51.003561 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:51.019493 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:51.019608 12160 tablet_replica.cc:264] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.019735 12160 raft_consensus.cc:2143] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.019873 12160 raft_consensus.cc:2170] T 1d488bd237df4d8693644e766b14820f P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.020684 12160 tablet_replica.cc:264] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.020777 12160 raft_consensus.cc:2143] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.020886 12160 raft_consensus.cc:2170] T d2920637aa6b4c3c8a9ecf286fd9792e P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.021519 12160 tablet_replica.cc:264] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.021607 12160 raft_consensus.cc:2143] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.021687 12160 raft_consensus.cc:2170] T 326662072cb64c93be9293bdd4eb0572 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.022357 12160 tablet_replica.cc:264] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.022450 12160 raft_consensus.cc:2143] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.022527 12160 raft_consensus.cc:2170] T ce18cc20a89f4b0ea5689fa69cd2d573 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.023130 12160 tablet_replica.cc:264] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.023219 12160 raft_consensus.cc:2143] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.023295 12160 raft_consensus.cc:2170] T 1014e6212c53450aa873880506494b22 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.023874 12160 tablet_replica.cc:264] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.023986 12160 raft_consensus.cc:2143] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.024096 12160 raft_consensus.cc:2170] T 4d3a78e5d640469bacefc38d11a5c554 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.025029 12160 tablet_replica.cc:264] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.025259 12160 raft_consensus.cc:2143] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.025471 12160 raft_consensus.cc:2170] T 9e9b6261342841ea8d3a1070c3e553e6 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.026042 12160 tablet_replica.cc:264] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.026131 12160 raft_consensus.cc:2143] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.026209 12160 raft_consensus.cc:2170] T c4f59507e08d48648f5f94ca5e6c5276 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.026983 12160 tablet_replica.cc:264] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.027070 12160 raft_consensus.cc:2143] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.027216 12160 raft_consensus.cc:2170] T 9996ab620dac4416b7773a41827de2b2 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.027878 12160 tablet_replica.cc:264] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3: stopping tablet replica I0401 16:41:51.027962 12160 raft_consensus.cc:2143] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.028112 12160 raft_consensus.cc:2170] T 49c29a4a9ce94cbcb08d3902882f3678 P c49eacb8125f47b5a28548c823edfbf3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.051914 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:51.051962 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:51.052104 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:51.055639 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:51.068866 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:51.068979 12160 tablet_replica.cc:264] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.069105 12160 raft_consensus.cc:2143] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.069317 12160 raft_consensus.cc:2170] T 1d488bd237df4d8693644e766b14820f P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.070142 12160 tablet_replica.cc:264] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.070240 12160 raft_consensus.cc:2143] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.070391 12160 raft_consensus.cc:2170] T d2920637aa6b4c3c8a9ecf286fd9792e P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.071058 12160 tablet_replica.cc:264] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.071151 12160 raft_consensus.cc:2143] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.071301 12160 raft_consensus.cc:2170] T 326662072cb64c93be9293bdd4eb0572 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.071859 12160 tablet_replica.cc:264] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.071956 12160 raft_consensus.cc:2143] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.072036 12160 raft_consensus.cc:2170] T ce18cc20a89f4b0ea5689fa69cd2d573 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.072690 12160 tablet_replica.cc:264] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.072779 12160 raft_consensus.cc:2143] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.072876 12160 raft_consensus.cc:2170] T 9e9b6261342841ea8d3a1070c3e553e6 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.073535 12160 tablet_replica.cc:264] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.073622 12160 raft_consensus.cc:2143] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.073776 12160 raft_consensus.cc:2170] T 1014e6212c53450aa873880506494b22 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.074405 12160 tablet_replica.cc:264] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.074492 12160 raft_consensus.cc:2143] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.074640 12160 raft_consensus.cc:2170] T 4d3a78e5d640469bacefc38d11a5c554 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.075266 12160 tablet_replica.cc:264] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.075354 12160 raft_consensus.cc:2143] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.075431 12160 raft_consensus.cc:2170] T c4f59507e08d48648f5f94ca5e6c5276 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.075778 12160 tablet_replica.cc:264] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.075886 12160 raft_consensus.cc:2143] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.075961 12160 raft_consensus.cc:2170] T 49c29a4a9ce94cbcb08d3902882f3678 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.076301 12160 tablet_replica.cc:264] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac: stopping tablet replica I0401 16:41:51.076382 12160 raft_consensus.cc:2143] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.076459 12160 raft_consensus.cc:2170] T 9996ab620dac4416b7773a41827de2b2 P 30b08c36fa41460b84546af2b84601ac [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.083338 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:51.083377 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:51.083494 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:51.086973 12160 master.cc:270] Master@127.11.224.62:37596 shutting down... I0401 16:41:51.095999 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:51.096223 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.096287 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P f157b39c0d014af294d782407497c377: stopping tablet replica I0401 16:41:51.109463 12160 master.cc:281] Master@127.11.224.62:37596 shutdown complete. I0401 16:41:51.112462 12160 master.cc:270] Master@127.11.224.61:58736 shutting down... I0401 16:41:51.121425 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.121558 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.121620 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P c648c7b342d841319c073af14dbe36e5: stopping tablet replica I0401 16:41:51.134887 12160 master.cc:281] Master@127.11.224.61:58736 shutdown complete. I0401 16:41:51.137507 12160 master.cc:270] Master@127.11.224.60:32872 shutting down... I0401 16:41:51.147316 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:51.147469 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:51.147541 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P db81944f68db4f41a11ed545fdf4ca28: stopping tablet replica I0401 16:41:51.160563 12160 master.cc:281] Master@127.11.224.60:32872 shutdown complete. [ OK ] RemoteKsckTest.TestChecksumSnapshot (2427 ms) [ RUN ] RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp I0401 16:41:51.178541 12160 test_util.cc:212] Using random seed: -1869650136 I0401 16:41:51.179096 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:47162,127.11.224.61:39871,127.11.224.60:38386 I0401 16:41:51.182444 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 845931us I0401 16:41:51.182624 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:51.182662 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:51.182749 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:51.182785 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:51.183231 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "d615d3567ad94867a869ba26b32ad365" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.187618 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s I0401 16:41:51.188360 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:51.190191 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:51.190240 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-0-root uuid: "d615d3567ad94867a869ba26b32ad365" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.190320 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:51.233467 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:47162 I0401 16:41:51.234206 12160 webserver.cc:308] Webserver started at http://127.11.224.62:54029/ using document root and password file I0401 16:41:51.235113 16153 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.236991 16153 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:51.237964 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 845931us I0401 16:41:51.238109 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:51.238152 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:51.238260 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:51.238287 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:51.238669 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "f8991cfaa67a4eb09bca751df54d8ad9" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.242369 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.001s sys 0.002s I0401 16:41:51.243036 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:51.245010 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:51.245055 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-1-root uuid: "f8991cfaa67a4eb09bca751df54d8ad9" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.245128 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:51.253265 16153 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:51.253959 16153 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:39871: Network error: Client connection negotiation failed: client connection to 127.11.224.61:39871: connect: Connection refused (error 111) I0401 16:41:51.281493 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:39871 I0401 16:41:51.282253 12160 webserver.cc:308] Webserver started at http://127.11.224.61:52627/ using document root and password file I0401 16:41:51.283257 16210 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.285115 16210 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:51.286155 16153 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } attempt: 1 I0401 16:41:51.286846 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 845931us I0401 16:41:51.287114 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:51.287184 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:51.287286 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:51.287336 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:51.287724 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "4c416e88ff1b4443b64d8924059c475e" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.291800 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s I0401 16:41:51.292016 16210 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:51.292742 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:51.293169 16153 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:51.293936 16153 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:38386: Network error: Client connection negotiation failed: client connection to 127.11.224.60:38386: connect: Connection refused (error 111) I0401 16:41:51.295047 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:51.295091 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-2-root uuid: "4c416e88ff1b4443b64d8924059c475e" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.295161 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:51.296926 16210 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:51.297610 16210 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:38386: Network error: Client connection negotiation failed: client connection to 127.11.224.60:38386: connect: Connection refused (error 111) I0401 16:41:51.318135 16153 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } attempt: 1 W0401 16:41:51.318994 16153 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:38386: Network error: Client connection negotiation failed: client connection to 127.11.224.60:38386: connect: Connection refused (error 111) I0401 16:41:51.344455 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:38386 I0401 16:41:51.345245 12160 webserver.cc:308] Webserver started at http://127.11.224.60:43724/ using document root and password file I0401 16:41:51.345589 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:51.346179 16267 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.348016 16267 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:51.352475 16267 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:51.355937 16267 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:51.358762 16210 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } attempt: 1 I0401 16:41:51.362140 16267 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e: Bootstrap starting. I0401 16:41:51.363557 16267 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e: No blocks or log segments found. Creating new log. I0401 16:41:51.365217 16210 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9: Bootstrap starting. I0401 16:41:51.365481 16267 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e: No bootstrap required, opened a new log I0401 16:41:51.366225 16267 raft_consensus.cc:340] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } I0401 16:41:51.366374 16210 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9: No blocks or log segments found. Creating new log. I0401 16:41:51.366425 16267 raft_consensus.cc:366] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.366467 16267 raft_consensus.cc:705] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4c416e88ff1b4443b64d8924059c475e, State: Initialized, Role: FOLLOWER I0401 16:41:51.366634 16267 consensus_queue.cc:229] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } I0401 16:41:51.368078 16267 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.368224 16267 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.368283 16272 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.368459 16272 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.368680 16267 sys_catalog.cc:424] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:51.369020 16210 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9: No bootstrap required, opened a new log I0401 16:41:51.369604 16210 raft_consensus.cc:340] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } I0401 16:41:51.369720 16210 raft_consensus.cc:366] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.369750 16210 raft_consensus.cc:705] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f8991cfaa67a4eb09bca751df54d8ad9, State: Initialized, Role: FOLLOWER I0401 16:41:51.369921 16210 consensus_queue.cc:229] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } W0401 16:41:51.370052 16274 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:51.370106 16274 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:51.370319 16210 sys_catalog.cc:337] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.370434 16210 sys_catalog.cc:340] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.370370 16275 sys_catalog.cc:337] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.370517 16275 sys_catalog.cc:340] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.370721 16210 sys_catalog.cc:424] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: configured and running, proceeding with master startup. W0401 16:41:51.371667 16276 catalog_manager.cc:1113] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:51.371711 16276 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:51.376179 16153 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } attempt: 2 I0401 16:41:51.381664 16153 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365: Bootstrap starting. I0401 16:41:51.382735 16153 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365: No blocks or log segments found. Creating new log. I0401 16:41:51.384304 16153 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365: No bootstrap required, opened a new log I0401 16:41:51.384887 16153 raft_consensus.cc:340] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } I0401 16:41:51.385053 16153 raft_consensus.cc:366] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.385076 16153 raft_consensus.cc:705] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d615d3567ad94867a869ba26b32ad365, State: Initialized, Role: FOLLOWER I0401 16:41:51.385207 16153 consensus_queue.cc:229] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } I0401 16:41:51.385660 16153 sys_catalog.cc:337] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.385784 16153 sys_catalog.cc:340] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.385766 16278 sys_catalog.cc:337] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.386000 16278 sys_catalog.cc:340] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.386188 16153 sys_catalog.cc:424] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:51.386485 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:41:51.386518 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:51.387671 16279 catalog_manager.cc:1113] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:51.387714 16279 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:51.391283 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 845931us I0401 16:41:51.391448 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:51.391486 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:51.391577 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:51.391604 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:51.392093 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "df4bcb3f585940acab1e8647d6d40269" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.396080 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s I0401 16:41:51.396734 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:51.399020 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:51.399066 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-0-root uuid: "df4bcb3f585940acab1e8647d6d40269" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.399140 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:51.452181 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:51.452224 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:51.464874 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:46867 I0401 16:41:51.465617 12160 webserver.cc:308] Webserver started at http://127.11.224.1:40819/ using document root and password file I0401 16:41:51.473989 16344 heartbeater.cc:345] Connected to a master server at 127.11.224.60:38386 I0401 16:41:51.474069 16344 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.474251 16344 heartbeater.cc:475] Master 127.11.224.60:38386 requested a full tablet report, sending... I0401 16:41:51.475271 16234 ts_manager.cc:159] Registered new tserver with Master: df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867) I0401 16:41:51.475389 16345 heartbeater.cc:345] Connected to a master server at 127.11.224.61:39871 I0401 16:41:51.475458 16345 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.475628 16345 heartbeater.cc:475] Master 127.11.224.61:39871 requested a full tablet report, sending... I0401 16:41:51.476325 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 845931us I0401 16:41:51.476505 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:51.476544 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:51.476626 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:51.476653 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:51.476800 16177 ts_manager.cc:159] Registered new tserver with Master: df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867) I0401 16:41:51.477128 16346 heartbeater.cc:345] Connected to a master server at 127.11.224.62:47162 I0401 16:41:51.477186 16346 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.477211 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "cd20ceec0aab4841b45376dd0bb4713b" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.477368 16346 heartbeater.cc:475] Master 127.11.224.62:47162 requested a full tablet report, sending... I0401 16:41:51.478178 16120 ts_manager.cc:159] Registered new tserver with Master: df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867) I0401 16:41:51.481643 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.003s I0401 16:41:51.482405 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:51.485041 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:51.485095 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-1-root uuid: "cd20ceec0aab4841b45376dd0bb4713b" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.485175 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:51.510599 16272 raft_consensus.cc:472] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:51.510715 16272 raft_consensus.cc:494] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } I0401 16:41:51.511510 16272 leader_election.cc:296] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d615d3567ad94867a869ba26b32ad365 (127.11.224.62:47162), f8991cfaa67a4eb09bca751df54d8ad9 (127.11.224.61:39871) I0401 16:41:51.511875 16130 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4c416e88ff1b4443b64d8924059c475e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d615d3567ad94867a869ba26b32ad365" is_pre_election: true I0401 16:41:51.512049 16130 raft_consensus.cc:2346] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c416e88ff1b4443b64d8924059c475e in term 0. I0401 16:41:51.512053 16187 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4c416e88ff1b4443b64d8924059c475e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" is_pre_election: true I0401 16:41:51.512259 16187 raft_consensus.cc:2346] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4c416e88ff1b4443b64d8924059c475e in term 0. I0401 16:41:51.512434 16216 leader_election.cc:310] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c416e88ff1b4443b64d8924059c475e, d615d3567ad94867a869ba26b32ad365; no voters: I0401 16:41:51.512642 16272 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:51.512689 16272 raft_consensus.cc:472] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:51.512738 16272 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.514227 16272 raft_consensus.cc:494] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } I0401 16:41:51.514745 16272 leader_election.cc:296] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [CANDIDATE]: Term 1 election: Requested vote from peers d615d3567ad94867a869ba26b32ad365 (127.11.224.62:47162), f8991cfaa67a4eb09bca751df54d8ad9 (127.11.224.61:39871) I0401 16:41:51.515027 16130 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4c416e88ff1b4443b64d8924059c475e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d615d3567ad94867a869ba26b32ad365" I0401 16:41:51.515051 16187 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4c416e88ff1b4443b64d8924059c475e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" I0401 16:41:51.515137 16130 raft_consensus.cc:2886] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.515156 16187 raft_consensus.cc:2886] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.516495 16187 raft_consensus.cc:2346] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c416e88ff1b4443b64d8924059c475e in term 1. I0401 16:41:51.516752 16218 leader_election.cc:310] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4c416e88ff1b4443b64d8924059c475e, f8991cfaa67a4eb09bca751df54d8ad9; no voters: I0401 16:41:51.516980 16272 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:51.517036 16130 raft_consensus.cc:2346] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4c416e88ff1b4443b64d8924059c475e in term 1. I0401 16:41:51.517447 16272 raft_consensus.cc:667] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 1 LEADER]: Becoming Leader. State: Replica: 4c416e88ff1b4443b64d8924059c475e, State: Running, Role: LEADER I0401 16:41:51.517662 16272 consensus_queue.cc:206] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } I0401 16:41:51.518746 16357 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c416e88ff1b4443b64d8924059c475e. Latest consensus state: current_term: 1 leader_uuid: "4c416e88ff1b4443b64d8924059c475e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.518963 16357 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: This master's current role is: LEADER I0401 16:41:51.519620 16359 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:51.521597 16359 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:51.539126 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:51.539170 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:51.559306 16187 raft_consensus.cc:1181] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 1 FOLLOWER]: Refusing update from remote peer 4c416e88ff1b4443b64d8924059c475e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:51.559409 16130 raft_consensus.cc:1181] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 1 FOLLOWER]: Refusing update from remote peer 4c416e88ff1b4443b64d8924059c475e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:51.559738 16272 consensus_queue.cc:984] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:51.559875 16357 consensus_queue.cc:984] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [LEADER]: Connected to new peer: Peer: permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:51.573536 16278 sys_catalog.cc:337] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c416e88ff1b4443b64d8924059c475e. Latest consensus state: current_term: 1 leader_uuid: "4c416e88ff1b4443b64d8924059c475e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.573768 16278 sys_catalog.cc:340] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.574527 16275 sys_catalog.cc:337] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4c416e88ff1b4443b64d8924059c475e. Latest consensus state: current_term: 1 leader_uuid: "4c416e88ff1b4443b64d8924059c475e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.574772 16275 sys_catalog.cc:340] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.587756 16419 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c416e88ff1b4443b64d8924059c475e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.588016 16419 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: This master's current role is: LEADER I0401 16:41:51.588289 16419 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4c416e88ff1b4443b64d8924059c475e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.588476 16419 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [sys.catalog]: This master's current role is: LEADER I0401 16:41:51.587756 16275 sys_catalog.cc:337] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c416e88ff1b4443b64d8924059c475e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.588943 16275 sys_catalog.cc:340] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.590781 16359 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:51.590970 16278 sys_catalog.cc:337] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4c416e88ff1b4443b64d8924059c475e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d615d3567ad94867a869ba26b32ad365" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 47162 } } peers { permanent_uuid: "f8991cfaa67a4eb09bca751df54d8ad9" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 39871 } } peers { permanent_uuid: "4c416e88ff1b4443b64d8924059c475e" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 38386 } } } I0401 16:41:51.591143 16278 sys_catalog.cc:340] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:51.592324 16359 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:51.594211 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:58243 I0401 16:41:51.595093 12160 webserver.cc:308] Webserver started at http://127.11.224.2:35761/ using document root and password file I0401 16:41:51.605096 16359 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e: Generated new TSK 0 I0401 16:41:51.607105 16431 heartbeater.cc:345] Connected to a master server at 127.11.224.60:38386 I0401 16:41:51.607167 16431 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.607621 16431 heartbeater.cc:475] Master 127.11.224.60:38386 requested a full tablet report, sending... I0401 16:41:51.608343 16234 ts_manager.cc:159] Registered new tserver with Master: cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:51.610208 16234 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:46797 I0401 16:41:51.611966 16432 heartbeater.cc:345] Connected to a master server at 127.11.224.61:39871 I0401 16:41:51.612047 16432 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.612175 16432 heartbeater.cc:475] Master 127.11.224.61:39871 requested a full tablet report, sending... I0401 16:41:51.612707 16234 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:46793 I0401 16:41:51.612936 16177 ts_manager.cc:159] Registered new tserver with Master: cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:51.615528 16434 heartbeater.cc:345] Connected to a master server at 127.11.224.62:47162 I0401 16:41:51.615595 16434 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.615712 16434 heartbeater.cc:475] Master 127.11.224.62:47162 requested a full tablet report, sending... I0401 16:41:51.616441 16120 ts_manager.cc:159] Registered new tserver with Master: cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:51.617686 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 845931us I0401 16:41:51.617842 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:51.617874 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:51.617964 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:51.617987 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:51.618422 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "fa1dbf7aa4e34d1c8aeac54870393547" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.621649 16431 heartbeater.cc:467] Master 127.11.224.60:38386 was elected leader, sending a full tablet report... I0401 16:41:51.623766 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.003s sys 0.002s I0401 16:41:51.624063 16344 heartbeater.cc:467] Master 127.11.224.60:38386 was elected leader, sending a full tablet report... I0401 16:41:51.624581 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:51.627573 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.001s I0401 16:41:51.627624 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-2-root uuid: "fa1dbf7aa4e34d1c8aeac54870393547" format_stamp: "Formatted at 2019-04-01 23:41:51 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:51.627696 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:51.653323 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:51.653367 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:51.674165 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:32809 I0401 16:41:51.674998 12160 webserver.cc:308] Webserver started at http://127.11.224.3:42977/ using document root and password file I0401 16:41:51.686193 16501 heartbeater.cc:345] Connected to a master server at 127.11.224.60:38386 I0401 16:41:51.686275 16501 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.686522 16501 heartbeater.cc:475] Master 127.11.224.60:38386 requested a full tablet report, sending... I0401 16:41:51.687842 16234 ts_manager.cc:159] Registered new tserver with Master: fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.688587 16503 heartbeater.cc:345] Connected to a master server at 127.11.224.62:47162 I0401 16:41:51.688643 16503 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.688827 16503 heartbeater.cc:475] Master 127.11.224.62:47162 requested a full tablet report, sending... I0401 16:41:51.689189 16502 heartbeater.cc:345] Connected to a master server at 127.11.224.61:39871 I0401 16:41:51.689278 16502 heartbeater.cc:426] Registering TS with master... I0401 16:41:51.689404 16234 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.60:46800 I0401 16:41:51.689471 16502 heartbeater.cc:475] Master 127.11.224.61:39871 requested a full tablet report, sending... I0401 16:41:51.689968 16120 ts_manager.cc:159] Registered new tserver with Master: fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.690517 16177 ts_manager.cc:159] Registered new tserver with Master: fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.691172 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.009973776s I0401 16:41:51.701594 16501 heartbeater.cc:467] Master 127.11.224.60:38386 was elected leader, sending a full tablet report... I0401 16:41:51.707232 16234 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.60:46805: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:51.708012 16234 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:51.739368 16389 tablet_service.cc:1006] Processing CreateTablet for tablet 3fd4c662330147308de7aaf015f1c526 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:51.739455 16388 tablet_service.cc:1006] Processing CreateTablet for tablet 767ff9cf36144c55925b925c438942ff (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:51.739881 16389 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3fd4c662330147308de7aaf015f1c526. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.739852 16386 tablet_service.cc:1006] Processing CreateTablet for tablet bfca62509b3e4b948f974b48c8a3744d (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:51.740319 16386 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bfca62509b3e4b948f974b48c8a3744d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.740694 16387 tablet_service.cc:1006] Processing CreateTablet for tablet 738f3ce8a91441cdab27e453c5fea465 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:51.741056 16387 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 738f3ce8a91441cdab27e453c5fea465. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.742745 16385 tablet_service.cc:1006] Processing CreateTablet for tablet 45c919434c794f00945387c3431ffa50 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:51.743291 16384 tablet_service.cc:1006] Processing CreateTablet for tablet 23315893717f4d85bf67e1bc90a41ae6 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:51.743484 16381 tablet_service.cc:1006] Processing CreateTablet for tablet 9c3ee1837ea840e0b758d8b696e713c7 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:51.744067 16383 tablet_service.cc:1006] Processing CreateTablet for tablet 2971bb5eed124316add709582295f9a8 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:51.744598 16382 tablet_service.cc:1006] Processing CreateTablet for tablet 4250b540766b42328f9dc22a577cd51d (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:51.744678 16462 tablet_service.cc:1006] Processing CreateTablet for tablet 2971bb5eed124316add709582295f9a8 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:51.744998 16462 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 2971bb5eed124316add709582295f9a8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.744988 16468 tablet_service.cc:1006] Processing CreateTablet for tablet 3fd4c662330147308de7aaf015f1c526 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:51.745213 16379 tablet_service.cc:1006] Processing CreateTablet for tablet c2a60d7d62614394b023920482b988f1 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:51.745326 16468 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3fd4c662330147308de7aaf015f1c526. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.745970 16466 tablet_service.cc:1006] Processing CreateTablet for tablet 738f3ce8a91441cdab27e453c5fea465 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:51.746225 16385 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 45c919434c794f00945387c3431ffa50. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.746331 16466 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 738f3ce8a91441cdab27e453c5fea465. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.747689 16460 tablet_service.cc:1006] Processing CreateTablet for tablet 9c3ee1837ea840e0b758d8b696e713c7 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:51.747869 16467 tablet_service.cc:1006] Processing CreateTablet for tablet 767ff9cf36144c55925b925c438942ff (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:51.748694 16464 tablet_service.cc:1006] Processing CreateTablet for tablet 45c919434c794f00945387c3431ffa50 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:51.749769 16465 tablet_service.cc:1006] Processing CreateTablet for tablet bfca62509b3e4b948f974b48c8a3744d (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:51.750111 16461 tablet_service.cc:1006] Processing CreateTablet for tablet 4250b540766b42328f9dc22a577cd51d (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:51.750402 16460 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9c3ee1837ea840e0b758d8b696e713c7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.749485 16459 tablet_service.cc:1006] Processing CreateTablet for tablet c2a60d7d62614394b023920482b988f1 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:51.750406 16388 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 767ff9cf36144c55925b925c438942ff. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.753181 16464 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 45c919434c794f00945387c3431ffa50. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.753384 16311 tablet_service.cc:1006] Processing CreateTablet for tablet 3fd4c662330147308de7aaf015f1c526 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:51.753758 16463 tablet_service.cc:1006] Processing CreateTablet for tablet 23315893717f4d85bf67e1bc90a41ae6 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:51.754004 16379 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c2a60d7d62614394b023920482b988f1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.754329 16310 tablet_service.cc:1006] Processing CreateTablet for tablet 767ff9cf36144c55925b925c438942ff (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:51.754670 16310 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 767ff9cf36144c55925b925c438942ff. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.758087 16383 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 2971bb5eed124316add709582295f9a8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.758088 16309 tablet_service.cc:1006] Processing CreateTablet for tablet 738f3ce8a91441cdab27e453c5fea465 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:51.758447 16309 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 738f3ce8a91441cdab27e453c5fea465. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.762609 16467 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 767ff9cf36144c55925b925c438942ff. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.765188 16304 tablet_service.cc:1006] Processing CreateTablet for tablet 4250b540766b42328f9dc22a577cd51d (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:51.765280 16302 tablet_service.cc:1006] Processing CreateTablet for tablet c2a60d7d62614394b023920482b988f1 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:51.765189 16303 tablet_service.cc:1006] Processing CreateTablet for tablet 9c3ee1837ea840e0b758d8b696e713c7 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:51.765532 16306 tablet_service.cc:1006] Processing CreateTablet for tablet 23315893717f4d85bf67e1bc90a41ae6 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:51.765985 16459 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c2a60d7d62614394b023920482b988f1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.766822 16304 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4250b540766b42328f9dc22a577cd51d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.767141 16465 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bfca62509b3e4b948f974b48c8a3744d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.767271 16384 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 23315893717f4d85bf67e1bc90a41ae6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.768016 16463 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 23315893717f4d85bf67e1bc90a41ae6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.768213 16307 tablet_service.cc:1006] Processing CreateTablet for tablet 45c919434c794f00945387c3431ffa50 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:51.768550 16308 tablet_service.cc:1006] Processing CreateTablet for tablet bfca62509b3e4b948f974b48c8a3744d (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:51.768744 16302 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c2a60d7d62614394b023920482b988f1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.769088 16381 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9c3ee1837ea840e0b758d8b696e713c7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.768023 16305 tablet_service.cc:1006] Processing CreateTablet for tablet 2971bb5eed124316add709582295f9a8 (table=ksck-test-table [id=1388effb9d08410e99f9912a8e286454]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:51.769984 16461 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4250b540766b42328f9dc22a577cd51d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.770277 16311 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3fd4c662330147308de7aaf015f1c526. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.770524 16382 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4250b540766b42328f9dc22a577cd51d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.773056 16307 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 45c919434c794f00945387c3431ffa50. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.774403 16306 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 23315893717f4d85bf67e1bc90a41ae6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.777768 16308 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bfca62509b3e4b948f974b48c8a3744d. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.782678 16303 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9c3ee1837ea840e0b758d8b696e713c7. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.785081 16305 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 2971bb5eed124316add709582295f9a8. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:51.796382 16521 tablet_bootstrap.cc:439] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:51.809069 16521 tablet_bootstrap.cc:590] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:51.814105 16522 tablet_bootstrap.cc:439] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.814172 16523 tablet_bootstrap.cc:439] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.815662 16523 tablet_bootstrap.cc:590] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.815996 16522 tablet_bootstrap.cc:590] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.818006 16522 tablet_bootstrap.cc:439] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.818136 16522 ts_tablet_manager.cc:1053] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0401 16:41:51.818888 16522 raft_consensus.cc:340] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.819139 16522 raft_consensus.cc:366] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.819211 16522 raft_consensus.cc:705] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.819397 16522 consensus_queue.cc:229] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.819655 16523 tablet_bootstrap.cc:439] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.819773 16523 ts_tablet_manager.cc:1053] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s I0401 16:41:51.820598 16523 raft_consensus.cc:340] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.820855 16523 raft_consensus.cc:366] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.820915 16523 raft_consensus.cc:705] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:51.821099 16523 consensus_queue.cc:229] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.822563 16521 tablet_bootstrap.cc:439] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:51.822693 16521 ts_tablet_manager.cc:1053] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.026s user 0.003s sys 0.004s I0401 16:41:51.824270 16521 raft_consensus.cc:340] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.824559 16521 raft_consensus.cc:366] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.824630 16521 raft_consensus.cc:705] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:51.826591 16521 consensus_queue.cc:229] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.825529 16522 ts_tablet_manager.cc:1081] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s I0401 16:41:51.826261 16523 ts_tablet_manager.cc:1081] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.006s user 0.000s sys 0.001s I0401 16:41:51.827472 16522 tablet_bootstrap.cc:439] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.827618 16523 tablet_bootstrap.cc:439] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.828886 16523 tablet_bootstrap.cc:590] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.828922 16522 tablet_bootstrap.cc:590] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.836549 16521 ts_tablet_manager.cc:1081] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.014s user 0.000s sys 0.008s I0401 16:41:51.837968 16521 tablet_bootstrap.cc:439] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:51.839164 16523 tablet_bootstrap.cc:439] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.839279 16523 ts_tablet_manager.cc:1053] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.005s I0401 16:41:51.839977 16521 tablet_bootstrap.cc:590] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:51.840236 16522 tablet_bootstrap.cc:439] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.840368 16522 ts_tablet_manager.cc:1053] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.006s I0401 16:41:51.840270 16523 raft_consensus.cc:340] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.840497 16523 raft_consensus.cc:366] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.840562 16523 raft_consensus.cc:705] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:51.840764 16523 consensus_queue.cc:229] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.841033 16522 raft_consensus.cc:340] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.841209 16522 raft_consensus.cc:366] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.841266 16522 raft_consensus.cc:705] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.841601 16523 ts_tablet_manager.cc:1081] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:51.841851 16523 tablet_bootstrap.cc:439] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.842342 16522 consensus_queue.cc:229] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.845168 16522 ts_tablet_manager.cc:1081] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s I0401 16:41:51.845425 16522 tablet_bootstrap.cc:439] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.846526 16521 tablet_bootstrap.cc:439] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:51.846591 16523 tablet_bootstrap.cc:590] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.846632 16521 ts_tablet_manager.cc:1053] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s I0401 16:41:51.846967 16522 tablet_bootstrap.cc:590] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.847148 16521 raft_consensus.cc:340] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:51.847276 16521 raft_consensus.cc:366] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.847329 16521 raft_consensus.cc:705] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:51.847496 16521 consensus_queue.cc:229] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:51.848809 16521 ts_tablet_manager.cc:1081] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:51.849052 16521 tablet_bootstrap.cc:439] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:51.850950 16521 tablet_bootstrap.cc:590] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:51.851150 16523 tablet_bootstrap.cc:439] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.851253 16523 ts_tablet_manager.cc:1053] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s I0401 16:41:51.851713 16523 raft_consensus.cc:340] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.851864 16523 raft_consensus.cc:366] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.851897 16523 raft_consensus.cc:705] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:51.852035 16523 consensus_queue.cc:229] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.852504 16523 ts_tablet_manager.cc:1081] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:51.852715 16523 tablet_bootstrap.cc:439] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.854039 16521 tablet_bootstrap.cc:439] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:51.854163 16521 ts_tablet_manager.cc:1053] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.005s user 0.001s sys 0.001s I0401 16:41:51.854737 16521 raft_consensus.cc:340] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.854871 16521 raft_consensus.cc:366] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.854950 16521 raft_consensus.cc:705] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:51.855000 16523 tablet_bootstrap.cc:590] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.855092 16521 consensus_queue.cc:229] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.861744 16522 tablet_bootstrap.cc:439] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.861892 16522 ts_tablet_manager.cc:1053] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.017s user 0.001s sys 0.002s I0401 16:41:51.862663 16522 raft_consensus.cc:340] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:51.862870 16522 raft_consensus.cc:366] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.862918 16522 raft_consensus.cc:705] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.863086 16522 consensus_queue.cc:229] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:51.863711 16522 ts_tablet_manager.cc:1081] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s I0401 16:41:51.863970 16522 tablet_bootstrap.cc:439] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.865731 16522 tablet_bootstrap.cc:590] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.866216 16523 tablet_bootstrap.cc:439] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.866660 16523 ts_tablet_manager.cc:1053] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.004s I0401 16:41:51.867676 16523 raft_consensus.cc:340] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.867874 16523 raft_consensus.cc:366] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.867967 16523 raft_consensus.cc:705] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:51.868237 16522 tablet_bootstrap.cc:439] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.868132 16523 consensus_queue.cc:229] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.868336 16522 ts_tablet_manager.cc:1053] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0401 16:41:51.868914 16522 raft_consensus.cc:340] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.869073 16522 raft_consensus.cc:366] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.869107 16522 raft_consensus.cc:705] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.869262 16522 consensus_queue.cc:229] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.869825 16522 ts_tablet_manager.cc:1081] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:51.870065 16522 tablet_bootstrap.cc:439] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.871469 16522 tablet_bootstrap.cc:590] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.874614 16523 ts_tablet_manager.cc:1081] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s I0401 16:41:51.874889 16523 tablet_bootstrap.cc:439] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.876082 16523 tablet_bootstrap.cc:590] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.881752 16522 tablet_bootstrap.cc:439] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.881880 16522 ts_tablet_manager.cc:1053] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.008s I0401 16:41:51.882468 16522 raft_consensus.cc:340] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.882601 16522 raft_consensus.cc:366] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.882655 16522 raft_consensus.cc:705] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.882815 16522 consensus_queue.cc:229] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.883720 16522 ts_tablet_manager.cc:1081] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:51.884006 16522 tablet_bootstrap.cc:439] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.885681 16522 tablet_bootstrap.cc:590] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.888926 16523 tablet_bootstrap.cc:439] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.888996 16522 tablet_bootstrap.cc:439] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.889040 16523 ts_tablet_manager.cc:1053] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.006s I0401 16:41:51.889101 16522 ts_tablet_manager.cc:1053] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s I0401 16:41:51.889608 16522 raft_consensus.cc:340] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.889802 16522 raft_consensus.cc:366] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.889868 16522 raft_consensus.cc:705] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.889752 16523 raft_consensus.cc:340] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.890008 16523 raft_consensus.cc:366] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.890115 16523 raft_consensus.cc:705] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:51.890197 16522 consensus_queue.cc:229] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.890717 16522 ts_tablet_manager.cc:1081] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:51.891490 16522 tablet_bootstrap.cc:439] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.890337 16523 consensus_queue.cc:229] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.894642 16522 tablet_bootstrap.cc:590] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.896011 16521 ts_tablet_manager.cc:1081] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.042s user 0.019s sys 0.005s I0401 16:41:51.896598 16521 tablet_bootstrap.cc:439] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:51.897563 16523 ts_tablet_manager.cc:1081] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.008s user 0.002s sys 0.000s I0401 16:41:51.897794 16523 tablet_bootstrap.cc:439] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.898185 16521 tablet_bootstrap.cc:590] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:51.899065 16523 tablet_bootstrap.cc:590] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.899765 16522 tablet_bootstrap.cc:439] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.899876 16522 ts_tablet_manager.cc:1053] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s I0401 16:41:51.900000 16527 raft_consensus.cc:472] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:51.900204 16521 tablet_bootstrap.cc:439] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:51.900096 16527 raft_consensus.cc:494] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.900319 16521 ts_tablet_manager.cc:1053] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:51.900581 16522 raft_consensus.cc:340] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.900830 16522 raft_consensus.cc:366] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.900740 16521 raft_consensus.cc:340] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.900873 16522 raft_consensus.cc:705] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.900914 16521 raft_consensus.cc:366] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.900951 16521 raft_consensus.cc:705] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:51.901039 16522 consensus_queue.cc:229] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.901093 16521 consensus_queue.cc:229] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.901245 16523 tablet_bootstrap.cc:439] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.901564 16521 ts_tablet_manager.cc:1081] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:51.901558 16528 raft_consensus.cc:472] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:51.901634 16528 raft_consensus.cc:494] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.901763 16521 tablet_bootstrap.cc:439] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:51.902199 16528 leader_election.cc:296] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.903008 16521 tablet_bootstrap.cc:590] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:51.900777 16527 leader_election.cc:296] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.901334 16523 ts_tablet_manager.cc:1053] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:51.907039 16523 raft_consensus.cc:340] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.907259 16523 raft_consensus.cc:366] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.907325 16523 raft_consensus.cc:705] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:51.907546 16523 consensus_queue.cc:229] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.909420 16523 ts_tablet_manager.cc:1081] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0401 16:41:51.910928 16523 tablet_bootstrap.cc:439] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.912858 16321 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767ff9cf36144c55925b925c438942ff" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:51.913064 16321 raft_consensus.cc:2346] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 0. I0401 16:41:51.914815 16356 leader_election.cc:310] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269; no voters: I0401 16:41:51.915562 16521 tablet_bootstrap.cc:439] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:51.915627 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767ff9cf36144c55925b925c438942ff" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:51.915690 16521 ts_tablet_manager.cc:1053] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.002s W0401 16:41:51.916177 16353 leader_election.cc:348] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:51.916407 16399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9c3ee1837ea840e0b758d8b696e713c7" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true I0401 16:41:51.916615 16522 ts_tablet_manager.cc:1081] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.017s user 0.001s sys 0.002s I0401 16:41:51.916559 16521 raft_consensus.cc:340] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.916735 16521 raft_consensus.cc:366] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.916767 16521 raft_consensus.cc:705] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:51.916942 16521 consensus_queue.cc:229] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.917214 16522 tablet_bootstrap.cc:439] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. W0401 16:41:51.917325 16285 leader_election.cc:348] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:51.918634 16521 ts_tablet_manager.cc:1081] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:51.918845 16521 tablet_bootstrap.cc:439] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:51.919247 16522 tablet_bootstrap.cc:590] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.920015 16521 tablet_bootstrap.cc:590] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:51.921133 16544 raft_consensus.cc:2640] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:51.921216 16544 raft_consensus.cc:472] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:51.921293 16544 raft_consensus.cc:2886] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.926151 16523 tablet_bootstrap.cc:590] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.926697 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9c3ee1837ea840e0b758d8b696e713c7" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:51.926882 16478 raft_consensus.cc:2346] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4bcb3f585940acab1e8647d6d40269 in term 0. I0401 16:41:51.926957 16544 raft_consensus.cc:494] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.927223 16282 leader_election.cc:310] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547; no voters: cd20ceec0aab4841b45376dd0bb4713b I0401 16:41:51.927459 16528 raft_consensus.cc:2640] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:51.927505 16528 raft_consensus.cc:472] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:51.927552 16528 raft_consensus.cc:2886] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.927925 16521 tablet_bootstrap.cc:439] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:51.927924 16321 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767ff9cf36144c55925b925c438942ff" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" I0401 16:41:51.928033 16321 raft_consensus.cc:2886] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.928032 16521 ts_tablet_manager.cc:1053] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.003s I0401 16:41:51.928683 16521 raft_consensus.cc:340] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.928833 16521 raft_consensus.cc:366] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.928881 16521 raft_consensus.cc:705] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:51.929050 16521 consensus_queue.cc:229] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.929479 16528 raft_consensus.cc:494] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.929915 16321 raft_consensus.cc:2346] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 1. I0401 16:41:51.930068 16528 leader_election.cc:296] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Requested vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.931216 16399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9c3ee1837ea840e0b758d8b696e713c7" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" W0401 16:41:51.932044 16285 leader_election.cc:348] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:51.932154 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9c3ee1837ea840e0b758d8b696e713c7" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" I0401 16:41:51.932272 16478 raft_consensus.cc:2886] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.932287 16356 leader_election.cc:310] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269; no voters: I0401 16:41:51.932552 16527 raft_consensus.cc:2640] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:51.934309 16478 raft_consensus.cc:2346] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4bcb3f585940acab1e8647d6d40269 in term 1. I0401 16:41:51.934629 16282 leader_election.cc:310] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547; no voters: cd20ceec0aab4841b45376dd0bb4713b I0401 16:41:51.934741 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767ff9cf36144c55925b925c438942ff" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" I0401 16:41:51.934855 16478 raft_consensus.cc:2886] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.935245 16528 raft_consensus.cc:2640] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:51.936281 16521 ts_tablet_manager.cc:1081] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s I0401 16:41:51.936548 16521 tablet_bootstrap.cc:439] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:51.937486 16478 raft_consensus.cc:2346] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 1. I0401 16:41:51.938135 16528 raft_consensus.cc:667] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Becoming Leader. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Running, Role: LEADER I0401 16:41:51.938343 16521 tablet_bootstrap.cc:590] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:51.938362 16528 consensus_queue.cc:206] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.938947 16523 tablet_bootstrap.cc:439] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.939054 16523 ts_tablet_manager.cc:1053] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.028s user 0.003s sys 0.004s I0401 16:41:51.939613 16551 raft_consensus.cc:472] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:51.939733 16551 raft_consensus.cc:494] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.939743 16523 raft_consensus.cc:340] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.940129 16523 raft_consensus.cc:366] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.940153 16522 tablet_bootstrap.cc:439] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.940171 16523 raft_consensus.cc:705] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:51.940243 16522 ts_tablet_manager.cc:1053] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.023s user 0.003s sys 0.000s I0401 16:41:51.940313 16523 consensus_queue.cc:229] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.940625 16523 ts_tablet_manager.cc:1081] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:41:51.940820 16523 tablet_bootstrap.cc:439] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.940762 16522 raft_consensus.cc:340] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.940943 16522 raft_consensus.cc:366] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.940971 16522 raft_consensus.cc:705] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.941098 16522 consensus_queue.cc:229] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.941275 16551 leader_election.cc:296] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.941671 16399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "738f3ce8a91441cdab27e453c5fea465" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true W0401 16:41:51.942065 16285 leader_election.cc:348] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:51.942283 16523 tablet_bootstrap.cc:590] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.942243 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "738f3ce8a91441cdab27e453c5fea465" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:51.942417 16478 raft_consensus.cc:2346] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4bcb3f585940acab1e8647d6d40269 in term 0. I0401 16:41:51.942715 16282 leader_election.cc:310] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547; no voters: cd20ceec0aab4841b45376dd0bb4713b I0401 16:41:51.944631 16232 catalog_manager.cc:3977] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 reported cstate change: term changed from 0 to 1, leader changed from to df4bcb3f585940acab1e8647d6d40269 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "df4bcb3f585940acab1e8647d6d40269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: UNKNOWN } } } I0401 16:41:51.944999 16551 raft_consensus.cc:2640] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:51.945044 16551 raft_consensus.cc:472] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:51.945091 16551 raft_consensus.cc:2886] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.948930 16522 ts_tablet_manager.cc:1081] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.009s user 0.001s sys 0.001s I0401 16:41:51.949146 16522 tablet_bootstrap.cc:439] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.951766 16544 leader_election.cc:296] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Requested vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.953142 16522 tablet_bootstrap.cc:590] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.954654 16551 raft_consensus.cc:494] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.955560 16551 leader_election.cc:296] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Requested vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.955862 16399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "738f3ce8a91441cdab27e453c5fea465" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" W0401 16:41:51.956296 16285 leader_election.cc:348] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:51.956604 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "738f3ce8a91441cdab27e453c5fea465" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" I0401 16:41:51.956733 16523 tablet_bootstrap.cc:439] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.956756 16478 raft_consensus.cc:2886] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.956845 16523 ts_tablet_manager.cc:1053] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.003s I0401 16:41:51.957059 16527 raft_consensus.cc:667] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Becoming Leader. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Running, Role: LEADER I0401 16:41:51.957264 16527 consensus_queue.cc:206] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.958806 16523 raft_consensus.cc:340] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.958945 16523 raft_consensus.cc:366] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.958987 16478 raft_consensus.cc:2346] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4bcb3f585940acab1e8647d6d40269 in term 1. I0401 16:41:51.958998 16523 raft_consensus.cc:705] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:51.959192 16523 consensus_queue.cc:229] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.959475 16282 leader_election.cc:310] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547; no voters: cd20ceec0aab4841b45376dd0bb4713b I0401 16:41:51.959923 16552 raft_consensus.cc:2640] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:51.960034 16552 raft_consensus.cc:667] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Becoming Leader. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Running, Role: LEADER I0401 16:41:51.960207 16552 consensus_queue.cc:206] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.961465 16523 ts_tablet_manager.cc:1081] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s I0401 16:41:51.961509 16522 tablet_bootstrap.cc:439] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.961665 16522 ts_tablet_manager.cc:1053] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.001s I0401 16:41:51.961737 16523 tablet_bootstrap.cc:439] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:51.962276 16522 raft_consensus.cc:340] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.962452 16522 raft_consensus.cc:366] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.962486 16522 raft_consensus.cc:705] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.962745 16522 consensus_queue.cc:229] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.963011 16523 tablet_bootstrap.cc:590] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:51.963362 16522 ts_tablet_manager.cc:1081] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:51.963575 16522 tablet_bootstrap.cc:439] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b: Bootstrap starting. I0401 16:41:51.964087 16521 tablet_bootstrap.cc:439] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:51.963666 16551 raft_consensus.cc:472] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:51.964217 16521 ts_tablet_manager.cc:1053] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.028s user 0.002s sys 0.002s I0401 16:41:51.964296 16551 raft_consensus.cc:494] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.964972 16551 leader_election.cc:296] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.964898 16521 raft_consensus.cc:340] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.965111 16521 raft_consensus.cc:366] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.965170 16521 raft_consensus.cc:705] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:51.965345 16521 consensus_queue.cc:229] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.965914 16399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bfca62509b3e4b948f974b48c8a3744d" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true I0401 16:41:51.966060 16399 raft_consensus.cc:2346] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df4bcb3f585940acab1e8647d6d40269 in term 0. I0401 16:41:51.966754 16522 tablet_bootstrap.cc:590] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b: No blocks or log segments found. Creating new log. I0401 16:41:51.966852 16233 catalog_manager.cc:3977] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b reported cstate change: term changed from 0 to 1, leader changed from to cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2). New cstate: current_term: 1 leader_uuid: "cd20ceec0aab4841b45376dd0bb4713b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: UNKNOWN } } } I0401 16:41:51.968164 16521 ts_tablet_manager.cc:1081] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0401 16:41:51.968369 16521 tablet_bootstrap.cc:439] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:51.968947 16285 leader_election.cc:310] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269; no voters: I0401 16:41:51.969352 16551 raft_consensus.cc:2640] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:51.969395 16551 raft_consensus.cc:472] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:51.969449 16551 raft_consensus.cc:2886] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.973748 16551 raft_consensus.cc:494] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.974725 16551 leader_election.cc:296] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Requested vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.974817 16399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bfca62509b3e4b948f974b48c8a3744d" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" I0401 16:41:51.974962 16399 raft_consensus.cc:2886] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.975116 16477 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bfca62509b3e4b948f974b48c8a3744d" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" W0401 16:41:51.975471 16282 leader_election.cc:348] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:51.976308 16521 tablet_bootstrap.cc:590] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:51.977174 16399 raft_consensus.cc:2346] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df4bcb3f585940acab1e8647d6d40269 in term 1. I0401 16:41:51.970461 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bfca62509b3e4b948f974b48c8a3744d" candidate_uuid: "df4bcb3f585940acab1e8647d6d40269" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:51.977470 16285 leader_election.cc:310] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269; no voters: fa1dbf7aa4e34d1c8aeac54870393547 I0401 16:41:51.977773 16551 raft_consensus.cc:2640] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election won for term 1 W0401 16:41:51.977809 16282 leader_election.cc:348] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:51.977903 16551 raft_consensus.cc:667] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Becoming Leader. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Running, Role: LEADER I0401 16:41:51.978109 16551 consensus_queue.cc:206] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.981242 16522 tablet_bootstrap.cc:439] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b: No bootstrap required, opened a new log I0401 16:41:51.981587 16522 ts_tablet_manager.cc:1053] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b: Time spent bootstrapping tablet: real 0.018s user 0.003s sys 0.002s I0401 16:41:51.982831 16233 catalog_manager.cc:3977] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 reported cstate change: term changed from 0 to 1, leader changed from to df4bcb3f585940acab1e8647d6d40269 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "df4bcb3f585940acab1e8647d6d40269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: UNKNOWN } } } I0401 16:41:51.984216 16522 raft_consensus.cc:340] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.984351 16522 raft_consensus.cc:366] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:51.984375 16522 raft_consensus.cc:705] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Initialized, Role: FOLLOWER I0401 16:41:51.984494 16522 consensus_queue.cc:229] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.985009 16522 ts_tablet_manager.cc:1081] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s I0401 16:41:51.985232 16529 raft_consensus.cc:472] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:51.989280 16529 raft_consensus.cc:494] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.991569 16529 leader_election.cc:296] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:51.993067 16550 raft_consensus.cc:472] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:51.993157 16550 raft_consensus.cc:494] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.993877 16550 leader_election.cc:296] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:51.994803 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "23315893717f4d85bf67e1bc90a41ae6" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:51.994833 16321 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "23315893717f4d85bf67e1bc90a41ae6" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:51.994999 16321 raft_consensus.cc:2346] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 0. W0401 16:41:51.995522 16353 leader_election.cc:348] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:51.996009 16356 leader_election.cc:310] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269; no voters: fa1dbf7aa4e34d1c8aeac54870393547 I0401 16:41:51.996402 16550 raft_consensus.cc:2640] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:51.996448 16550 raft_consensus.cc:472] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:51.996495 16550 raft_consensus.cc:2886] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:51.998224 16523 tablet_bootstrap.cc:439] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:51.998360 16523 ts_tablet_manager.cc:1053] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.037s user 0.002s sys 0.004s I0401 16:41:51.999922 16550 raft_consensus.cc:494] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:51.999342 16321 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "45c919434c794f00945387c3431ffa50" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.000190 16321 raft_consensus.cc:2346] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 0. I0401 16:41:52.000471 16442 leader_election.cc:310] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547; no voters: I0401 16:41:52.000212 16233 catalog_manager.cc:3977] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 reported cstate change: term changed from 0 to 1, leader changed from to df4bcb3f585940acab1e8647d6d40269 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "df4bcb3f585940acab1e8647d6d40269" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: UNKNOWN } } } I0401 16:41:52.000536 16550 leader_election.cc:296] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Requested vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:52.000928 16529 raft_consensus.cc:2640] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:52.000978 16529 raft_consensus.cc:472] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:52.000928 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "23315893717f4d85bf67e1bc90a41ae6" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" I0401 16:41:52.001024 16529 raft_consensus.cc:2886] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 W0401 16:41:52.001330 16353 leader_election.cc:348] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:52.001857 16523 raft_consensus.cc:340] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:52.002013 16523 raft_consensus.cc:366] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:52.002048 16523 raft_consensus.cc:705] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:52.002226 16523 consensus_queue.cc:229] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:52.002406 16321 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "23315893717f4d85bf67e1bc90a41ae6" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" I0401 16:41:52.002522 16321 raft_consensus.cc:2886] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.003453 16523 ts_tablet_manager.cc:1081] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s I0401 16:41:52.003687 16523 tablet_bootstrap.cc:439] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269: Bootstrap starting. I0401 16:41:52.007409 16529 raft_consensus.cc:494] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.008072 16529 leader_election.cc:296] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 election: Requested vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:52.009023 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "45c919434c794f00945387c3431ffa50" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" I0401 16:41:52.009150 16320 raft_consensus.cc:2886] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.009424 16321 raft_consensus.cc:2346] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 1. I0401 16:41:52.010004 16356 leader_election.cc:310] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269; no voters: fa1dbf7aa4e34d1c8aeac54870393547 I0401 16:41:52.010761 16523 tablet_bootstrap.cc:590] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269: No blocks or log segments found. Creating new log. I0401 16:41:52.010957 16550 raft_consensus.cc:2640] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:52.011059 16550 raft_consensus.cc:667] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Becoming Leader. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Running, Role: LEADER I0401 16:41:52.011171 16320 raft_consensus.cc:2346] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 1. I0401 16:41:52.011262 16550 consensus_queue.cc:206] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.011457 16442 leader_election.cc:310] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547; no voters: I0401 16:41:52.011664 16521 tablet_bootstrap.cc:439] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:52.011754 16529 raft_consensus.cc:2640] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:52.011778 16521 ts_tablet_manager.cc:1053] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.043s user 0.003s sys 0.010s I0401 16:41:52.012966 16399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "45c919434c794f00945387c3431ffa50" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true I0401 16:41:52.013118 16399 raft_consensus.cc:2346] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 0. I0401 16:41:52.013048 16521 raft_consensus.cc:340] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.013177 16521 raft_consensus.cc:366] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:52.013198 16521 raft_consensus.cc:705] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:52.013311 16521 consensus_queue.cc:229] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.013718 16398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "45c919434c794f00945387c3431ffa50" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" I0401 16:41:52.013860 16398 raft_consensus.cc:2886] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.023231 16398 raft_consensus.cc:2346] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 1. I0401 16:41:52.024070 16529 raft_consensus.cc:667] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 LEADER]: Becoming Leader. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Running, Role: LEADER I0401 16:41:52.024328 16529 consensus_queue.cc:206] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.024570 16566 raft_consensus.cc:472] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.024696 16566 raft_consensus.cc:494] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.025357 16566 leader_election.cc:296] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:52.025806 16233 catalog_manager.cc:3977] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b reported cstate change: term changed from 0 to 1, leader changed from to cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2). New cstate: current_term: 1 leader_uuid: "cd20ceec0aab4841b45376dd0bb4713b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: UNKNOWN } } } I0401 16:41:52.026517 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "2971bb5eed124316add709582295f9a8" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.026674 16320 raft_consensus.cc:2346] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 0. I0401 16:41:52.027113 16398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "2971bb5eed124316add709582295f9a8" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true I0401 16:41:52.027279 16398 raft_consensus.cc:2346] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 0. I0401 16:41:52.027570 16442 leader_election.cc:310] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, fa1dbf7aa4e34d1c8aeac54870393547; no voters: I0401 16:41:52.028102 16521 ts_tablet_manager.cc:1081] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.016s user 0.001s sys 0.007s I0401 16:41:52.028903 16566 raft_consensus.cc:2640] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:52.029546 16566 raft_consensus.cc:472] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:52.029649 16566 raft_consensus.cc:2886] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.029846 16521 tablet_bootstrap.cc:439] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:52.033195 16233 catalog_manager.cc:3977] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 reported cstate change: term changed from 0 to 1, leader changed from to fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: HEALTHY } } } I0401 16:41:52.034186 16521 tablet_bootstrap.cc:590] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:52.034469 16523 tablet_bootstrap.cc:439] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269: No bootstrap required, opened a new log I0401 16:41:52.032814 16566 raft_consensus.cc:494] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.034584 16523 ts_tablet_manager.cc:1053] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.009s I0401 16:41:52.035043 16566 leader_election.cc:296] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 election: Requested vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:52.035346 16523 raft_consensus.cc:340] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.035526 16523 raft_consensus.cc:366] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:52.035562 16523 raft_consensus.cc:705] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df4bcb3f585940acab1e8647d6d40269, State: Initialized, Role: FOLLOWER I0401 16:41:52.035662 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "2971bb5eed124316add709582295f9a8" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" I0401 16:41:52.035787 16320 raft_consensus.cc:2886] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.035662 16398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "2971bb5eed124316add709582295f9a8" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" I0401 16:41:52.035696 16523 consensus_queue.cc:229] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.035888 16398 raft_consensus.cc:2886] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.036219 16523 ts_tablet_manager.cc:1081] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:41:52.038142 16398 raft_consensus.cc:2346] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 1. I0401 16:41:52.038467 16442 leader_election.cc:310] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, fa1dbf7aa4e34d1c8aeac54870393547; no voters: I0401 16:41:52.040063 16566 raft_consensus.cc:2640] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:52.040186 16566 raft_consensus.cc:667] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 LEADER]: Becoming Leader. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Running, Role: LEADER I0401 16:41:52.038143 16320 raft_consensus.cc:2346] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 1. I0401 16:41:52.040525 16566 consensus_queue.cc:206] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.042268 16550 raft_consensus.cc:472] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.042340 16550 raft_consensus.cc:494] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.043150 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4250b540766b42328f9dc22a577cd51d" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.043298 16320 raft_consensus.cc:2346] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 0. I0401 16:41:52.043277 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4250b540766b42328f9dc22a577cd51d" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:52.043618 16356 leader_election.cc:310] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269; no voters: W0401 16:41:52.043704 16353 leader_election.cc:348] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:52.043817 16550 leader_election.cc:296] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:52.043967 16527 raft_consensus.cc:2640] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:52.044011 16527 raft_consensus.cc:472] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:52.044059 16527 raft_consensus.cc:2886] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.046192 16527 raft_consensus.cc:494] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.046799 16527 leader_election.cc:296] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Requested vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:52.047122 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4250b540766b42328f9dc22a577cd51d" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" I0401 16:41:52.047171 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4250b540766b42328f9dc22a577cd51d" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" I0401 16:41:52.047291 16320 raft_consensus.cc:2886] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.047540 16521 tablet_bootstrap.cc:439] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log W0401 16:41:52.047530 16353 leader_election.cc:348] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:52.047694 16521 ts_tablet_manager.cc:1053] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.019s user 0.000s sys 0.005s I0401 16:41:52.046597 16233 catalog_manager.cc:3977] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 reported cstate change: term changed from 0 to 1, leader changed from to fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: HEALTHY } } } I0401 16:41:52.048257 16521 raft_consensus.cc:340] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.048373 16521 raft_consensus.cc:366] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:52.048426 16521 raft_consensus.cc:705] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:52.048581 16521 consensus_queue.cc:229] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.049077 16521 ts_tablet_manager.cc:1081] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0401 16:41:52.049324 16521 tablet_bootstrap.cc:439] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547: Bootstrap starting. I0401 16:41:52.050664 16521 tablet_bootstrap.cc:590] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547: No blocks or log segments found. Creating new log. I0401 16:41:52.055212 16320 raft_consensus.cc:2346] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 1. I0401 16:41:52.055496 16356 leader_election.cc:310] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269; no voters: fa1dbf7aa4e34d1c8aeac54870393547 I0401 16:41:52.055869 16527 raft_consensus.cc:2640] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:52.056001 16527 raft_consensus.cc:667] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Becoming Leader. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Running, Role: LEADER I0401 16:41:52.056191 16527 consensus_queue.cc:206] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.056996 16521 tablet_bootstrap.cc:439] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547: No bootstrap required, opened a new log I0401 16:41:52.057072 16521 ts_tablet_manager.cc:1053] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.003s I0401 16:41:52.057641 16521 raft_consensus.cc:340] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.057873 16521 raft_consensus.cc:366] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:52.057936 16521 raft_consensus.cc:705] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Initialized, Role: FOLLOWER I0401 16:41:52.058537 16521 consensus_queue.cc:229] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.059069 16521 ts_tablet_manager.cc:1081] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s I0401 16:41:52.058605 16233 catalog_manager.cc:3977] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b reported cstate change: term changed from 0 to 1, leader changed from to cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2). New cstate: current_term: 1 leader_uuid: "cd20ceec0aab4841b45376dd0bb4713b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: UNKNOWN } } } I0401 16:41:52.117559 16566 raft_consensus.cc:472] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.117666 16566 raft_consensus.cc:494] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.118247 16566 leader_election.cc:296] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867) I0401 16:41:52.118626 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c2a60d7d62614394b023920482b988f1" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.118626 16398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c2a60d7d62614394b023920482b988f1" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true I0401 16:41:52.118759 16320 raft_consensus.cc:2346] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 0. I0401 16:41:52.118803 16398 raft_consensus.cc:2346] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 0. I0401 16:41:52.119035 16442 leader_election.cc:310] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547; no voters: I0401 16:41:52.119221 16566 raft_consensus.cc:2640] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:52.119272 16566 raft_consensus.cc:472] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:52.119328 16566 raft_consensus.cc:2886] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.120901 16566 raft_consensus.cc:494] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.121467 16566 leader_election.cc:296] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 election: Requested vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867) I0401 16:41:52.121937 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c2a60d7d62614394b023920482b988f1" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" I0401 16:41:52.122076 16320 raft_consensus.cc:2886] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.122102 16398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "c2a60d7d62614394b023920482b988f1" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" I0401 16:41:52.122223 16398 raft_consensus.cc:2886] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.123598 16320 raft_consensus.cc:2346] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 1. I0401 16:41:52.123862 16442 leader_election.cc:310] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547; no voters: I0401 16:41:52.124056 16566 raft_consensus.cc:2640] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:52.123869 16398 raft_consensus.cc:2346] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fa1dbf7aa4e34d1c8aeac54870393547 in term 1. I0401 16:41:52.124552 16566 raft_consensus.cc:667] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 LEADER]: Becoming Leader. State: Replica: fa1dbf7aa4e34d1c8aeac54870393547, State: Running, Role: LEADER I0401 16:41:52.124765 16566 consensus_queue.cc:206] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.126997 16233 catalog_manager.cc:3977] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 reported cstate change: term changed from 0 to 1, leader changed from to fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: HEALTHY } } } I0401 16:41:52.140197 16527 raft_consensus.cc:472] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.140323 16527 raft_consensus.cc:494] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:52.141016 16527 leader_election.cc:296] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809), df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867) I0401 16:41:52.141297 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3fd4c662330147308de7aaf015f1c526" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:52.141381 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3fd4c662330147308de7aaf015f1c526" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.141446 16478 raft_consensus.cc:2346] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 0. I0401 16:41:52.141501 16320 raft_consensus.cc:2346] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 0. I0401 16:41:52.141750 16353 leader_election.cc:310] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, fa1dbf7aa4e34d1c8aeac54870393547; no voters: I0401 16:41:52.141976 16527 raft_consensus.cc:2640] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:52.142019 16527 raft_consensus.cc:472] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:52.142062 16527 raft_consensus.cc:2886] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.143592 16527 raft_consensus.cc:494] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:52.144160 16527 leader_election.cc:296] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Requested vote from peers fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809), df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867) I0401 16:41:52.144420 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3fd4c662330147308de7aaf015f1c526" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" I0401 16:41:52.144534 16478 raft_consensus.cc:2886] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.144594 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3fd4c662330147308de7aaf015f1c526" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" I0401 16:41:52.144733 16320 raft_consensus.cc:2886] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.146065 16478 raft_consensus.cc:2346] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 1. I0401 16:41:52.146458 16353 leader_election.cc:310] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b, fa1dbf7aa4e34d1c8aeac54870393547; no voters: I0401 16:41:52.146529 16320 raft_consensus.cc:2346] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd20ceec0aab4841b45376dd0bb4713b in term 1. I0401 16:41:52.146644 16527 raft_consensus.cc:2640] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:52.146744 16527 raft_consensus.cc:667] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Becoming Leader. State: Replica: cd20ceec0aab4841b45376dd0bb4713b, State: Running, Role: LEADER I0401 16:41:52.146973 16527 consensus_queue.cc:206] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } I0401 16:41:52.149070 16233 catalog_manager.cc:3977] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b reported cstate change: term changed from 0 to 1, leader changed from to cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2). New cstate: current_term: 1 leader_uuid: "cd20ceec0aab4841b45376dd0bb4713b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } health_report { overall_health: UNKNOWN } } } I0401 16:41:52.160408 16527 raft_consensus.cc:472] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.160506 16527 raft_consensus.cc:494] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.161255 16527 leader_election.cc:296] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:52.161592 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "738f3ce8a91441cdab27e453c5fea465" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.161610 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "738f3ce8a91441cdab27e453c5fea465" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:52.161731 16320 raft_consensus.cc:2307] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate cd20ceec0aab4841b45376dd0bb4713b for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:52.161770 16478 raft_consensus.cc:2276] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd20ceec0aab4841b45376dd0bb4713b in current term 1: Already voted for candidate df4bcb3f585940acab1e8647d6d40269 in this term. I0401 16:41:52.162144 16353 leader_election.cc:310] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b; no voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547 I0401 16:41:52.162329 16527 raft_consensus.cc:2886] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.164410 16527 raft_consensus.cc:2588] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:52.180349 16527 raft_consensus.cc:472] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.180450 16527 raft_consensus.cc:494] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.181046 16527 leader_election.cc:296] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), fa1dbf7aa4e34d1c8aeac54870393547 (127.11.224.3:32809) I0401 16:41:52.181358 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9c3ee1837ea840e0b758d8b696e713c7" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.181401 16478 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "9c3ee1837ea840e0b758d8b696e713c7" candidate_uuid: "cd20ceec0aab4841b45376dd0bb4713b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" is_pre_election: true I0401 16:41:52.181506 16320 raft_consensus.cc:2307] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate cd20ceec0aab4841b45376dd0bb4713b for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:52.181532 16478 raft_consensus.cc:2276] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd20ceec0aab4841b45376dd0bb4713b in current term 1: Already voted for candidate df4bcb3f585940acab1e8647d6d40269 in this term. I0401 16:41:52.181869 16356 leader_election.cc:310] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cd20ceec0aab4841b45376dd0bb4713b; no voters: df4bcb3f585940acab1e8647d6d40269, fa1dbf7aa4e34d1c8aeac54870393547 I0401 16:41:52.182101 16527 raft_consensus.cc:2886] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.184173 16527 raft_consensus.cc:2588] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:52.214506 16478 raft_consensus.cc:1181] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Refusing update from remote peer cd20ceec0aab4841b45376dd0bb4713b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:52.214570 16320 raft_consensus.cc:1181] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Refusing update from remote peer cd20ceec0aab4841b45376dd0bb4713b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:52.214975 16550 consensus_queue.cc:984] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.215128 16527 consensus_queue.cc:984] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.255749 16566 raft_consensus.cc:472] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.255877 16566 raft_consensus.cc:494] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.256484 16566 leader_election.cc:296] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:52.256880 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "23315893717f4d85bf67e1bc90a41ae6" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.256880 16398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "23315893717f4d85bf67e1bc90a41ae6" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true I0401 16:41:52.257063 16320 raft_consensus.cc:2276] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa1dbf7aa4e34d1c8aeac54870393547 in current term 1: Already voted for candidate cd20ceec0aab4841b45376dd0bb4713b in this term. I0401 16:41:52.257063 16398 raft_consensus.cc:2307] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate fa1dbf7aa4e34d1c8aeac54870393547 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:52.257802 16442 leader_election.cc:310] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1dbf7aa4e34d1c8aeac54870393547; no voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269 I0401 16:41:52.258030 16566 raft_consensus.cc:2886] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.260228 16566 raft_consensus.cc:2588] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:52.275446 16566 raft_consensus.cc:472] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.275607 16566 raft_consensus.cc:494] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.276612 16566 leader_election.cc:296] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243), df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867) I0401 16:41:52.276868 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bfca62509b3e4b948f974b48c8a3744d" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.277035 16320 raft_consensus.cc:2307] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate fa1dbf7aa4e34d1c8aeac54870393547 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:52.276988 16398 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "bfca62509b3e4b948f974b48c8a3744d" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true I0401 16:41:52.277129 16398 raft_consensus.cc:2276] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa1dbf7aa4e34d1c8aeac54870393547 in current term 1: Already voted for candidate df4bcb3f585940acab1e8647d6d40269 in this term. I0401 16:41:52.277478 16442 leader_election.cc:310] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1dbf7aa4e34d1c8aeac54870393547; no voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269 I0401 16:41:52.277709 16566 raft_consensus.cc:2886] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.279736 16566 raft_consensus.cc:2588] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:52.285181 16478 raft_consensus.cc:1181] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Refusing update from remote peer cd20ceec0aab4841b45376dd0bb4713b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:52.285305 16320 raft_consensus.cc:1181] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Refusing update from remote peer cd20ceec0aab4841b45376dd0bb4713b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:52.285735 16550 consensus_queue.cc:984] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.285907 16527 consensus_queue.cc:984] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.346560 16478 raft_consensus.cc:1181] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Refusing update from remote peer df4bcb3f585940acab1e8647d6d40269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:52.346974 16398 raft_consensus.cc:1181] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Refusing update from remote peer df4bcb3f585940acab1e8647d6d40269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:52.347369 16551 consensus_queue.cc:984] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.347641 16551 consensus_queue.cc:984] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.375802 16276 catalog_manager.cc:1111] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9: acquiring CA information for follower catalog manager: success I0401 16:41:52.378901 16276 catalog_manager.cc:1139] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:52.390146 16477 raft_consensus.cc:1181] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Refusing update from remote peer df4bcb3f585940acab1e8647d6d40269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.390571 16551 consensus_queue.cc:984] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.391432 16279 catalog_manager.cc:1111] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365: acquiring CA information for follower catalog manager: success I0401 16:41:52.394570 16279 catalog_manager.cc:1139] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:52.402107 16398 raft_consensus.cc:1181] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Refusing update from remote peer df4bcb3f585940acab1e8647d6d40269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.403012 16528 consensus_queue.cc:984] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.406814 16477 raft_consensus.cc:1181] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Refusing update from remote peer df4bcb3f585940acab1e8647d6d40269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:52.407239 16398 raft_consensus.cc:1181] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Refusing update from remote peer df4bcb3f585940acab1e8647d6d40269: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:52.407383 16528 consensus_queue.cc:984] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.408501 16551 consensus_queue.cc:984] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.410118 16566 raft_consensus.cc:472] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:52.410199 16566 raft_consensus.cc:494] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 } } peers { permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 } } peers { permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 } } I0401 16:41:52.410778 16566 leader_election.cc:296] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867), cd20ceec0aab4841b45376dd0bb4713b (127.11.224.2:58243) I0401 16:41:52.411300 16399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4250b540766b42328f9dc22a577cd51d" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd20ceec0aab4841b45376dd0bb4713b" is_pre_election: true I0401 16:41:52.411454 16399 raft_consensus.cc:2307] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate fa1dbf7aa4e34d1c8aeac54870393547 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:52.411389 16320 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "4250b540766b42328f9dc22a577cd51d" candidate_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df4bcb3f585940acab1e8647d6d40269" is_pre_election: true I0401 16:41:52.411538 16320 raft_consensus.cc:2276] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fa1dbf7aa4e34d1c8aeac54870393547 in current term 1: Already voted for candidate cd20ceec0aab4841b45376dd0bb4713b in this term. I0401 16:41:52.411926 16442 leader_election.cc:310] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fa1dbf7aa4e34d1c8aeac54870393547; no voters: cd20ceec0aab4841b45376dd0bb4713b, df4bcb3f585940acab1e8647d6d40269 I0401 16:41:52.412370 16566 raft_consensus.cc:2886] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:52.416666 16399 raft_consensus.cc:1181] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Refusing update from remote peer fa1dbf7aa4e34d1c8aeac54870393547: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.417135 16529 consensus_queue.cc:984] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.419920 16566 raft_consensus.cc:2588] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:52.435770 16320 raft_consensus.cc:1181] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Refusing update from remote peer fa1dbf7aa4e34d1c8aeac54870393547: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.436722 16566 consensus_queue.cc:984] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.448420 16477 raft_consensus.cc:1181] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Refusing update from remote peer cd20ceec0aab4841b45376dd0bb4713b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.449331 16554 consensus_queue.cc:984] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s I0401 16:41:52.462003 16399 raft_consensus.cc:1181] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Refusing update from remote peer fa1dbf7aa4e34d1c8aeac54870393547: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.464273 16320 raft_consensus.cc:1181] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Refusing update from remote peer fa1dbf7aa4e34d1c8aeac54870393547: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.463140 16566 consensus_queue.cc:984] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s I0401 16:41:52.470640 16566 consensus_queue.cc:984] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.478545 16320 raft_consensus.cc:1181] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Refusing update from remote peer cd20ceec0aab4841b45376dd0bb4713b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.479715 16554 consensus_queue.cc:984] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.496592 16320 raft_consensus.cc:1181] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Refusing update from remote peer cd20ceec0aab4841b45376dd0bb4713b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.497421 16554 consensus_queue.cc:984] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.501778 16477 raft_consensus.cc:1181] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Refusing update from remote peer cd20ceec0aab4841b45376dd0bb4713b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.503309 16550 consensus_queue.cc:984] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fa1dbf7aa4e34d1c8aeac54870393547" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 32809 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.507854 16399 raft_consensus.cc:1181] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Refusing update from remote peer fa1dbf7aa4e34d1c8aeac54870393547: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.508744 16567 consensus_queue.cc:984] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd20ceec0aab4841b45376dd0bb4713b" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 58243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:52.517294 16320 raft_consensus.cc:1181] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Refusing update from remote peer fa1dbf7aa4e34d1c8aeac54870393547: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:52.518075 16529 consensus_queue.cc:984] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df4bcb3f585940acab1e8647d6d40269" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 46867 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:53.671773 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:53.691390 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:53.691506 12160 tablet_replica.cc:264] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.691615 12160 raft_consensus.cc:2143] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.691728 12160 raft_consensus.cc:2170] T c2a60d7d62614394b023920482b988f1 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.693050 12160 tablet_replica.cc:264] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.693169 12160 raft_consensus.cc:2143] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.693291 12160 raft_consensus.cc:2170] T 45c919434c794f00945387c3431ffa50 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.693886 12160 tablet_replica.cc:264] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.694084 12160 raft_consensus.cc:2143] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.694563 12160 raft_consensus.cc:2170] T 3fd4c662330147308de7aaf015f1c526 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.695174 12160 tablet_replica.cc:264] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.695351 12160 raft_consensus.cc:2143] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.695480 12160 raft_consensus.cc:2170] T 23315893717f4d85bf67e1bc90a41ae6 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.695966 12160 tablet_replica.cc:264] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.696070 12160 raft_consensus.cc:2143] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.696307 12160 raft_consensus.cc:2170] T 9c3ee1837ea840e0b758d8b696e713c7 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.697136 12160 tablet_replica.cc:264] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.697235 12160 raft_consensus.cc:2143] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.697326 12160 raft_consensus.cc:2170] T 2971bb5eed124316add709582295f9a8 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.697691 12160 tablet_replica.cc:264] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.697789 12160 raft_consensus.cc:2143] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.697978 12160 raft_consensus.cc:2170] T bfca62509b3e4b948f974b48c8a3744d P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.709864 12160 tablet_replica.cc:264] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.710006 12160 raft_consensus.cc:2143] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.710101 12160 raft_consensus.cc:2170] T 4250b540766b42328f9dc22a577cd51d P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.710819 12160 tablet_replica.cc:264] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.710937 12160 raft_consensus.cc:2143] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.711094 12160 raft_consensus.cc:2170] T 738f3ce8a91441cdab27e453c5fea465 P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.711447 12160 tablet_replica.cc:264] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269: stopping tablet replica I0401 16:41:53.711534 12160 raft_consensus.cc:2143] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.711609 12160 raft_consensus.cc:2170] T 767ff9cf36144c55925b925c438942ff P df4bcb3f585940acab1e8647d6d40269 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.729383 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:53.729431 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:53.729552 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:53.733454 12160 tablet_server.cc:165] TabletServer shutting down... W0401 16:41:53.740375 16442 consensus_peers.cc:457] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 -> Peer df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867): Couldn't send request to peer df4bcb3f585940acab1e8647d6d40269. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:46867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. W0401 16:41:53.746882 16356 consensus_peers.cc:457] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b -> Peer df4bcb3f585940acab1e8647d6d40269 (127.11.224.1:46867): Couldn't send request to peer df4bcb3f585940acab1e8647d6d40269. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:46867: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:53.751787 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:53.751905 12160 tablet_replica.cc:264] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.752022 12160 raft_consensus.cc:2143] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.752118 12160 raft_consensus.cc:2170] T 9c3ee1837ea840e0b758d8b696e713c7 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.752934 12160 tablet_replica.cc:264] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.753024 12160 raft_consensus.cc:2143] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.753100 12160 raft_consensus.cc:2170] T 2971bb5eed124316add709582295f9a8 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.753453 12160 tablet_replica.cc:264] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.753540 12160 raft_consensus.cc:2143] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.753614 12160 raft_consensus.cc:2170] T 738f3ce8a91441cdab27e453c5fea465 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.753991 12160 tablet_replica.cc:264] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.754077 12160 raft_consensus.cc:2143] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.754240 12160 raft_consensus.cc:2170] T 4250b540766b42328f9dc22a577cd51d P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.754595 12160 tablet_replica.cc:264] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.754678 12160 raft_consensus.cc:2143] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.754823 12160 raft_consensus.cc:2170] T 767ff9cf36144c55925b925c438942ff P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.755197 12160 tablet_replica.cc:264] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.755281 12160 raft_consensus.cc:2143] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.755352 12160 raft_consensus.cc:2170] T c2a60d7d62614394b023920482b988f1 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.756038 12160 tablet_replica.cc:264] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.756124 12160 raft_consensus.cc:2143] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.756275 12160 raft_consensus.cc:2170] T 23315893717f4d85bf67e1bc90a41ae6 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.756737 12160 tablet_replica.cc:264] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.756824 12160 raft_consensus.cc:2143] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.756985 12160 raft_consensus.cc:2170] T 3fd4c662330147308de7aaf015f1c526 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.757336 12160 tablet_replica.cc:264] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.757419 12160 raft_consensus.cc:2143] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.757493 12160 raft_consensus.cc:2170] T 45c919434c794f00945387c3431ffa50 P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.757926 12160 tablet_replica.cc:264] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b: stopping tablet replica I0401 16:41:53.758006 12160 raft_consensus.cc:2143] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.758080 12160 raft_consensus.cc:2170] T bfca62509b3e4b948f974b48c8a3744d P cd20ceec0aab4841b45376dd0bb4713b [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.775311 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:53.775354 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:53.775482 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:53.778905 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:53.803154 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:53.803261 12160 tablet_replica.cc:264] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.803380 12160 raft_consensus.cc:2143] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.803489 12160 raft_consensus.cc:2170] T bfca62509b3e4b948f974b48c8a3744d P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.804076 12160 tablet_replica.cc:264] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.804165 12160 raft_consensus.cc:2143] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.804337 12160 raft_consensus.cc:2170] T c2a60d7d62614394b023920482b988f1 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.804908 12160 tablet_replica.cc:264] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.804994 12160 raft_consensus.cc:2143] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.805068 12160 raft_consensus.cc:2170] T 767ff9cf36144c55925b925c438942ff P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.805408 12160 tablet_replica.cc:264] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.805495 12160 raft_consensus.cc:2143] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.805637 12160 raft_consensus.cc:2170] T 2971bb5eed124316add709582295f9a8 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.806010 12160 tablet_replica.cc:264] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.806094 12160 raft_consensus.cc:2143] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.806167 12160 raft_consensus.cc:2170] T 9c3ee1837ea840e0b758d8b696e713c7 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.806509 12160 tablet_replica.cc:264] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.806593 12160 raft_consensus.cc:2143] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.806737 12160 raft_consensus.cc:2170] T 45c919434c794f00945387c3431ffa50 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.807118 12160 tablet_replica.cc:264] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.807210 12160 raft_consensus.cc:2143] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.807289 12160 raft_consensus.cc:2170] T 23315893717f4d85bf67e1bc90a41ae6 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.807642 12160 tablet_replica.cc:264] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.807732 12160 raft_consensus.cc:2143] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.807806 12160 raft_consensus.cc:2170] T 3fd4c662330147308de7aaf015f1c526 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.808184 12160 tablet_replica.cc:264] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.808269 12160 raft_consensus.cc:2143] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.808349 12160 raft_consensus.cc:2170] T 4250b540766b42328f9dc22a577cd51d P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.808708 12160 tablet_replica.cc:264] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547: stopping tablet replica I0401 16:41:53.808791 12160 raft_consensus.cc:2143] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.808871 12160 raft_consensus.cc:2170] T 738f3ce8a91441cdab27e453c5fea465 P fa1dbf7aa4e34d1c8aeac54870393547 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.824895 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:53.824936 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:53.825055 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:53.828554 12160 master.cc:270] Master@127.11.224.62:47162 shutting down... I0401 16:41:53.838287 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.838399 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.838457 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P d615d3567ad94867a869ba26b32ad365: stopping tablet replica I0401 16:41:53.841536 12160 master.cc:281] Master@127.11.224.62:47162 shutdown complete. I0401 16:41:53.843796 12160 master.cc:270] Master@127.11.224.61:39871 shutting down... I0401 16:41:53.853098 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:53.853200 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.853267 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P f8991cfaa67a4eb09bca751df54d8ad9: stopping tablet replica I0401 16:41:53.866123 12160 master.cc:281] Master@127.11.224.61:39871 shutdown complete. I0401 16:41:53.881443 12160 master.cc:270] Master@127.11.224.60:38386 shutting down... I0401 16:41:53.891695 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:53.891952 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:53.892040 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 4c416e88ff1b4443b64d8924059c475e: stopping tablet replica I0401 16:41:53.895272 12160 master.cc:281] Master@127.11.224.60:38386 shutdown complete. [ OK ] RemoteKsckTest.TestChecksumSnapshotCurrentTimestamp (2733 ms) [ RUN ] RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM I0401 16:41:53.911805 12160 test_util.cc:212] Using random seed: -1866916870 I0401 16:41:53.912295 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:56282,127.11.224.61:38064,127.11.224.60:44441 I0401 16:41:53.915563 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 846931us I0401 16:41:53.915695 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:53.915724 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:53.915786 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:53.915808 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:53.916220 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "66dce64e6ea840c383918fc8e5e4b1ae" format_stamp: "Formatted at 2019-04-01 23:41:53 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:53.920166 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s I0401 16:41:53.920742 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:53.922466 12160 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0401 16:41:53.922503 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-0-root uuid: "66dce64e6ea840c383918fc8e5e4b1ae" format_stamp: "Formatted at 2019-04-01 23:41:53 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:53.922559 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:53.963330 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:56282 I0401 16:41:53.963910 12160 webserver.cc:308] Webserver started at http://127.11.224.62:33008/ using document root and password file I0401 16:41:53.964756 16700 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:53.966609 16700 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:53.967368 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 846931us I0401 16:41:53.968106 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:53.968164 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:53.968286 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:53.968340 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:53.968856 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" format_stamp: "Formatted at 2019-04-01 23:41:53 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:53.973222 16700 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:53.973448 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s W0401 16:41:53.973968 16700 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:38064: Network error: Client connection negotiation failed: client connection to 127.11.224.61:38064: connect: Connection refused (error 111) I0401 16:41:53.974241 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:53.976114 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:53.976155 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-1-root uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" format_stamp: "Formatted at 2019-04-01 23:41:53 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:53.976212 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:53.993156 16700 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } attempt: 1 W0401 16:41:53.993903 16700 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:38064: Network error: Client connection negotiation failed: client connection to 127.11.224.61:38064: connect: Connection refused (error 111) I0401 16:41:54.004582 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:38064 I0401 16:41:54.005184 12160 webserver.cc:308] Webserver started at http://127.11.224.61:54986/ using document root and password file I0401 16:41:54.005981 16757 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.007802 16757 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:54.009114 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847431us I0401 16:41:54.009243 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:54.009277 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:54.009402 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:54.009459 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:54.010015 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "97cf8f99ee6e4e759679a8292962551d" format_stamp: "Formatted at 2019-04-01 23:41:54 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:54.012913 16757 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:54.014797 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s I0401 16:41:54.015504 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:54.017640 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:54.017680 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-2-root uuid: "97cf8f99ee6e4e759679a8292962551d" format_stamp: "Formatted at 2019-04-01 23:41:54 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:54.017735 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:54.017731 16757 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:54.018409 16757 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:44441: Network error: Client connection negotiation failed: client connection to 127.11.224.60:44441: connect: Connection refused (error 111) I0401 16:41:54.028079 16700 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } attempt: 2 I0401 16:41:54.032732 16700 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:54.033437 16700 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:44441: Network error: Client connection negotiation failed: client connection to 127.11.224.60:44441: connect: Connection refused (error 111) I0401 16:41:54.038607 16757 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } attempt: 1 W0401 16:41:54.039438 16757 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:44441: Network error: Client connection negotiation failed: client connection to 127.11.224.60:44441: connect: Connection refused (error 111) I0401 16:41:54.046133 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:44441 I0401 16:41:54.046860 12160 webserver.cc:308] Webserver started at http://127.11.224.60:40627/ using document root and password file I0401 16:41:54.047184 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:54.047798 16814 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.049674 16814 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:54.053814 16814 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:54.057392 16814 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:54.063377 16814 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d: Bootstrap starting. I0401 16:41:54.064473 16814 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d: No blocks or log segments found. Creating new log. I0401 16:41:54.066097 16814 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d: No bootstrap required, opened a new log I0401 16:41:54.066637 16814 raft_consensus.cc:340] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.066774 16814 raft_consensus.cc:366] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.066825 16814 raft_consensus.cc:705] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97cf8f99ee6e4e759679a8292962551d, State: Initialized, Role: FOLLOWER I0401 16:41:54.067034 16814 consensus_queue.cc:229] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.067452 16814 sys_catalog.cc:337] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.067584 16814 sys_catalog.cc:340] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.067504 16818 sys_catalog.cc:337] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.067664 16818 sys_catalog.cc:340] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.068011 16814 sys_catalog.cc:424] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: configured and running, proceeding with master startup. W0401 16:41:54.069208 16819 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:54.069252 16819 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:54.076637 16700 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } attempt: 1 I0401 16:41:54.082084 16700 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae: Bootstrap starting. I0401 16:41:54.083142 16700 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae: No blocks or log segments found. Creating new log. I0401 16:41:54.084594 16700 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae: No bootstrap required, opened a new log I0401 16:41:54.085130 16700 raft_consensus.cc:340] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.085266 16700 raft_consensus.cc:366] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.085296 16700 raft_consensus.cc:705] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66dce64e6ea840c383918fc8e5e4b1ae, State: Initialized, Role: FOLLOWER I0401 16:41:54.085470 16700 consensus_queue.cc:229] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.085896 16700 sys_catalog.cc:337] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.086022 16700 sys_catalog.cc:340] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.085963 16821 sys_catalog.cc:337] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.086092 16821 sys_catalog.cc:340] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.086398 16700 sys_catalog.cc:424] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:54.086727 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 W0401 16:41:54.087597 16822 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:54.087644 16822 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:54.098628 16757 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } attempt: 2 I0401 16:41:54.104169 16757 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e: Bootstrap starting. I0401 16:41:54.105206 16757 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e: No blocks or log segments found. Creating new log. I0401 16:41:54.106623 16757 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e: No bootstrap required, opened a new log I0401 16:41:54.107180 16757 raft_consensus.cc:340] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.107307 16757 raft_consensus.cc:366] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.107342 16757 raft_consensus.cc:705] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 98c0b50f3b9b49c2a017f01d32dfd03e, State: Initialized, Role: FOLLOWER I0401 16:41:54.107492 16757 consensus_queue.cc:229] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.107909 16757 sys_catalog.cc:337] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.108039 16757 sys_catalog.cc:340] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.108027 16824 sys_catalog.cc:337] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.108176 16824 sys_catalog.cc:340] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.108408 16757 sys_catalog.cc:424] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:54.108738 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:54.109884 16825 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:54.109947 16825 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:54.113283 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847431us I0401 16:41:54.113411 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:54.113435 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:54.113494 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:54.113509 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:54.113955 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "f172996cdc0646dc954f931f55011322" format_stamp: "Formatted at 2019-04-01 23:41:54 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:54.117921 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.002s I0401 16:41:54.118566 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:54.120767 12160 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s I0401 16:41:54.120811 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-0-root uuid: "f172996cdc0646dc954f931f55011322" format_stamp: "Formatted at 2019-04-01 23:41:54 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:54.120898 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:54.173182 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:54.173225 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:54.187176 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:41020 I0401 16:41:54.187953 12160 webserver.cc:308] Webserver started at http://127.11.224.1:37002/ using document root and password file I0401 16:41:54.202513 16890 heartbeater.cc:345] Connected to a master server at 127.11.224.60:44441 I0401 16:41:54.202603 16890 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.202793 16890 heartbeater.cc:475] Master 127.11.224.60:44441 requested a full tablet report, sending... I0401 16:41:54.203625 16781 ts_manager.cc:159] Registered new tserver with Master: f172996cdc0646dc954f931f55011322 (127.11.224.1:41020) I0401 16:41:54.203812 16891 heartbeater.cc:345] Connected to a master server at 127.11.224.61:38064 I0401 16:41:54.203866 16891 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.204048 16891 heartbeater.cc:475] Master 127.11.224.61:38064 requested a full tablet report, sending... I0401 16:41:54.204847 16724 ts_manager.cc:159] Registered new tserver with Master: f172996cdc0646dc954f931f55011322 (127.11.224.1:41020) I0401 16:41:54.205199 16892 heartbeater.cc:345] Connected to a master server at 127.11.224.62:56282 I0401 16:41:54.205260 16892 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.205453 16892 heartbeater.cc:475] Master 127.11.224.62:56282 requested a full tablet report, sending... I0401 16:41:54.206255 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847431us I0401 16:41:54.206374 16667 ts_manager.cc:159] Registered new tserver with Master: f172996cdc0646dc954f931f55011322 (127.11.224.1:41020) I0401 16:41:54.206463 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:54.206506 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:54.206601 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:54.206621 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:54.207073 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "82eece752383481aab0e4d4f70d7960c" format_stamp: "Formatted at 2019-04-01 23:41:54 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:54.211463 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s I0401 16:41:54.212155 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:54.214649 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:41:54.214697 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-1-root uuid: "82eece752383481aab0e4d4f70d7960c" format_stamp: "Formatted at 2019-04-01 23:41:54 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:54.214769 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:54.226111 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:54.226155 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:54.244244 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:35483 I0401 16:41:54.245043 12160 webserver.cc:308] Webserver started at http://127.11.224.2:36985/ using document root and password file I0401 16:41:54.252964 16961 heartbeater.cc:345] Connected to a master server at 127.11.224.60:44441 I0401 16:41:54.253042 16961 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.253199 16961 heartbeater.cc:475] Master 127.11.224.60:44441 requested a full tablet report, sending... I0401 16:41:54.253861 16781 ts_manager.cc:159] Registered new tserver with Master: 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483) I0401 16:41:54.254323 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847431us I0401 16:41:54.254495 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:54.254539 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:54.254652 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:54.254712 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:54.255502 16962 heartbeater.cc:345] Connected to a master server at 127.11.224.61:38064 I0401 16:41:54.255573 16962 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.255722 16962 heartbeater.cc:475] Master 127.11.224.61:38064 requested a full tablet report, sending... I0401 16:41:54.255753 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "9d2910a181674a39a19707efa79d3135" format_stamp: "Formatted at 2019-04-01 23:41:54 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:54.256490 16724 ts_manager.cc:159] Registered new tserver with Master: 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483) I0401 16:41:54.259086 16963 heartbeater.cc:345] Connected to a master server at 127.11.224.62:56282 I0401 16:41:54.259140 16963 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.259275 16963 heartbeater.cc:475] Master 127.11.224.62:56282 requested a full tablet report, sending... I0401 16:41:54.260013 16667 ts_manager.cc:159] Registered new tserver with Master: 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483) I0401 16:41:54.261080 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.000s sys 0.003s I0401 16:41:54.261829 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:54.264955 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:54.265007 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-2-root uuid: "9d2910a181674a39a19707efa79d3135" format_stamp: "Formatted at 2019-04-01 23:41:54 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:54.265076 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:54.285615 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:54.285710 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:54.305299 16824 raft_consensus.cc:472] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.305420 16824 raft_consensus.cc:494] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.306283 16824 leader_election.cc:296] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66dce64e6ea840c383918fc8e5e4b1ae (127.11.224.62:56282), 97cf8f99ee6e4e759679a8292962551d (127.11.224.60:44441) I0401 16:41:54.306944 16791 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97cf8f99ee6e4e759679a8292962551d" is_pre_election: true I0401 16:41:54.307101 16791 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98c0b50f3b9b49c2a017f01d32dfd03e in term 0. I0401 16:41:54.307337 16677 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" is_pre_election: true I0401 16:41:54.307463 16677 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 98c0b50f3b9b49c2a017f01d32dfd03e in term 0. I0401 16:41:54.307684 16708 leader_election.cc:310] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 97cf8f99ee6e4e759679a8292962551d, 98c0b50f3b9b49c2a017f01d32dfd03e; no voters: I0401 16:41:54.307998 16824 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.308038 16824 raft_consensus.cc:472] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.308084 16824 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.310025 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:47365 I0401 16:41:54.310391 16824 raft_consensus.cc:494] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.311125 12160 webserver.cc:308] Webserver started at http://127.11.224.3:44567/ using document root and password file I0401 16:41:54.311256 16824 leader_election.cc:296] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [CANDIDATE]: Term 1 election: Requested vote from peers 66dce64e6ea840c383918fc8e5e4b1ae (127.11.224.62:56282), 97cf8f99ee6e4e759679a8292962551d (127.11.224.60:44441) I0401 16:41:54.311323 16677 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" I0401 16:41:54.311472 16677 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.311708 16791 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97cf8f99ee6e4e759679a8292962551d" I0401 16:41:54.311816 16791 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.313850 16677 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98c0b50f3b9b49c2a017f01d32dfd03e in term 1. I0401 16:41:54.314018 16791 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 98c0b50f3b9b49c2a017f01d32dfd03e in term 1. I0401 16:41:54.314196 16707 leader_election.cc:310] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66dce64e6ea840c383918fc8e5e4b1ae, 98c0b50f3b9b49c2a017f01d32dfd03e; no voters: I0401 16:41:54.314512 16824 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.316149 16824 raft_consensus.cc:667] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 1 LEADER]: Becoming Leader. State: Replica: 98c0b50f3b9b49c2a017f01d32dfd03e, State: Running, Role: LEADER I0401 16:41:54.316385 16824 consensus_queue.cc:206] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } I0401 16:41:54.317785 17033 sys_catalog.cc:337] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98c0b50f3b9b49c2a017f01d32dfd03e. Latest consensus state: current_term: 1 leader_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.318109 17033 sys_catalog.cc:340] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: This master's current role is: LEADER I0401 16:41:54.323501 17036 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:54.325525 17036 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:54.328909 17031 heartbeater.cc:345] Connected to a master server at 127.11.224.60:44441 I0401 16:41:54.328979 17031 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.329206 17031 heartbeater.cc:475] Master 127.11.224.60:44441 requested a full tablet report, sending... I0401 16:41:54.331845 17032 heartbeater.cc:345] Connected to a master server at 127.11.224.61:38064 I0401 16:41:54.331962 17032 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.332185 17032 heartbeater.cc:475] Master 127.11.224.61:38064 requested a full tablet report, sending... I0401 16:41:54.333091 16724 ts_manager.cc:159] Registered new tserver with Master: 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.334039 16781 ts_manager.cc:159] Registered new tserver with Master: 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.335063 17037 heartbeater.cc:345] Connected to a master server at 127.11.224.62:56282 I0401 16:41:54.335189 17037 heartbeater.cc:426] Registering TS with master... I0401 16:41:54.335404 17037 heartbeater.cc:475] Master 127.11.224.62:56282 requested a full tablet report, sending... I0401 16:41:54.336124 16667 ts_manager.cc:159] Registered new tserver with Master: 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.336256 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.009483524s I0401 16:41:54.376268 16791 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 1 FOLLOWER]: Refusing update from remote peer 98c0b50f3b9b49c2a017f01d32dfd03e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:54.376334 16677 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 1 FOLLOWER]: Refusing update from remote peer 98c0b50f3b9b49c2a017f01d32dfd03e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:54.376772 16824 consensus_queue.cc:984] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [LEADER]: Connected to new peer: Peer: permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:54.376961 17033 consensus_queue.cc:984] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [LEADER]: Connected to new peer: Peer: permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:54.380750 16821 sys_catalog.cc:337] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98c0b50f3b9b49c2a017f01d32dfd03e. Latest consensus state: current_term: 1 leader_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.380954 16821 sys_catalog.cc:340] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.381764 16818 sys_catalog.cc:337] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 98c0b50f3b9b49c2a017f01d32dfd03e. Latest consensus state: current_term: 1 leader_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.381932 16818 sys_catalog.cc:340] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.385022 16821 sys_catalog.cc:337] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.385210 16821 sys_catalog.cc:340] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.385228 17050 mvcc.cc:203] Tried to move safe_time back from 6365848020480094208 to 6365848020242599936. Current Snapshot: MvccSnapshot[committed={T|T < 6365848020480094208}] I0401 16:41:54.386122 16818 sys_catalog.cc:337] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.386303 16818 sys_catalog.cc:340] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:54.386524 16824 sys_catalog.cc:337] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.386739 16824 sys_catalog.cc:340] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: This master's current role is: LEADER I0401 16:41:54.387655 17036 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:54.389122 17033 sys_catalog.cc:337] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66dce64e6ea840c383918fc8e5e4b1ae" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 56282 } } peers { permanent_uuid: "98c0b50f3b9b49c2a017f01d32dfd03e" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 38064 } } peers { permanent_uuid: "97cf8f99ee6e4e759679a8292962551d" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 44441 } } } I0401 16:41:54.389294 17033 sys_catalog.cc:340] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [sys.catalog]: This master's current role is: LEADER I0401 16:41:54.389432 17036 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:54.407241 17036 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e: Generated new TSK 0 I0401 16:41:54.411373 16724 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:32957 I0401 16:41:54.413434 16723 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:32960 I0401 16:41:54.414767 16722 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:32954 I0401 16:41:54.414548 16723 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.61:32963: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:54.415597 16723 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:54.423442 16962 heartbeater.cc:467] Master 127.11.224.61:38064 was elected leader, sending a full tablet report... I0401 16:41:54.425480 17032 heartbeater.cc:467] Master 127.11.224.61:38064 was elected leader, sending a full tablet report... I0401 16:41:54.426486 16891 heartbeater.cc:467] Master 127.11.224.61:38064 was elected leader, sending a full tablet report... I0401 16:41:54.459345 16856 tablet_service.cc:1006] Processing CreateTablet for tablet 592098728dd945bca53221864e027054 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:54.460309 16856 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 592098728dd945bca53221864e027054. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.460404 16998 tablet_service.cc:1006] Processing CreateTablet for tablet 7d62fb567f8a4f4f9d652a07c693c489 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:54.460414 16997 tablet_service.cc:1006] Processing CreateTablet for tablet 592098728dd945bca53221864e027054 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:54.460702 16997 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 592098728dd945bca53221864e027054. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.460963 16857 tablet_service.cc:1006] Processing CreateTablet for tablet 7d62fb567f8a4f4f9d652a07c693c489 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:54.461238 16857 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 7d62fb567f8a4f4f9d652a07c693c489. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.461285 16998 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 7d62fb567f8a4f4f9d652a07c693c489. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.464843 16853 tablet_service.cc:1006] Processing CreateTablet for tablet 5390f72c0f8446958bb3480cb0367396 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:54.465240 16853 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 5390f72c0f8446958bb3480cb0367396. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.465389 16855 tablet_service.cc:1006] Processing CreateTablet for tablet e389391748cc4a98acac74f489e04ff2 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:54.465669 16855 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e389391748cc4a98acac74f489e04ff2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.468184 16851 tablet_service.cc:1006] Processing CreateTablet for tablet 8bdba9b25079474ca744bbdaef9445f2 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:54.468544 16851 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8bdba9b25079474ca744bbdaef9445f2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.469149 16854 tablet_service.cc:1006] Processing CreateTablet for tablet 052bfeda53ac4cbbb519288e39ea1f60 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:54.469441 16854 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 052bfeda53ac4cbbb519288e39ea1f60. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.472741 17063 tablet_bootstrap.cc:439] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.473212 16852 tablet_service.cc:1006] Processing CreateTablet for tablet 0843764bca114975957d7ff6cf6b8658 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:54.473549 16852 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0843764bca114975957d7ff6cf6b8658. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.474407 17063 tablet_bootstrap.cc:590] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.476770 16848 tablet_service.cc:1006] Processing CreateTablet for tablet b46cce3175b34529991658b9a642d360 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:54.477133 16849 tablet_service.cc:1006] Processing CreateTablet for tablet a7f19526ea9e46d7a9712631a17b667f (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:54.477433 16850 tablet_service.cc:1006] Processing CreateTablet for tablet 78a659df3b01418fbfc3049fa64e8998 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:54.479063 16997 tablet_service.cc:1006] Processing CreateTablet for tablet 052bfeda53ac4cbbb519288e39ea1f60 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:54.479388 16997 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 052bfeda53ac4cbbb519288e39ea1f60. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.481051 16996 tablet_service.cc:1006] Processing CreateTablet for tablet e389391748cc4a98acac74f489e04ff2 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:54.484382 16994 tablet_service.cc:1006] Processing CreateTablet for tablet 8bdba9b25079474ca744bbdaef9445f2 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:54.484658 16991 tablet_service.cc:1006] Processing CreateTablet for tablet b46cce3175b34529991658b9a642d360 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:54.484777 16920 tablet_service.cc:1006] Processing CreateTablet for tablet a7f19526ea9e46d7a9712631a17b667f (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:54.484782 16992 tablet_service.cc:1006] Processing CreateTablet for tablet a7f19526ea9e46d7a9712631a17b667f (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:54.484382 16996 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e389391748cc4a98acac74f489e04ff2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.484990 16927 tablet_service.cc:1006] Processing CreateTablet for tablet 592098728dd945bca53221864e027054 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:54.485163 16995 tablet_service.cc:1006] Processing CreateTablet for tablet 0843764bca114975957d7ff6cf6b8658 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:54.485297 16920 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a7f19526ea9e46d7a9712631a17b667f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.485298 16928 tablet_service.cc:1006] Processing CreateTablet for tablet 7d62fb567f8a4f4f9d652a07c693c489 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:54.485731 16994 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8bdba9b25079474ca744bbdaef9445f2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.485747 16850 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 78a659df3b01418fbfc3049fa64e8998. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.485738 16993 tablet_service.cc:1006] Processing CreateTablet for tablet 78a659df3b01418fbfc3049fa64e8998 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:54.486198 16928 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 7d62fb567f8a4f4f9d652a07c693c489. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.487694 16992 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a7f19526ea9e46d7a9712631a17b667f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.488457 16848 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b46cce3175b34529991658b9a642d360. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.488659 16849 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a7f19526ea9e46d7a9712631a17b667f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.488695 16923 tablet_service.cc:1006] Processing CreateTablet for tablet 0843764bca114975957d7ff6cf6b8658 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:54.489230 16923 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0843764bca114975957d7ff6cf6b8658. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.489231 16991 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b46cce3175b34529991658b9a642d360. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.489898 16927 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 592098728dd945bca53221864e027054. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.492314 16919 tablet_service.cc:1006] Processing CreateTablet for tablet b46cce3175b34529991658b9a642d360 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:54.492467 16998 tablet_service.cc:1006] Processing CreateTablet for tablet 5390f72c0f8446958bb3480cb0367396 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:54.492700 16919 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b46cce3175b34529991658b9a642d360. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.495180 16921 tablet_service.cc:1006] Processing CreateTablet for tablet 78a659df3b01418fbfc3049fa64e8998 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:54.495586 16921 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 78a659df3b01418fbfc3049fa64e8998. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.496136 16995 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0843764bca114975957d7ff6cf6b8658. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.499029 16922 tablet_service.cc:1006] Processing CreateTablet for tablet 8bdba9b25079474ca744bbdaef9445f2 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:54.499600 16922 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8bdba9b25079474ca744bbdaef9445f2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.514439 16924 tablet_service.cc:1006] Processing CreateTablet for tablet 5390f72c0f8446958bb3480cb0367396 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:54.514621 16926 tablet_service.cc:1006] Processing CreateTablet for tablet e389391748cc4a98acac74f489e04ff2 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:54.517369 16993 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 78a659df3b01418fbfc3049fa64e8998. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.514427 16925 tablet_service.cc:1006] Processing CreateTablet for tablet 052bfeda53ac4cbbb519288e39ea1f60 (table=ksck-test-table [id=cd877bb6a59f45caa4e858b47d04f368]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:54.522615 16924 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 5390f72c0f8446958bb3480cb0367396. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.523062 16926 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e389391748cc4a98acac74f489e04ff2. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.525866 17066 tablet_bootstrap.cc:439] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.527218 16925 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 052bfeda53ac4cbbb519288e39ea1f60. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.528308 16998 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 5390f72c0f8446958bb3480cb0367396. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:54.528931 17066 tablet_bootstrap.cc:590] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.534664 17063 tablet_bootstrap.cc:439] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.534885 17063 ts_tablet_manager.cc:1053] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.006s I0401 16:41:54.537020 17063 raft_consensus.cc:340] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.539893 17063 raft_consensus.cc:366] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.540009 17063 raft_consensus.cc:705] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.540269 17063 consensus_queue.cc:229] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.546079 17063 ts_tablet_manager.cc:1081] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.011s user 0.001s sys 0.003s I0401 16:41:54.546942 17066 tablet_bootstrap.cc:439] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.546959 17063 tablet_bootstrap.cc:439] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.548121 17066 ts_tablet_manager.cc:1053] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.008s I0401 16:41:54.548981 17066 raft_consensus.cc:340] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.549175 17066 raft_consensus.cc:366] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.549279 17066 raft_consensus.cc:705] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.549515 17066 consensus_queue.cc:229] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.547710 17064 tablet_bootstrap.cc:439] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.550549 17063 tablet_bootstrap.cc:590] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.551457 17066 ts_tablet_manager.cc:1081] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.003s user 0.001s sys 0.002s I0401 16:41:54.552955 17066 tablet_bootstrap.cc:439] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.553447 17064 tablet_bootstrap.cc:590] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.555963 17063 tablet_bootstrap.cc:439] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.556260 17063 ts_tablet_manager.cc:1053] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s I0401 16:41:54.556784 17066 tablet_bootstrap.cc:590] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.557600 17064 tablet_bootstrap.cc:439] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.557881 17064 ts_tablet_manager.cc:1053] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s I0401 16:41:54.558156 17063 raft_consensus.cc:340] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.558477 17063 raft_consensus.cc:366] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.558629 17063 raft_consensus.cc:705] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.558938 17063 consensus_queue.cc:229] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.559015 17064 raft_consensus.cc:340] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.559383 17064 raft_consensus.cc:366] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.559648 17064 raft_consensus.cc:705] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.559934 17064 consensus_queue.cc:229] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.560145 17066 tablet_bootstrap.cc:439] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.561079 17066 ts_tablet_manager.cc:1053] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s I0401 16:41:54.561401 17063 ts_tablet_manager.cc:1081] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s I0401 16:41:54.561709 17063 tablet_bootstrap.cc:439] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.561782 17066 raft_consensus.cc:340] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.562245 17066 raft_consensus.cc:366] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.562348 17066 raft_consensus.cc:705] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.562569 17066 consensus_queue.cc:229] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.563220 17066 ts_tablet_manager.cc:1081] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:54.563498 17066 tablet_bootstrap.cc:439] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.563796 17063 tablet_bootstrap.cc:590] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.565433 17066 tablet_bootstrap.cc:590] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.567534 17064 ts_tablet_manager.cc:1081] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.009s user 0.002s sys 0.002s I0401 16:41:54.567847 17064 tablet_bootstrap.cc:439] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.571424 17064 tablet_bootstrap.cc:590] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.571782 17066 tablet_bootstrap.cc:439] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.572326 17066 ts_tablet_manager.cc:1053] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.001s I0401 16:41:54.573169 17066 raft_consensus.cc:340] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.573402 17066 raft_consensus.cc:366] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.573402 17063 tablet_bootstrap.cc:439] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.573511 17066 raft_consensus.cc:705] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.573628 17063 ts_tablet_manager.cc:1053] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.004s I0401 16:41:54.573818 17066 consensus_queue.cc:229] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.574313 17063 raft_consensus.cc:340] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.574646 17063 raft_consensus.cc:366] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.574769 17063 raft_consensus.cc:705] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.574929 17064 tablet_bootstrap.cc:439] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.575119 17064 ts_tablet_manager.cc:1053] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s I0401 16:41:54.575026 17063 consensus_queue.cc:229] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.575676 17063 ts_tablet_manager.cc:1081] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:54.576006 17063 tablet_bootstrap.cc:439] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.575940 17064 raft_consensus.cc:340] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.576244 17064 raft_consensus.cc:366] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.576362 17064 raft_consensus.cc:705] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.576619 17064 consensus_queue.cc:229] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.580814 17064 ts_tablet_manager.cc:1081] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s I0401 16:41:54.581284 17064 tablet_bootstrap.cc:439] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.581653 17066 ts_tablet_manager.cc:1081] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.009s user 0.002s sys 0.000s I0401 16:41:54.582026 17066 tablet_bootstrap.cc:439] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.583040 17064 tablet_bootstrap.cc:590] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.583214 17063 tablet_bootstrap.cc:590] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.583662 17066 tablet_bootstrap.cc:590] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.585268 17064 tablet_bootstrap.cc:439] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.585422 17064 ts_tablet_manager.cc:1053] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.002s I0401 16:41:54.585994 17064 raft_consensus.cc:340] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.586133 17064 raft_consensus.cc:366] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.586189 17064 raft_consensus.cc:705] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.586378 17064 consensus_queue.cc:229] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.586933 17064 ts_tablet_manager.cc:1081] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:54.587239 17064 tablet_bootstrap.cc:439] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.588807 17063 tablet_bootstrap.cc:439] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.589021 17063 ts_tablet_manager.cc:1053] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.003s I0401 16:41:54.589085 17066 tablet_bootstrap.cc:439] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.589089 17064 tablet_bootstrap.cc:590] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.589277 17066 ts_tablet_manager.cc:1053] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s I0401 16:41:54.589902 17063 raft_consensus.cc:340] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.590098 17063 raft_consensus.cc:366] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.590193 17063 raft_consensus.cc:705] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.590363 17063 consensus_queue.cc:229] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.591645 17066 raft_consensus.cc:340] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.592605 17066 raft_consensus.cc:366] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.592737 17066 raft_consensus.cc:705] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.592810 17064 tablet_bootstrap.cc:439] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.593041 17064 ts_tablet_manager.cc:1053] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s I0401 16:41:54.593044 17066 consensus_queue.cc:229] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.593884 17064 raft_consensus.cc:340] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.594163 17064 raft_consensus.cc:366] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.594348 17066 ts_tablet_manager.cc:1081] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.005s user 0.001s sys 0.001s I0401 16:41:54.594525 17063 ts_tablet_manager.cc:1081] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0401 16:41:54.594928 17064 raft_consensus.cc:705] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.595327 17063 tablet_bootstrap.cc:439] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.595335 17064 consensus_queue.cc:229] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.595808 17066 tablet_bootstrap.cc:439] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.597239 17064 ts_tablet_manager.cc:1081] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:54.597569 17064 tablet_bootstrap.cc:439] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.598268 17066 tablet_bootstrap.cc:590] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.599061 17063 tablet_bootstrap.cc:590] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.599413 17064 tablet_bootstrap.cc:590] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.602136 17064 tablet_bootstrap.cc:439] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.602290 17064 ts_tablet_manager.cc:1053] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.002s I0401 16:41:54.602843 17064 raft_consensus.cc:340] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.603029 17064 raft_consensus.cc:366] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.603106 17064 raft_consensus.cc:705] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.603323 17064 consensus_queue.cc:229] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.603953 17064 ts_tablet_manager.cc:1081] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.001s user 0.001s sys 0.001s I0401 16:41:54.604297 17064 tablet_bootstrap.cc:439] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.605276 17068 raft_consensus.cc:472] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.606999 17068 raft_consensus.cc:494] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.609423 17063 tablet_bootstrap.cc:439] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.610373 17066 tablet_bootstrap.cc:439] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.610726 17068 leader_election.cc:296] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483) I0401 16:41:54.611272 17064 tablet_bootstrap.cc:590] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.612196 17066 ts_tablet_manager.cc:1053] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.005s I0401 16:41:54.612996 17063 ts_tablet_manager.cc:1053] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.003s I0401 16:41:54.613157 17066 raft_consensus.cc:340] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.613332 17068 raft_consensus.cc:472] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.613910 17066 raft_consensus.cc:366] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.614030 17066 raft_consensus.cc:705] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.614276 17066 consensus_queue.cc:229] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.614863 17066 ts_tablet_manager.cc:1081] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s I0401 16:41:54.615193 17066 tablet_bootstrap.cc:439] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.616784 17066 tablet_bootstrap.cc:590] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.617913 17068 raft_consensus.cc:494] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.618674 17068 leader_election.cc:296] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), f172996cdc0646dc954f931f55011322 (127.11.224.1:41020) I0401 16:41:54.620138 16867 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "592098728dd945bca53221864e027054" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" is_pre_election: true I0401 16:41:54.620749 16866 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b46cce3175b34529991658b9a642d360" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" is_pre_election: true W0401 16:41:54.621258 16970 leader_election.cc:348] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f172996cdc0646dc954f931f55011322 (127.11.224.1:41020): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:54.621320 17066 tablet_bootstrap.cc:439] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log W0401 16:41:54.621510 16970 leader_election.cc:348] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f172996cdc0646dc954f931f55011322 (127.11.224.1:41020): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:54.622180 17063 raft_consensus.cc:340] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.622360 17066 ts_tablet_manager.cc:1053] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.003s I0401 16:41:54.622637 17063 raft_consensus.cc:366] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.622737 17063 raft_consensus.cc:705] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.622961 17063 consensus_queue.cc:229] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.623379 17066 raft_consensus.cc:340] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.623561 17063 ts_tablet_manager.cc:1081] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s I0401 16:41:54.624150 17063 tablet_bootstrap.cc:439] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.624438 17064 tablet_bootstrap.cc:439] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.624637 17064 ts_tablet_manager.cc:1053] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.020s user 0.000s sys 0.006s I0401 16:41:54.625340 17064 raft_consensus.cc:340] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.625937 17063 tablet_bootstrap.cc:590] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.625938 17064 raft_consensus.cc:366] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.623678 17066 raft_consensus.cc:366] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.626149 17066 raft_consensus.cc:705] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.626410 17066 consensus_queue.cc:229] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.627035 17066 ts_tablet_manager.cc:1081] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:41:54.627159 17064 raft_consensus.cc:705] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.627481 17066 tablet_bootstrap.cc:439] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.629050 17066 tablet_bootstrap.cc:590] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.629686 17064 consensus_queue.cc:229] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.631570 17064 ts_tablet_manager.cc:1081] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s I0401 16:41:54.632953 17063 tablet_bootstrap.cc:439] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.632956 17064 tablet_bootstrap.cc:439] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.633172 17063 ts_tablet_manager.cc:1053] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.001s I0401 16:41:54.634423 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b46cce3175b34529991658b9a642d360" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.634413 16938 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "592098728dd945bca53221864e027054" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.634762 16937 raft_consensus.cc:2346] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 0. I0401 16:41:54.635038 17064 tablet_bootstrap.cc:590] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.634047 17063 raft_consensus.cc:340] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.635241 17063 raft_consensus.cc:366] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.635398 17063 raft_consensus.cc:705] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER W0401 16:41:54.635411 16969 leader_election.cc:348] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:54.635591 16969 leader_election.cc:310] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9d2910a181674a39a19707efa79d3135; no voters: 82eece752383481aab0e4d4f70d7960c, f172996cdc0646dc954f931f55011322 I0401 16:41:54.636183 17084 raft_consensus.cc:2588] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:54.636425 16969 leader_election.cc:310] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, 9d2910a181674a39a19707efa79d3135; no voters: f172996cdc0646dc954f931f55011322 I0401 16:41:54.636539 17066 tablet_bootstrap.cc:439] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.636848 17066 ts_tablet_manager.cc:1053] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s I0401 16:41:54.636238 17063 consensus_queue.cc:229] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.637734 17084 raft_consensus.cc:2640] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.637890 17084 raft_consensus.cc:472] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.637804 17066 raft_consensus.cc:340] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.638043 17084 raft_consensus.cc:2886] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.638180 17066 raft_consensus.cc:366] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.638309 17066 raft_consensus.cc:705] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.638535 17066 consensus_queue.cc:229] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.639155 17066 ts_tablet_manager.cc:1081] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:54.639475 17066 tablet_bootstrap.cc:439] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.640272 17084 raft_consensus.cc:494] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.641119 17066 tablet_bootstrap.cc:590] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.641490 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b46cce3175b34529991658b9a642d360" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" I0401 16:41:54.642102 16937 raft_consensus.cc:2886] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.644191 16937 raft_consensus.cc:2346] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 1. I0401 16:41:54.644534 16866 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b46cce3175b34529991658b9a642d360" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" I0401 16:41:54.644737 17084 leader_election.cc:296] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Requested vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), f172996cdc0646dc954f931f55011322 (127.11.224.1:41020) I0401 16:41:54.641928 17063 ts_tablet_manager.cc:1081] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.009s user 0.001s sys 0.002s I0401 16:41:54.645341 16969 leader_election.cc:310] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, 9d2910a181674a39a19707efa79d3135; no voters: I0401 16:41:54.645341 17063 tablet_bootstrap.cc:439] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. W0401 16:41:54.645695 16970 leader_election.cc:348] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f172996cdc0646dc954f931f55011322 (127.11.224.1:41020): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:54.645761 17084 raft_consensus.cc:2640] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.646208 17084 raft_consensus.cc:667] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Becoming Leader. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Running, Role: LEADER I0401 16:41:54.646536 17084 consensus_queue.cc:206] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.647419 17063 tablet_bootstrap.cc:590] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.650806 17064 tablet_bootstrap.cc:439] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.652950 17063 tablet_bootstrap.cc:439] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.653160 17063 ts_tablet_manager.cc:1053] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s I0401 16:41:54.653762 16722 catalog_manager.cc:3977] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 reported cstate change: term changed from 0 to 1, leader changed from to 9d2910a181674a39a19707efa79d3135 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "9d2910a181674a39a19707efa79d3135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: HEALTHY } } } I0401 16:41:54.654129 17063 raft_consensus.cc:340] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.654376 17063 raft_consensus.cc:366] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.654498 17063 raft_consensus.cc:705] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.654733 17063 consensus_queue.cc:229] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.658002 17064 ts_tablet_manager.cc:1053] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.001s I0401 16:41:54.659826 17063 ts_tablet_manager.cc:1081] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s I0401 16:41:54.660162 17063 tablet_bootstrap.cc:439] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.661643 17063 tablet_bootstrap.cc:590] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.663038 17064 raft_consensus.cc:340] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.663610 17064 raft_consensus.cc:366] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.663718 17064 raft_consensus.cc:705] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.664114 17064 consensus_queue.cc:229] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.664294 17066 tablet_bootstrap.cc:439] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.664518 17066 ts_tablet_manager.cc:1053] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.007s I0401 16:41:54.664520 17063 tablet_bootstrap.cc:439] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.664727 17063 ts_tablet_manager.cc:1053] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s I0401 16:41:54.665416 17064 ts_tablet_manager.cc:1081] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s I0401 16:41:54.665314 17066 raft_consensus.cc:340] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.665561 17066 raft_consensus.cc:366] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.665747 17066 raft_consensus.cc:705] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.666000 17066 consensus_queue.cc:229] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.666575 17066 ts_tablet_manager.cc:1081] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:54.666569 17063 raft_consensus.cc:340] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.666846 17063 raft_consensus.cc:366] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.667021 17063 raft_consensus.cc:705] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.667181 17064 tablet_bootstrap.cc:439] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.667881 17063 consensus_queue.cc:229] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.669313 17064 tablet_bootstrap.cc:590] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.671933 17063 ts_tablet_manager.cc:1081] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.007s user 0.001s sys 0.001s I0401 16:41:54.672400 17066 tablet_bootstrap.cc:439] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.672442 17063 tablet_bootstrap.cc:439] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.674054 17066 tablet_bootstrap.cc:590] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.674136 17063 tablet_bootstrap.cc:590] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.677249 17064 tablet_bootstrap.cc:439] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.677420 17064 ts_tablet_manager.cc:1053] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.012s user 0.004s sys 0.005s I0401 16:41:54.678083 17064 raft_consensus.cc:340] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.678613 17064 raft_consensus.cc:366] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.678774 17064 raft_consensus.cc:705] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.679299 17064 consensus_queue.cc:229] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.680600 17064 ts_tablet_manager.cc:1081] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s I0401 16:41:54.681500 17069 raft_consensus.cc:472] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.681665 17069 raft_consensus.cc:494] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.682600 17069 leader_election.cc:296] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.688912 17064 tablet_bootstrap.cc:439] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.689144 16866 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a7f19526ea9e46d7a9712631a17b667f" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" is_pre_election: true I0401 16:41:54.689309 16866 raft_consensus.cc:2346] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82eece752383481aab0e4d4f70d7960c in term 0. I0401 16:41:54.689646 16900 leader_election.cc:310] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.690002 17069 raft_consensus.cc:2640] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.690048 17069 raft_consensus.cc:472] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.690104 17069 raft_consensus.cc:2886] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.690503 17008 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a7f19526ea9e46d7a9712631a17b667f" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" is_pre_election: true I0401 16:41:54.690626 17008 raft_consensus.cc:2346] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82eece752383481aab0e4d4f70d7960c in term 0. I0401 16:41:54.690757 17066 tablet_bootstrap.cc:439] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.690999 17066 ts_tablet_manager.cc:1053] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.006s I0401 16:41:54.691998 17073 raft_consensus.cc:472] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.692090 17073 raft_consensus.cc:494] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.692323 17066 raft_consensus.cc:340] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.692474 17066 raft_consensus.cc:366] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.692500 17066 raft_consensus.cc:705] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.692659 17066 consensus_queue.cc:229] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.692754 17073 leader_election.cc:296] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.693768 17063 tablet_bootstrap.cc:439] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.693918 17063 ts_tablet_manager.cc:1053] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.006s I0401 16:41:54.694823 17063 raft_consensus.cc:340] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.696070 17063 raft_consensus.cc:366] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.696143 17063 raft_consensus.cc:705] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.696395 17063 consensus_queue.cc:229] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.698432 17073 raft_consensus.cc:472] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.698529 17073 raft_consensus.cc:494] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.699210 17063 ts_tablet_manager.cc:1081] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I0401 16:41:54.699244 17073 leader_election.cc:296] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.699530 17063 tablet_bootstrap.cc:439] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135: Bootstrap starting. I0401 16:41:54.700700 17073 raft_consensus.cc:472] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.700773 17073 raft_consensus.cc:494] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.701345 17073 leader_election.cc:296] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.702716 16938 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "592098728dd945bca53221864e027054" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.702909 16938 raft_consensus.cc:2346] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 0. I0401 16:41:54.702842 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "052bfeda53ac4cbbb519288e39ea1f60" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.703266 16936 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0843764bca114975957d7ff6cf6b8658" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.703346 16828 leader_election.cc:310] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.703408 16936 raft_consensus.cc:2346] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 0. W0401 16:41:54.703616 16828 leader_election.cc:348] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:54.703752 16828 leader_election.cc:310] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.704105 17073 raft_consensus.cc:2640] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.704151 17073 raft_consensus.cc:472] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.704197 17073 raft_consensus.cc:2886] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.704246 17063 tablet_bootstrap.cc:590] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135: No blocks or log segments found. Creating new log. I0401 16:41:54.704927 17069 raft_consensus.cc:494] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.706017 16866 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a7f19526ea9e46d7a9712631a17b667f" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" I0401 16:41:54.706126 16866 raft_consensus.cc:2886] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.706589 17008 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "052bfeda53ac4cbbb519288e39ea1f60" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" is_pre_election: true I0401 16:41:54.706722 17008 raft_consensus.cc:2346] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 0. I0401 16:41:54.706686 17006 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0843764bca114975957d7ff6cf6b8658" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" is_pre_election: true I0401 16:41:54.706878 17006 raft_consensus.cc:2346] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 0. I0401 16:41:54.706982 17007 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "592098728dd945bca53221864e027054" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" is_pre_election: true I0401 16:41:54.707015 17073 raft_consensus.cc:494] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.707185 17007 raft_consensus.cc:2346] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 0. I0401 16:41:54.707553 17073 leader_election.cc:296] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Requested vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.707654 17073 raft_consensus.cc:2640] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.707701 17073 raft_consensus.cc:472] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.707739 17073 raft_consensus.cc:2886] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.708256 16830 leader_election.cc:310] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: 82eece752383481aab0e4d4f70d7960c I0401 16:41:54.708331 17063 tablet_bootstrap.cc:439] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135: No bootstrap required, opened a new log I0401 16:41:54.708444 17063 ts_tablet_manager.cc:1053] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135: Time spent bootstrapping tablet: real 0.009s user 0.001s sys 0.002s I0401 16:41:54.708814 17007 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "592098728dd945bca53221864e027054" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" I0401 16:41:54.708950 17007 raft_consensus.cc:2886] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.709172 17069 leader_election.cc:296] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 election: Requested vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.709218 17006 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a7f19526ea9e46d7a9712631a17b667f" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" I0401 16:41:54.709329 17006 raft_consensus.cc:2886] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.710566 17063 raft_consensus.cc:340] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.710933 17063 raft_consensus.cc:366] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.711144 17069 raft_consensus.cc:472] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.711336 17069 raft_consensus.cc:494] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.711035 17063 raft_consensus.cc:705] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Initialized, Role: FOLLOWER I0401 16:41:54.714998 16866 raft_consensus.cc:2346] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82eece752383481aab0e4d4f70d7960c in term 1. I0401 16:41:54.717669 16900 leader_election.cc:310] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.717363 17063 consensus_queue.cc:229] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.718389 17008 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8bdba9b25079474ca744bbdaef9445f2" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" is_pre_election: true I0401 16:41:54.718544 17008 raft_consensus.cc:2346] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82eece752383481aab0e4d4f70d7960c in term 0. I0401 16:41:54.718943 16901 leader_election.cc:310] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, 9d2910a181674a39a19707efa79d3135; no voters: I0401 16:41:54.720024 17063 ts_tablet_manager.cc:1081] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135: Time spent starting tablet: real 0.012s user 0.001s sys 0.001s I0401 16:41:54.720161 17069 leader_election.cc:296] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.720998 17069 raft_consensus.cc:2640] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.721099 17069 raft_consensus.cc:667] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 1 LEADER]: Becoming Leader. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Running, Role: LEADER I0401 16:41:54.721199 17066 ts_tablet_manager.cc:1081] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.030s user 0.002s sys 0.005s I0401 16:41:54.721312 17069 consensus_queue.cc:206] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.721523 17066 tablet_bootstrap.cc:439] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c: Bootstrap starting. I0401 16:41:54.721541 17073 raft_consensus.cc:494] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.722645 17073 leader_election.cc:296] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Requested vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.722753 17073 raft_consensus.cc:2640] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.722795 17073 raft_consensus.cc:472] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.722843 17073 raft_consensus.cc:2886] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.723104 17008 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0843764bca114975957d7ff6cf6b8658" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" I0401 16:41:54.723127 16867 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8bdba9b25079474ca744bbdaef9445f2" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" is_pre_election: true I0401 16:41:54.723233 17008 raft_consensus.cc:2886] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.723253 16867 raft_consensus.cc:2346] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 82eece752383481aab0e4d4f70d7960c in term 0. I0401 16:41:54.724328 17006 raft_consensus.cc:2346] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82eece752383481aab0e4d4f70d7960c in term 1. I0401 16:41:54.725208 17008 raft_consensus.cc:2346] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 1. I0401 16:41:54.725939 16830 leader_election.cc:310] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.728240 17007 raft_consensus.cc:2346] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 1. I0401 16:41:54.728734 16830 leader_election.cc:310] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.729228 17097 raft_consensus.cc:2640] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.729327 17064 tablet_bootstrap.cc:590] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.729902 17097 raft_consensus.cc:472] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.729976 17097 raft_consensus.cc:2886] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.734686 17066 tablet_bootstrap.cc:590] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c: No blocks or log segments found. Creating new log. I0401 16:41:54.736799 17073 raft_consensus.cc:494] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.738718 17073 leader_election.cc:296] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Requested vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.738894 17073 raft_consensus.cc:2640] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.739012 17073 raft_consensus.cc:667] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: Becoming Leader. State: Replica: f172996cdc0646dc954f931f55011322, State: Running, Role: LEADER I0401 16:41:54.739773 17099 raft_consensus.cc:2640] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.739246 17073 consensus_queue.cc:206] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.740859 16723 catalog_manager.cc:3977] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c reported cstate change: term changed from 0 to 1, leader changed from to 82eece752383481aab0e4d4f70d7960c (127.11.224.2). New cstate: current_term: 1 leader_uuid: "82eece752383481aab0e4d4f70d7960c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: UNKNOWN } } } I0401 16:41:54.743333 17064 tablet_bootstrap.cc:439] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.743296 16936 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "592098728dd945bca53221864e027054" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" I0401 16:41:54.743314 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0843764bca114975957d7ff6cf6b8658" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" I0401 16:41:54.743419 16936 raft_consensus.cc:2886] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.743435 16937 raft_consensus.cc:2886] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.743445 17064 ts_tablet_manager.cc:1053] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.062s user 0.002s sys 0.001s I0401 16:41:54.744195 17064 raft_consensus.cc:340] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.744359 17064 raft_consensus.cc:366] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.744387 17064 raft_consensus.cc:705] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.744549 17064 consensus_queue.cc:229] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.745187 17064 ts_tablet_manager.cc:1081] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:54.745390 17064 tablet_bootstrap.cc:439] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322: Bootstrap starting. I0401 16:41:54.745503 16937 raft_consensus.cc:2346] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 1. I0401 16:41:54.745550 16936 raft_consensus.cc:2346] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 1. I0401 16:41:54.745590 17084 raft_consensus.cc:472] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.745671 17084 raft_consensus.cc:494] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.746294 17084 leader_election.cc:296] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), f172996cdc0646dc954f931f55011322 (127.11.224.1:41020) I0401 16:41:54.746630 16936 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "052bfeda53ac4cbbb519288e39ea1f60" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" I0401 16:41:54.746842 16867 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "5390f72c0f8446958bb3480cb0367396" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" is_pre_election: true I0401 16:41:54.747005 16867 raft_consensus.cc:2346] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 0. I0401 16:41:54.747123 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "5390f72c0f8446958bb3480cb0367396" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.747251 16937 raft_consensus.cc:2346] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 0. I0401 16:41:54.747359 16970 leader_election.cc:310] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.747557 17064 tablet_bootstrap.cc:590] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322: No blocks or log segments found. Creating new log. I0401 16:41:54.747769 17084 raft_consensus.cc:2640] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.747819 17084 raft_consensus.cc:472] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.747905 17084 raft_consensus.cc:2886] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 W0401 16:41:54.750154 16828 leader_election.cc:348] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:54.749951 17084 raft_consensus.cc:494] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.750751 17099 raft_consensus.cc:667] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: Becoming Leader. State: Replica: f172996cdc0646dc954f931f55011322, State: Running, Role: LEADER I0401 16:41:54.750960 17099 consensus_queue.cc:206] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.751302 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "5390f72c0f8446958bb3480cb0367396" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" I0401 16:41:54.751929 16937 raft_consensus.cc:2886] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.753190 17007 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "052bfeda53ac4cbbb519288e39ea1f60" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" I0401 16:41:54.753300 17007 raft_consensus.cc:2886] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.753918 16937 raft_consensus.cc:2346] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 1. I0401 16:41:54.754164 16969 leader_election.cc:310] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, 9d2910a181674a39a19707efa79d3135; no voters: I0401 16:41:54.754423 17068 raft_consensus.cc:2640] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.754565 17084 leader_election.cc:296] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Requested vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), f172996cdc0646dc954f931f55011322 (127.11.224.1:41020) I0401 16:41:54.754994 16867 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "5390f72c0f8446958bb3480cb0367396" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" I0401 16:41:54.755113 16867 raft_consensus.cc:2886] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.762128 17084 raft_consensus.cc:472] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.762214 17084 raft_consensus.cc:494] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.764008 17084 leader_election.cc:296] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483) I0401 16:41:54.764214 17007 raft_consensus.cc:2346] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 1. I0401 16:41:54.764679 16866 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "7d62fb567f8a4f4f9d652a07c693c489" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" is_pre_election: true I0401 16:41:54.764832 16866 raft_consensus.cc:2346] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 0. I0401 16:41:54.764899 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "7d62fb567f8a4f4f9d652a07c693c489" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.765048 16937 raft_consensus.cc:2346] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 0. I0401 16:41:54.765125 16970 leader_election.cc:310] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.765406 17084 raft_consensus.cc:2640] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.765453 17084 raft_consensus.cc:472] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.765506 17084 raft_consensus.cc:2886] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.765609 16830 leader_election.cc:310] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: 82eece752383481aab0e4d4f70d7960c I0401 16:41:54.766391 17105 raft_consensus.cc:2640] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.766502 17105 raft_consensus.cc:667] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: Becoming Leader. State: Replica: f172996cdc0646dc954f931f55011322, State: Running, Role: LEADER I0401 16:41:54.754951 17097 raft_consensus.cc:494] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.767443 17097 leader_election.cc:296] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 election: Requested vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.767802 17007 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8bdba9b25079474ca744bbdaef9445f2" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" I0401 16:41:54.767942 17007 raft_consensus.cc:2886] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.768832 16867 raft_consensus.cc:2346] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 1. I0401 16:41:54.770206 16867 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8bdba9b25079474ca744bbdaef9445f2" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" I0401 16:41:54.770318 16867 raft_consensus.cc:2886] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.770920 17084 raft_consensus.cc:494] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.771490 17084 leader_election.cc:296] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Requested vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483) I0401 16:41:54.771908 16866 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "7d62fb567f8a4f4f9d652a07c693c489" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" I0401 16:41:54.772023 16866 raft_consensus.cc:2886] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.772014 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "7d62fb567f8a4f4f9d652a07c693c489" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" I0401 16:41:54.772123 16937 raft_consensus.cc:2886] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.766989 17105 consensus_queue.cc:206] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.773957 16866 raft_consensus.cc:2346] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 1. I0401 16:41:54.774154 16937 raft_consensus.cc:2346] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 1. I0401 16:41:54.774253 16970 leader_election.cc:310] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.774502 17084 raft_consensus.cc:2640] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.774572 17084 raft_consensus.cc:667] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Becoming Leader. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Running, Role: LEADER I0401 16:41:54.776821 17064 tablet_bootstrap.cc:439] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322: No bootstrap required, opened a new log I0401 16:41:54.776971 17064 ts_tablet_manager.cc:1053] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322: Time spent bootstrapping tablet: real 0.032s user 0.001s sys 0.011s I0401 16:41:54.774744 17084 consensus_queue.cc:206] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.777762 17064 raft_consensus.cc:340] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.777950 17064 raft_consensus.cc:366] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.777983 17064 raft_consensus.cc:705] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f172996cdc0646dc954f931f55011322, State: Initialized, Role: FOLLOWER I0401 16:41:54.778115 17064 consensus_queue.cc:229] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.779580 17064 ts_tablet_manager.cc:1081] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:54.780766 17066 tablet_bootstrap.cc:439] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c: No bootstrap required, opened a new log I0401 16:41:54.780891 17066 ts_tablet_manager.cc:1053] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c: Time spent bootstrapping tablet: real 0.059s user 0.004s sys 0.008s I0401 16:41:54.781303 17007 raft_consensus.cc:2346] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82eece752383481aab0e4d4f70d7960c in term 1. I0401 16:41:54.781718 16901 leader_election.cc:310] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, 9d2910a181674a39a19707efa79d3135; no voters: I0401 16:41:54.782065 17097 raft_consensus.cc:2640] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.782143 17097 raft_consensus.cc:667] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 1 LEADER]: Becoming Leader. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Running, Role: LEADER I0401 16:41:54.781461 17066 raft_consensus.cc:340] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.782485 17066 raft_consensus.cc:366] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:54.782513 17066 raft_consensus.cc:705] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82eece752383481aab0e4d4f70d7960c, State: Initialized, Role: FOLLOWER I0401 16:41:54.782629 17066 consensus_queue.cc:229] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.783084 17066 ts_tablet_manager.cc:1081] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:54.783118 17097 consensus_queue.cc:206] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.784345 17099 raft_consensus.cc:472] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.784595 17099 raft_consensus.cc:494] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.785253 16723 catalog_manager.cc:3977] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 reported cstate change: term changed from 0 to 1, leader changed from to f172996cdc0646dc954f931f55011322 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "f172996cdc0646dc954f931f55011322" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: UNKNOWN } } } I0401 16:41:54.786339 17007 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e389391748cc4a98acac74f489e04ff2" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" is_pre_election: true I0401 16:41:54.786486 17007 raft_consensus.cc:2346] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 0. I0401 16:41:54.786324 16723 catalog_manager.cc:3977] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 reported cstate change: term changed from 0 to 1, leader changed from to f172996cdc0646dc954f931f55011322 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "f172996cdc0646dc954f931f55011322" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: UNKNOWN } } } I0401 16:41:54.785802 16867 raft_consensus.cc:2346] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 82eece752383481aab0e4d4f70d7960c in term 1. I0401 16:41:54.786036 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e389391748cc4a98acac74f489e04ff2" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.787518 16830 leader_election.cc:310] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.787585 16937 raft_consensus.cc:2346] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 0. I0401 16:41:54.785717 17099 leader_election.cc:296] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.787978 17068 raft_consensus.cc:667] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Becoming Leader. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Running, Role: LEADER I0401 16:41:54.787837 17105 raft_consensus.cc:2640] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.788110 17105 raft_consensus.cc:472] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.788172 17105 raft_consensus.cc:2886] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.788264 17068 consensus_queue.cc:206] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.794370 17105 raft_consensus.cc:494] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.795011 17105 leader_election.cc:296] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Requested vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.794719 16723 catalog_manager.cc:3977] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 reported cstate change: term changed from 0 to 1, leader changed from to f172996cdc0646dc954f931f55011322 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "f172996cdc0646dc954f931f55011322" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: UNKNOWN } } } I0401 16:41:54.795408 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e389391748cc4a98acac74f489e04ff2" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" I0401 16:41:54.795531 16937 raft_consensus.cc:2886] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.795542 17007 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e389391748cc4a98acac74f489e04ff2" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" I0401 16:41:54.795655 17007 raft_consensus.cc:2886] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.797740 16937 raft_consensus.cc:2346] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 1. I0401 16:41:54.798162 16828 leader_election.cc:310] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.797745 17007 raft_consensus.cc:2346] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f172996cdc0646dc954f931f55011322 in term 1. I0401 16:41:54.798482 17105 raft_consensus.cc:2640] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.798694 17105 raft_consensus.cc:667] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: Becoming Leader. State: Replica: f172996cdc0646dc954f931f55011322, State: Running, Role: LEADER I0401 16:41:54.799161 17105 consensus_queue.cc:206] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.799484 16722 catalog_manager.cc:3977] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 reported cstate change: term changed from 0 to 1, leader changed from to 9d2910a181674a39a19707efa79d3135 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "9d2910a181674a39a19707efa79d3135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: HEALTHY } } } I0401 16:41:54.804710 16723 catalog_manager.cc:3977] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c reported cstate change: term changed from 0 to 1, leader changed from to 82eece752383481aab0e4d4f70d7960c (127.11.224.2). New cstate: current_term: 1 leader_uuid: "82eece752383481aab0e4d4f70d7960c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: UNKNOWN } } } I0401 16:41:54.807772 16722 catalog_manager.cc:3977] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 reported cstate change: term changed from 0 to 1, leader changed from to 9d2910a181674a39a19707efa79d3135 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "9d2910a181674a39a19707efa79d3135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: HEALTHY } } } I0401 16:41:54.811167 17109 raft_consensus.cc:472] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.811275 17109 raft_consensus.cc:494] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.813571 16723 catalog_manager.cc:3977] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 reported cstate change: term changed from 0 to 1, leader changed from to f172996cdc0646dc954f931f55011322 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "f172996cdc0646dc954f931f55011322" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: UNKNOWN } } } I0401 16:41:54.814569 17109 leader_election.cc:296] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483) I0401 16:41:54.815593 16867 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "78a659df3b01418fbfc3049fa64e8998" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" is_pre_election: true I0401 16:41:54.815696 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "78a659df3b01418fbfc3049fa64e8998" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.815744 16867 raft_consensus.cc:2346] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 0. I0401 16:41:54.815817 16937 raft_consensus.cc:2346] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 0. I0401 16:41:54.816016 16970 leader_election.cc:310] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.816537 17109 raft_consensus.cc:2640] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:54.816614 17109 raft_consensus.cc:472] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:54.816707 17109 raft_consensus.cc:2886] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.820680 17109 raft_consensus.cc:494] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.821451 17109 leader_election.cc:296] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Requested vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483) I0401 16:41:54.821825 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "78a659df3b01418fbfc3049fa64e8998" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" I0401 16:41:54.821815 16867 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "78a659df3b01418fbfc3049fa64e8998" candidate_uuid: "9d2910a181674a39a19707efa79d3135" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f172996cdc0646dc954f931f55011322" I0401 16:41:54.821983 16937 raft_consensus.cc:2886] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.822003 16867 raft_consensus.cc:2886] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.824434 16937 raft_consensus.cc:2346] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 1. I0401 16:41:54.824434 16867 raft_consensus.cc:2346] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9d2910a181674a39a19707efa79d3135 in term 1. I0401 16:41:54.825100 16970 leader_election.cc:310] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c, 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322; no voters: I0401 16:41:54.825492 17109 raft_consensus.cc:2640] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:54.825701 17109 raft_consensus.cc:667] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Becoming Leader. State: Replica: 9d2910a181674a39a19707efa79d3135, State: Running, Role: LEADER I0401 16:41:54.825964 17109 consensus_queue.cc:206] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.828506 16723 catalog_manager.cc:3977] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 reported cstate change: term changed from 0 to 1, leader changed from to 9d2910a181674a39a19707efa79d3135 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "9d2910a181674a39a19707efa79d3135" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } health_report { overall_health: HEALTHY } } } W0401 16:41:54.924324 12160 ksck_remote-test.cc:437] test is skipped in TSAN and ASAN builds I0401 16:41:54.924437 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:54.925748 17105 raft_consensus.cc:472] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.925845 17105 raft_consensus.cc:494] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:54.927444 17105 leader_election.cc:296] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 82eece752383481aab0e4d4f70d7960c (127.11.224.2:35483), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) I0401 16:41:54.926769 16937 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b46cce3175b34529991658b9a642d360" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82eece752383481aab0e4d4f70d7960c" is_pre_election: true I0401 16:41:54.928069 16937 raft_consensus.cc:2276] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f172996cdc0646dc954f931f55011322 in current term 1: Already voted for candidate 9d2910a181674a39a19707efa79d3135 in this term. I0401 16:41:54.927978 17007 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b46cce3175b34529991658b9a642d360" candidate_uuid: "f172996cdc0646dc954f931f55011322" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" is_pre_election: true I0401 16:41:54.928189 17007 raft_consensus.cc:2307] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate f172996cdc0646dc954f931f55011322 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:54.928515 16830 leader_election.cc:310] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f172996cdc0646dc954f931f55011322; no voters: 82eece752383481aab0e4d4f70d7960c, 9d2910a181674a39a19707efa79d3135 I0401 16:41:54.928702 17105 raft_consensus.cc:2886] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:54.932934 17105 raft_consensus.cc:2588] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:54.942324 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:54.942469 12160 tablet_replica.cc:264] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.942636 12160 raft_consensus.cc:2143] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:54.942731 12160 raft_consensus.cc:2170] T a7f19526ea9e46d7a9712631a17b667f P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.943390 12160 tablet_replica.cc:264] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.943527 12160 raft_consensus.cc:2143] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:54.943872 12160 pending_rounds.cc:64] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322: Trying to abort 1 pending transactions. I0401 16:41:54.943922 12160 pending_rounds.cc:70] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848022022815744 op_type: NO_OP noop_request { } I0401 16:41:54.944036 12160 raft_consensus.cc:2723] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:54.944649 12160 raft_consensus.cc:2170] T 592098728dd945bca53221864e027054 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.945528 12160 tablet_replica.cc:264] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.945631 12160 raft_consensus.cc:2143] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:54.945709 12160 raft_consensus.cc:2170] T 8bdba9b25079474ca744bbdaef9445f2 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.946326 12160 tablet_replica.cc:264] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.946419 12160 raft_consensus.cc:2143] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:54.946498 12160 raft_consensus.cc:2170] T 78a659df3b01418fbfc3049fa64e8998 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.946928 12160 tablet_replica.cc:264] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.947016 12160 raft_consensus.cc:2143] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:54.947129 12160 pending_rounds.cc:64] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322: Trying to abort 1 pending transactions. I0401 16:41:54.947155 12160 pending_rounds.cc:70] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848021977243648 op_type: NO_OP noop_request { } I0401 16:41:54.947227 12160 raft_consensus.cc:2723] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:54.947279 12160 raft_consensus.cc:2170] T 0843764bca114975957d7ff6cf6b8658 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.947937 12160 tablet_replica.cc:264] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.948025 12160 raft_consensus.cc:2143] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:54.948137 12160 pending_rounds.cc:64] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322: Trying to abort 1 pending transactions. I0401 16:41:54.948161 12160 pending_rounds.cc:70] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848022230065152 op_type: NO_OP noop_request { } I0401 16:41:54.948231 12160 raft_consensus.cc:2723] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:54.948283 12160 raft_consensus.cc:2170] T e389391748cc4a98acac74f489e04ff2 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.948951 12160 tablet_replica.cc:264] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.949038 12160 raft_consensus.cc:2143] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:54.949148 12160 pending_rounds.cc:64] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322: Trying to abort 1 pending transactions. I0401 16:41:54.949173 12160 pending_rounds.cc:70] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848022112620544 op_type: NO_OP noop_request { } I0401 16:41:54.949242 12160 raft_consensus.cc:2723] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:54.949295 12160 raft_consensus.cc:2170] T 052bfeda53ac4cbbb519288e39ea1f60 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.950573 12160 tablet_replica.cc:264] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.950661 12160 raft_consensus.cc:2143] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:54.950739 12160 raft_consensus.cc:2170] T 7d62fb567f8a4f4f9d652a07c693c489 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.951233 12160 tablet_replica.cc:264] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.951318 12160 raft_consensus.cc:2143] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:54.951397 12160 raft_consensus.cc:2170] T b46cce3175b34529991658b9a642d360 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.951809 12160 tablet_replica.cc:264] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322: stopping tablet replica I0401 16:41:54.951896 12160 raft_consensus.cc:2143] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:54.951975 12160 raft_consensus.cc:2170] T 5390f72c0f8446958bb3480cb0367396 P f172996cdc0646dc954f931f55011322 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:54.970166 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:54.970218 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:54.970355 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:54.974133 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:54.999258 17097 raft_consensus.cc:472] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:54.999372 17097 raft_consensus.cc:494] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f172996cdc0646dc954f931f55011322" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 41020 } } peers { permanent_uuid: "82eece752383481aab0e4d4f70d7960c" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 35483 } } peers { permanent_uuid: "9d2910a181674a39a19707efa79d3135" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 47365 } } I0401 16:41:55.000075 17097 leader_election.cc:296] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f172996cdc0646dc954f931f55011322 (127.11.224.1:41020), 9d2910a181674a39a19707efa79d3135 (127.11.224.3:47365) W0401 16:41:55.000517 16900 leader_election.cc:341] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 pre-election: RPC error from VoteRequest() call to peer f172996cdc0646dc954f931f55011322 (127.11.224.1:41020): Network error: Client connection negotiation failed: client connection to 127.11.224.1:41020: connect: Connection refused (error 111) I0401 16:41:55.000514 17007 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "052bfeda53ac4cbbb519288e39ea1f60" candidate_uuid: "82eece752383481aab0e4d4f70d7960c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d2910a181674a39a19707efa79d3135" is_pre_election: true I0401 16:41:55.000705 17007 raft_consensus.cc:2276] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 82eece752383481aab0e4d4f70d7960c in current term 1: Already voted for candidate f172996cdc0646dc954f931f55011322 in this term. I0401 16:41:55.001165 16901 leader_election.cc:310] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82eece752383481aab0e4d4f70d7960c; no voters: 9d2910a181674a39a19707efa79d3135, f172996cdc0646dc954f931f55011322 I0401 16:41:55.001411 17097 raft_consensus.cc:2886] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:55.003603 17097 raft_consensus.cc:2588] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:55.009253 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:55.009395 12160 tablet_replica.cc:264] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.009542 12160 raft_consensus.cc:2143] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.009650 12160 raft_consensus.cc:2170] T 052bfeda53ac4cbbb519288e39ea1f60 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.010279 12160 tablet_replica.cc:264] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.010370 12160 raft_consensus.cc:2143] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.010448 12160 raft_consensus.cc:2170] T e389391748cc4a98acac74f489e04ff2 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.010850 12160 tablet_replica.cc:264] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.010964 12160 raft_consensus.cc:2143] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:55.011098 12160 pending_rounds.cc:64] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c: Trying to abort 1 pending transactions. I0401 16:41:55.011127 12160 pending_rounds.cc:70] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848022155161600 op_type: NO_OP noop_request { } I0401 16:41:55.011219 12160 raft_consensus.cc:2723] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:55.011272 12160 raft_consensus.cc:2170] T 8bdba9b25079474ca744bbdaef9445f2 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.011945 12160 tablet_replica.cc:264] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.012037 12160 raft_consensus.cc:2143] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.012115 12160 raft_consensus.cc:2170] T 592098728dd945bca53221864e027054 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.012501 12160 tablet_replica.cc:264] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.012586 12160 raft_consensus.cc:2143] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:55.012697 12160 pending_rounds.cc:64] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c: Trying to abort 1 pending transactions. I0401 16:41:55.012723 12160 pending_rounds.cc:70] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848021930078208 op_type: NO_OP noop_request { } I0401 16:41:55.012794 12160 raft_consensus.cc:2723] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:55.012848 12160 raft_consensus.cc:2170] T a7f19526ea9e46d7a9712631a17b667f P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.013530 12160 tablet_replica.cc:264] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.013628 12160 raft_consensus.cc:2143] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.013711 12160 raft_consensus.cc:2170] T 5390f72c0f8446958bb3480cb0367396 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.014564 12160 tablet_replica.cc:264] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.014696 12160 raft_consensus.cc:2143] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.014816 12160 raft_consensus.cc:2170] T b46cce3175b34529991658b9a642d360 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.015452 12160 tablet_replica.cc:264] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.015544 12160 raft_consensus.cc:2143] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.015624 12160 raft_consensus.cc:2170] T 0843764bca114975957d7ff6cf6b8658 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.016137 12160 tablet_replica.cc:264] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.016224 12160 raft_consensus.cc:2143] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.016302 12160 raft_consensus.cc:2170] T 78a659df3b01418fbfc3049fa64e8998 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.016753 12160 tablet_replica.cc:264] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c: stopping tablet replica I0401 16:41:55.016844 12160 raft_consensus.cc:2143] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.016940 12160 raft_consensus.cc:2170] T 7d62fb567f8a4f4f9d652a07c693c489 P 82eece752383481aab0e4d4f70d7960c [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.033397 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:55.033447 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:55.033599 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:55.038331 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:55.050534 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:55.050683 12160 tablet_replica.cc:264] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.050837 12160 raft_consensus.cc:2143] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.050981 12160 raft_consensus.cc:2170] T 8bdba9b25079474ca744bbdaef9445f2 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.051584 12160 tablet_replica.cc:264] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.051678 12160 raft_consensus.cc:2143] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:55.051810 12160 pending_rounds.cc:64] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135: Trying to abort 1 pending transactions. I0401 16:41:55.051838 12160 pending_rounds.cc:70] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848022329987072 op_type: NO_OP noop_request { } I0401 16:41:55.051951 12160 raft_consensus.cc:2723] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:55.052004 12160 raft_consensus.cc:2170] T 78a659df3b01418fbfc3049fa64e8998 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.052680 12160 tablet_replica.cc:264] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.052769 12160 raft_consensus.cc:2143] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.052844 12160 raft_consensus.cc:2170] T 0843764bca114975957d7ff6cf6b8658 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.053256 12160 tablet_replica.cc:264] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.053344 12160 raft_consensus.cc:2143] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.053418 12160 raft_consensus.cc:2170] T e389391748cc4a98acac74f489e04ff2 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.053869 12160 tablet_replica.cc:264] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.053972 12160 raft_consensus.cc:2143] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.054046 12160 raft_consensus.cc:2170] T 052bfeda53ac4cbbb519288e39ea1f60 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.054476 12160 tablet_replica.cc:264] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.054560 12160 raft_consensus.cc:2143] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:55.054673 12160 pending_rounds.cc:64] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135: Trying to abort 1 pending transactions. I0401 16:41:55.054697 12160 pending_rounds.cc:70] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848022175670272 op_type: NO_OP noop_request { } I0401 16:41:55.054771 12160 raft_consensus.cc:2723] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:55.054826 12160 raft_consensus.cc:2170] T 5390f72c0f8446958bb3480cb0367396 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.055501 12160 tablet_replica.cc:264] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.055586 12160 raft_consensus.cc:2143] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:55.055703 12160 pending_rounds.cc:64] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135: Trying to abort 1 pending transactions. I0401 16:41:55.055732 12160 pending_rounds.cc:70] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848021595516928 op_type: NO_OP noop_request { } I0401 16:41:55.055807 12160 raft_consensus.cc:2723] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:55.055860 12160 raft_consensus.cc:2170] T b46cce3175b34529991658b9a642d360 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.056574 12160 tablet_replica.cc:264] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.056658 12160 raft_consensus.cc:2143] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:55.056766 12160 pending_rounds.cc:64] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135: Trying to abort 1 pending transactions. I0401 16:41:55.056789 12160 pending_rounds.cc:70] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135: Aborting transaction as it isn't in flight: id { term: 1 index: 1 } timestamp: 6365848022129807360 op_type: NO_OP noop_request { } I0401 16:41:55.056862 12160 raft_consensus.cc:2723] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 1 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:41:55.056928 12160 raft_consensus.cc:2170] T 7d62fb567f8a4f4f9d652a07c693c489 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.057548 12160 tablet_replica.cc:264] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.057631 12160 raft_consensus.cc:2143] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.057706 12160 raft_consensus.cc:2170] T a7f19526ea9e46d7a9712631a17b667f P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.058120 12160 tablet_replica.cc:264] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135: stopping tablet replica I0401 16:41:55.058200 12160 raft_consensus.cc:2143] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.058274 12160 raft_consensus.cc:2170] T 592098728dd945bca53221864e027054 P 9d2910a181674a39a19707efa79d3135 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.064558 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:55.064596 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:55.064720 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:55.068164 12160 master.cc:270] Master@127.11.224.62:56282 shutting down... I0401 16:41:55.072886 16819 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d: acquiring CA information for follower catalog manager: success I0401 16:41:55.074355 16819 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:55.090629 16822 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae: acquiring CA information for follower catalog manager: success I0401 16:41:55.091778 16822 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:55.092406 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.092535 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.092609 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 66dce64e6ea840c383918fc8e5e4b1ae: stopping tablet replica I0401 16:41:55.096287 12160 master.cc:281] Master@127.11.224.62:56282 shutdown complete. I0401 16:41:55.098603 12160 master.cc:270] Master@127.11.224.61:38064 shutting down... I0401 16:41:55.107856 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:55.108144 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.108219 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 98c0b50f3b9b49c2a017f01d32dfd03e: stopping tablet replica I0401 16:41:55.121788 12160 master.cc:281] Master@127.11.224.61:38064 shutdown complete. I0401 16:41:55.124660 12160 master.cc:270] Master@127.11.224.60:44441 shutting down... I0401 16:41:55.134136 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:55.134289 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:55.134363 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 97cf8f99ee6e4e759679a8292962551d: stopping tablet replica I0401 16:41:55.137943 12160 master.cc:281] Master@127.11.224.60:44441 shutdown complete. [ OK ] RemoteKsckTest.TestChecksumSnapshotLastingLongerThanAHM (1240 ms) [ RUN ] RemoteKsckTest.TestLeaderMasterDown I0401 16:41:55.151463 12160 test_util.cc:212] Using random seed: -1865677215 I0401 16:41:55.152015 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:36670,127.11.224.61:49689,127.11.224.60:53465 I0401 16:41:55.155341 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847931us I0401 16:41:55.155519 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:55.155555 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:55.155639 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:55.155665 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:55.156150 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "d7805c86420e4a78bd9449f7fe578dc7" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.160437 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s I0401 16:41:55.161206 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:55.163048 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:55.163094 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-0-root uuid: "d7805c86420e4a78bd9449f7fe578dc7" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.163173 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:55.204877 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:36670 I0401 16:41:55.205585 12160 webserver.cc:308] Webserver started at http://127.11.224.62:39169/ using document root and password file I0401 16:41:55.206584 17174 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.208478 17174 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:55.209394 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847931us I0401 16:41:55.209681 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:55.209749 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:55.209887 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:55.209941 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:55.210461 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "6493c51091c34650bb4ad4c001bfbed8" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.214701 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s I0401 16:41:55.215615 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:55.217099 17174 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:55.217806 17174 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:49689: Network error: Client connection negotiation failed: client connection to 127.11.224.61:49689: connect: Connection refused (error 111) I0401 16:41:55.218137 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:55.218183 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-1-root uuid: "6493c51091c34650bb4ad4c001bfbed8" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.218261 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:55.236009 17174 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } attempt: 1 W0401 16:41:55.236850 17174 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:49689: Network error: Client connection negotiation failed: client connection to 127.11.224.61:49689: connect: Connection refused (error 111) I0401 16:41:55.249322 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:49689 I0401 16:41:55.250061 12160 webserver.cc:308] Webserver started at http://127.11.224.61:33840/ using document root and password file I0401 16:41:55.250967 17231 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.252882 17231 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:55.254305 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847931us I0401 16:41:55.254566 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:55.254603 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:55.254721 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:55.254776 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:55.255338 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "1e37da2047f04022872d01162bce6fab" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.258575 17231 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:55.260390 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.002s sys 0.002s I0401 16:41:55.261265 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:55.263700 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:55.263753 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-2-root uuid: "1e37da2047f04022872d01162bce6fab" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.263891 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:55.263993 17231 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } has no permanent_uuid. Determining permanent_uuid... W0401 16:41:55.264719 17231 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:53465: Network error: Client connection negotiation failed: client connection to 127.11.224.60:53465: connect: Connection refused (error 111) I0401 16:41:55.285925 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:53465 I0401 16:41:55.286658 12160 webserver.cc:308] Webserver started at http://127.11.224.60:60997/ using document root and password file I0401 16:41:55.287009 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:41:55.287657 17288 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.289543 17288 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:55.291069 17174 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } attempt: 2 I0401 16:41:55.294548 17288 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:55.295413 17174 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:55.300395 17288 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } has no permanent_uuid. Determining permanent_uuid... I0401 16:41:55.302947 17174 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7: Bootstrap starting. I0401 16:41:55.304694 17174 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7: No blocks or log segments found. Creating new log. I0401 16:41:55.304855 17231 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } attempt: 1 I0401 16:41:55.307057 17288 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab: Bootstrap starting. I0401 16:41:55.308061 17288 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab: No blocks or log segments found. Creating new log. I0401 16:41:55.309309 17174 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7: No bootstrap required, opened a new log I0401 16:41:55.310066 17288 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab: No bootstrap required, opened a new log I0401 16:41:55.309989 17174 raft_consensus.cc:340] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.310174 17174 raft_consensus.cc:366] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.310226 17174 raft_consensus.cc:705] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d7805c86420e4a78bd9449f7fe578dc7, State: Initialized, Role: FOLLOWER I0401 16:41:55.310400 17174 consensus_queue.cc:229] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.310736 17288 raft_consensus.cc:340] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.310966 17288 raft_consensus.cc:366] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.311031 17288 raft_consensus.cc:705] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e37da2047f04022872d01162bce6fab, State: Initialized, Role: FOLLOWER I0401 16:41:55.310930 17174 sys_catalog.cc:337] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.311153 17174 sys_catalog.cc:340] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.311178 17293 sys_catalog.cc:337] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.311233 17288 consensus_queue.cc:229] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.311408 17293 sys_catalog.cc:340] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.311666 17174 sys_catalog.cc:424] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:55.311830 17231 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: Bootstrap starting. I0401 16:41:55.311888 17288 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.312127 17288 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.312088 17294 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.312366 17294 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.312825 17288 sys_catalog.cc:424] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:55.313334 17231 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: No blocks or log segments found. Creating new log. I0401 16:41:55.315186 17231 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: No bootstrap required, opened a new log W0401 16:41:55.315824 17296 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:55.315902 17296 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:55.315853 17231 raft_consensus.cc:340] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.316005 17231 raft_consensus.cc:366] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.316041 17231 raft_consensus.cc:705] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6493c51091c34650bb4ad4c001bfbed8, State: Initialized, Role: FOLLOWER I0401 16:41:55.316187 17231 consensus_queue.cc:229] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.316720 17231 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.316917 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:41:55.316922 17231 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.316999 17298 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.317169 17298 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.317323 17231 sys_catalog.cc:424] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:41:55.317682 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:41:55.317926 17295 catalog_manager.cc:1113] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:55.317966 17295 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:55.322016 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847931us I0401 16:41:55.322230 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:55.322294 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:55.322419 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:55.322474 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:55.323220 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "6ef9f21c58f44f249dd738b3b7ed8154" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" W0401 16:41:55.323652 17299 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:41:55.323726 17299 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:41:55.327457 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s I0401 16:41:55.328315 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:55.330705 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:41:55.330765 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-0-root uuid: "6ef9f21c58f44f249dd738b3b7ed8154" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.330878 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:55.356360 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:55.356408 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:55.371146 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:43541 I0401 16:41:55.371923 12160 webserver.cc:308] Webserver started at http://127.11.224.1:42082/ using document root and password file I0401 16:41:55.382738 17364 heartbeater.cc:345] Connected to a master server at 127.11.224.60:53465 I0401 16:41:55.382839 17364 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.383093 17364 heartbeater.cc:475] Master 127.11.224.60:53465 requested a full tablet report, sending... I0401 16:41:55.383118 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847931us I0401 16:41:55.383325 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:55.383360 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:55.383435 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:55.383460 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:55.384578 17255 ts_manager.cc:159] Registered new tserver with Master: 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541) I0401 16:41:55.384855 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.387559 17365 heartbeater.cc:345] Connected to a master server at 127.11.224.61:49689 I0401 16:41:55.387632 17365 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.387882 17365 heartbeater.cc:475] Master 127.11.224.61:49689 requested a full tablet report, sending... I0401 16:41:55.388969 17198 ts_manager.cc:159] Registered new tserver with Master: 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541) I0401 16:41:55.390374 17366 heartbeater.cc:345] Connected to a master server at 127.11.224.62:36670 I0401 16:41:55.390444 17366 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.390432 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s I0401 16:41:55.390662 17366 heartbeater.cc:475] Master 127.11.224.62:36670 requested a full tablet report, sending... I0401 16:41:55.391399 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:55.391521 17141 ts_manager.cc:159] Registered new tserver with Master: 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541) I0401 16:41:55.394028 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:55.394073 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-1-root uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.394137 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:55.428525 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:55.428566 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:55.444416 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:44328 I0401 16:41:55.445317 12160 webserver.cc:308] Webserver started at http://127.11.224.2:55471/ using document root and password file I0401 16:41:55.451906 17436 heartbeater.cc:345] Connected to a master server at 127.11.224.61:49689 I0401 16:41:55.451989 17436 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.452175 17436 heartbeater.cc:475] Master 127.11.224.61:49689 requested a full tablet report, sending... I0401 16:41:55.452481 17435 heartbeater.cc:345] Connected to a master server at 127.11.224.60:53465 I0401 16:41:55.453056 17435 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.453258 17435 heartbeater.cc:475] Master 127.11.224.60:53465 requested a full tablet report, sending... I0401 16:41:55.453270 17198 ts_manager.cc:159] Registered new tserver with Master: 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:55.454071 17255 ts_manager.cc:159] Registered new tserver with Master: 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:55.458689 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 847931us I0401 16:41:55.458874 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:41:55.458905 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:41:55.458973 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:41:55.458997 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:41:55.459473 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "fddd89494a344d12a1cd2756b2e57247" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.460852 17437 heartbeater.cc:345] Connected to a master server at 127.11.224.62:36670 I0401 16:41:55.460911 17437 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.461093 17437 heartbeater.cc:475] Master 127.11.224.62:36670 requested a full tablet report, sending... I0401 16:41:55.461841 17141 ts_manager.cc:159] Registered new tserver with Master: 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:55.465590 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.003s sys 0.002s I0401 16:41:55.466344 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:41:55.469154 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:41:55.469200 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-2-root uuid: "fddd89494a344d12a1cd2756b2e57247" format_stamp: "Formatted at 2019-04-01 23:41:55 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:41:55.469261 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestLeaderMasterDown.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:41:55.524179 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:41:55.524220 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:41:55.543114 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:39158 I0401 16:41:55.543931 12160 webserver.cc:308] Webserver started at http://127.11.224.3:55521/ using document root and password file I0401 16:41:55.559455 17505 heartbeater.cc:345] Connected to a master server at 127.11.224.60:53465 I0401 16:41:55.559537 17505 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.559762 17505 heartbeater.cc:475] Master 127.11.224.60:53465 requested a full tablet report, sending... I0401 16:41:55.560523 17255 ts_manager.cc:159] Registered new tserver with Master: fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:55.560791 17506 heartbeater.cc:345] Connected to a master server at 127.11.224.61:49689 I0401 16:41:55.560880 17506 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.561022 17506 heartbeater.cc:475] Master 127.11.224.61:49689 requested a full tablet report, sending... I0401 16:41:55.561585 17507 heartbeater.cc:345] Connected to a master server at 127.11.224.62:36670 I0401 16:41:55.561655 17507 heartbeater.cc:426] Registering TS with master... I0401 16:41:55.561794 17507 heartbeater.cc:475] Master 127.11.224.62:36670 requested a full tablet report, sending... I0401 16:41:55.561823 17198 ts_manager.cc:159] Registered new tserver with Master: fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:55.562474 17141 ts_manager.cc:159] Registered new tserver with Master: fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:55.562825 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.009441113s I0401 16:41:55.658010 17293 raft_consensus.cc:472] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:55.658102 17293 raft_consensus.cc:494] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.658708 17293 leader_election.cc:296] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6493c51091c34650bb4ad4c001bfbed8 (127.11.224.61:49689), 1e37da2047f04022872d01162bce6fab (127.11.224.60:53465) I0401 16:41:55.659021 17208 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7805c86420e4a78bd9449f7fe578dc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6493c51091c34650bb4ad4c001bfbed8" is_pre_election: true I0401 16:41:55.659088 17265 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7805c86420e4a78bd9449f7fe578dc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e37da2047f04022872d01162bce6fab" is_pre_election: true I0401 16:41:55.659145 17208 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7805c86420e4a78bd9449f7fe578dc7 in term 0. I0401 16:41:55.659238 17265 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d7805c86420e4a78bd9449f7fe578dc7 in term 0. I0401 16:41:55.659529 17122 leader_election.cc:310] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6493c51091c34650bb4ad4c001bfbed8, d7805c86420e4a78bd9449f7fe578dc7; no voters: I0401 16:41:55.659759 17293 raft_consensus.cc:2640] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:55.659826 17293 raft_consensus.cc:472] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:55.659862 17293 raft_consensus.cc:2886] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:55.661767 17293 raft_consensus.cc:494] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.662389 17293 leader_election.cc:296] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [CANDIDATE]: Term 1 election: Requested vote from peers 6493c51091c34650bb4ad4c001bfbed8 (127.11.224.61:49689), 1e37da2047f04022872d01162bce6fab (127.11.224.60:53465) I0401 16:41:55.662619 17208 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7805c86420e4a78bd9449f7fe578dc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6493c51091c34650bb4ad4c001bfbed8" I0401 16:41:55.662798 17265 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d7805c86420e4a78bd9449f7fe578dc7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e37da2047f04022872d01162bce6fab" I0401 16:41:55.663236 17208 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:55.663275 17265 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:55.664871 17208 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7805c86420e4a78bd9449f7fe578dc7 in term 1. I0401 16:41:55.664924 17265 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d7805c86420e4a78bd9449f7fe578dc7 in term 1. I0401 16:41:55.665174 17123 leader_election.cc:310] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e37da2047f04022872d01162bce6fab, d7805c86420e4a78bd9449f7fe578dc7; no voters: I0401 16:41:55.665400 17293 raft_consensus.cc:2640] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:55.665719 17293 raft_consensus.cc:667] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 1 LEADER]: Becoming Leader. State: Replica: d7805c86420e4a78bd9449f7fe578dc7, State: Running, Role: LEADER I0401 16:41:55.665915 17293 consensus_queue.cc:206] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:55.667163 17520 sys_catalog.cc:337] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7805c86420e4a78bd9449f7fe578dc7. Latest consensus state: current_term: 1 leader_uuid: "d7805c86420e4a78bd9449f7fe578dc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.667351 17520 sys_catalog.cc:340] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: This master's current role is: LEADER I0401 16:41:55.667989 17522 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:55.669912 17522 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:55.713024 17208 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 1 FOLLOWER]: Refusing update from remote peer d7805c86420e4a78bd9449f7fe578dc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:55.713024 17265 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 1 FOLLOWER]: Refusing update from remote peer d7805c86420e4a78bd9449f7fe578dc7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:41:55.713469 17520 consensus_queue.cc:984] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:55.713629 17293 consensus_queue.cc:984] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:55.716773 17298 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7805c86420e4a78bd9449f7fe578dc7. Latest consensus state: current_term: 1 leader_uuid: "d7805c86420e4a78bd9449f7fe578dc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.716982 17298 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.719060 17294 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: SysCatalogTable state changed. Reason: New leader d7805c86420e4a78bd9449f7fe578dc7. Latest consensus state: current_term: 1 leader_uuid: "d7805c86420e4a78bd9449f7fe578dc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.719244 17294 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.723342 17294 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d7805c86420e4a78bd9449f7fe578dc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.723520 17294 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.724229 17298 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d7805c86420e4a78bd9449f7fe578dc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.724401 17298 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:41:55.725210 17522 catalog_manager.cc:950] Generated new certificate authority record I0401 16:41:55.725570 17293 sys_catalog.cc:337] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d7805c86420e4a78bd9449f7fe578dc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.725742 17293 sys_catalog.cc:340] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: This master's current role is: LEADER I0401 16:41:55.725169 17531 sys_catalog.cc:337] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d7805c86420e4a78bd9449f7fe578dc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:55.725792 17531 sys_catalog.cc:340] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [sys.catalog]: This master's current role is: LEADER I0401 16:41:55.726594 17522 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:55.737850 17522 catalog_manager.cc:4281] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7: Generated new TSK 0 I0401 16:41:55.749743 17141 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:33595 I0401 16:41:55.750391 17139 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:33601 I0401 16:41:55.750748 17140 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.62:33598 I0401 16:41:55.757858 17140 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.62:33602: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:41:55.758572 17140 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:41:55.761778 17366 heartbeater.cc:467] Master 127.11.224.62:36670 was elected leader, sending a full tablet report... I0401 16:41:55.762382 17507 heartbeater.cc:467] Master 127.11.224.62:36670 was elected leader, sending a full tablet report... I0401 16:41:55.762897 17437 heartbeater.cc:467] Master 127.11.224.62:36670 was elected leader, sending a full tablet report... I0401 16:41:55.799753 17470 tablet_service.cc:1006] Processing CreateTablet for tablet b4ebb6880f65472aa60108d6a84a711f (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:55.799753 17471 tablet_service.cc:1006] Processing CreateTablet for tablet 470984c7f7894fc4af997e17431ab35b (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:55.799753 17472 tablet_service.cc:1006] Processing CreateTablet for tablet ab0ee02e1ff34496884c6b99fb4366f1 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:55.800230 17470 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b4ebb6880f65472aa60108d6a84a711f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.800401 17471 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 470984c7f7894fc4af997e17431ab35b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.800948 17472 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ab0ee02e1ff34496884c6b99fb4366f1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.803279 17331 tablet_service.cc:1006] Processing CreateTablet for tablet ab0ee02e1ff34496884c6b99fb4366f1 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:55.803580 17331 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ab0ee02e1ff34496884c6b99fb4366f1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.807165 17469 tablet_service.cc:1006] Processing CreateTablet for tablet d98e804572ea4ff5aaa26ed95fefd12a (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:55.807479 17469 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d98e804572ea4ff5aaa26ed95fefd12a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.807417 17466 tablet_service.cc:1006] Processing CreateTablet for tablet 38c212dc9ad74daf9483c8a684ed5e88 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:55.807683 17466 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 38c212dc9ad74daf9483c8a684ed5e88. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.807631 17464 tablet_service.cc:1006] Processing CreateTablet for tablet cc9be6d6b120481fb19df463acdb154b (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:55.807934 17468 tablet_service.cc:1006] Processing CreateTablet for tablet 27493696fabc490ea8fdd9dcae6b18c1 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:55.808068 17464 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet cc9be6d6b120481fb19df463acdb154b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.808207 17468 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 27493696fabc490ea8fdd9dcae6b18c1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.808427 17463 tablet_service.cc:1006] Processing CreateTablet for tablet 8d3c98fd34794ba1bbdc75598989b855 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:55.808904 17463 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8d3c98fd34794ba1bbdc75598989b855. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.810480 17465 tablet_service.cc:1006] Processing CreateTablet for tablet ab6de6d13ad245149610ecb56be02a4f (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:55.812572 17465 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ab6de6d13ad245149610ecb56be02a4f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.813025 17467 tablet_service.cc:1006] Processing CreateTablet for tablet 94335152d3e84229bd5dc92dd1af2988 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:55.818832 17330 tablet_service.cc:1006] Processing CreateTablet for tablet 470984c7f7894fc4af997e17431ab35b (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:55.819289 17327 tablet_service.cc:1006] Processing CreateTablet for tablet 27493696fabc490ea8fdd9dcae6b18c1 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:55.820050 17323 tablet_service.cc:1006] Processing CreateTablet for tablet cc9be6d6b120481fb19df463acdb154b (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:55.822207 17328 tablet_service.cc:1006] Processing CreateTablet for tablet d98e804572ea4ff5aaa26ed95fefd12a (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:55.818850 17326 tablet_service.cc:1006] Processing CreateTablet for tablet 94335152d3e84229bd5dc92dd1af2988 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:55.824231 17325 tablet_service.cc:1006] Processing CreateTablet for tablet 38c212dc9ad74daf9483c8a684ed5e88 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:55.824596 17329 tablet_service.cc:1006] Processing CreateTablet for tablet b4ebb6880f65472aa60108d6a84a711f (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:55.824764 17330 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 470984c7f7894fc4af997e17431ab35b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.824923 17467 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 94335152d3e84229bd5dc92dd1af2988. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.825490 17322 tablet_service.cc:1006] Processing CreateTablet for tablet 8d3c98fd34794ba1bbdc75598989b855 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:55.825736 17323 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet cc9be6d6b120481fb19df463acdb154b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.825803 17324 tablet_service.cc:1006] Processing CreateTablet for tablet ab6de6d13ad245149610ecb56be02a4f (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:55.828615 17327 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 27493696fabc490ea8fdd9dcae6b18c1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.833010 17326 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 94335152d3e84229bd5dc92dd1af2988. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.834178 17400 tablet_service.cc:1006] Processing CreateTablet for tablet b4ebb6880f65472aa60108d6a84a711f (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:41:55.834357 17324 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ab6de6d13ad245149610ecb56be02a4f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.834460 17399 tablet_service.cc:1006] Processing CreateTablet for tablet d98e804572ea4ff5aaa26ed95fefd12a (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:41:55.834144 17402 tablet_service.cc:1006] Processing CreateTablet for tablet ab0ee02e1ff34496884c6b99fb4366f1 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:41:55.834144 17401 tablet_service.cc:1006] Processing CreateTablet for tablet 470984c7f7894fc4af997e17431ab35b (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:41:55.838004 17395 tablet_service.cc:1006] Processing CreateTablet for tablet ab6de6d13ad245149610ecb56be02a4f (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:41:55.838491 17393 tablet_service.cc:1006] Processing CreateTablet for tablet 8d3c98fd34794ba1bbdc75598989b855 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:41:55.838903 17398 tablet_service.cc:1006] Processing CreateTablet for tablet 27493696fabc490ea8fdd9dcae6b18c1 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:41:55.839258 17394 tablet_service.cc:1006] Processing CreateTablet for tablet cc9be6d6b120481fb19df463acdb154b (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:41:55.838023 17397 tablet_service.cc:1006] Processing CreateTablet for tablet 94335152d3e84229bd5dc92dd1af2988 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:41:55.840162 17325 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 38c212dc9ad74daf9483c8a684ed5e88. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.838289 17396 tablet_service.cc:1006] Processing CreateTablet for tablet 38c212dc9ad74daf9483c8a684ed5e88 (table=ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:41:55.847622 17400 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b4ebb6880f65472aa60108d6a84a711f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.848502 17328 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d98e804572ea4ff5aaa26ed95fefd12a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.853417 17401 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 470984c7f7894fc4af997e17431ab35b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.856849 17329 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b4ebb6880f65472aa60108d6a84a711f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.862447 17395 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ab6de6d13ad245149610ecb56be02a4f. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.862818 17322 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8d3c98fd34794ba1bbdc75598989b855. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.863891 17398 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 27493696fabc490ea8fdd9dcae6b18c1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.871946 17396 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 38c212dc9ad74daf9483c8a684ed5e88. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.872654 17393 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8d3c98fd34794ba1bbdc75598989b855. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.874230 17397 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 94335152d3e84229bd5dc92dd1af2988. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.877367 17394 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet cc9be6d6b120481fb19df463acdb154b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.880761 17537 tablet_bootstrap.cc:439] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:55.880815 17402 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ab0ee02e1ff34496884c6b99fb4366f1. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.882166 17537 tablet_bootstrap.cc:590] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:55.884824 17399 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d98e804572ea4ff5aaa26ed95fefd12a. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:41:55.916824 17538 tablet_bootstrap.cc:439] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:55.918956 17538 tablet_bootstrap.cc:590] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:55.920497 17540 tablet_bootstrap.cc:439] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:55.920564 17537 tablet_bootstrap.cc:439] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:55.920701 17537 ts_tablet_manager.cc:1053] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.040s user 0.003s sys 0.013s I0401 16:41:55.920985 17538 tablet_bootstrap.cc:439] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:55.921092 17538 ts_tablet_manager.cc:1053] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.004s user 0.001s sys 0.002s I0401 16:41:55.921301 17537 raft_consensus.cc:340] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.921433 17537 raft_consensus.cc:366] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.921486 17537 raft_consensus.cc:705] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:55.921638 17540 tablet_bootstrap.cc:590] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:55.921645 17537 consensus_queue.cc:229] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.921684 17538 raft_consensus.cc:340] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.921977 17538 raft_consensus.cc:366] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.922046 17538 raft_consensus.cc:705] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:55.922263 17538 consensus_queue.cc:229] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.925822 17537 ts_tablet_manager.cc:1081] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I0401 16:41:55.926527 17537 tablet_bootstrap.cc:439] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:55.928408 17537 tablet_bootstrap.cc:590] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:55.930377 17538 ts_tablet_manager.cc:1081] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.009s user 0.002s sys 0.005s I0401 16:41:55.930681 17538 tablet_bootstrap.cc:439] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:55.931886 17538 tablet_bootstrap.cc:590] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:55.932842 17540 tablet_bootstrap.cc:439] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:55.932950 17540 ts_tablet_manager.cc:1053] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.004s I0401 16:41:55.933483 17540 raft_consensus.cc:340] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.933619 17540 raft_consensus.cc:366] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.933650 17540 raft_consensus.cc:705] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:55.933814 17540 consensus_queue.cc:229] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.935349 17540 ts_tablet_manager.cc:1081] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:55.935636 17540 tablet_bootstrap.cc:439] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:55.936108 17538 tablet_bootstrap.cc:439] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:55.936224 17538 ts_tablet_manager.cc:1053] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.000s I0401 16:41:55.936919 17538 raft_consensus.cc:340] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.937124 17538 raft_consensus.cc:366] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.937186 17538 raft_consensus.cc:705] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:55.937395 17538 consensus_queue.cc:229] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.938179 17537 tablet_bootstrap.cc:439] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:55.939143 17537 ts_tablet_manager.cc:1053] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.005s I0401 16:41:55.939002 17540 tablet_bootstrap.cc:590] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:55.940102 17537 raft_consensus.cc:340] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.940474 17537 raft_consensus.cc:366] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.940543 17537 raft_consensus.cc:705] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:55.940717 17537 consensus_queue.cc:229] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.941627 17538 ts_tablet_manager.cc:1081] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s I0401 16:41:55.942116 17537 ts_tablet_manager.cc:1081] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:55.942548 17538 tablet_bootstrap.cc:439] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:55.942498 17537 tablet_bootstrap.cc:439] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:55.944110 17537 tablet_bootstrap.cc:590] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:55.944169 17538 tablet_bootstrap.cc:590] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:55.944749 17547 raft_consensus.cc:472] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:55.944839 17547 raft_consensus.cc:494] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.946802 17547 leader_election.cc:296] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:55.951648 17537 tablet_bootstrap.cc:439] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:55.951891 17537 ts_tablet_manager.cc:1053] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.009s user 0.004s sys 0.000s I0401 16:41:55.951648 17540 tablet_bootstrap.cc:439] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:55.952837 17540 ts_tablet_manager.cc:1053] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.017s user 0.003s sys 0.006s I0401 16:41:55.953656 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "27493696fabc490ea8fdd9dcae6b18c1" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" is_pre_election: true I0401 16:41:55.954176 17538 tablet_bootstrap.cc:439] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:55.954322 17538 ts_tablet_manager.cc:1053] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.001s I0401 16:41:55.954282 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "27493696fabc490ea8fdd9dcae6b18c1" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" is_pre_election: true I0401 16:41:55.954483 17341 raft_consensus.cc:2346] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 0. I0401 16:41:55.954535 17540 raft_consensus.cc:340] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.954702 17540 raft_consensus.cc:366] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.954741 17540 raft_consensus.cc:705] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:55.954867 17374 leader_election.cc:310] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:55.954922 17540 consensus_queue.cc:229] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.954960 17538 raft_consensus.cc:340] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.955116 17547 raft_consensus.cc:2640] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:55.955144 17538 raft_consensus.cc:366] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.955193 17547 raft_consensus.cc:472] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:55.955212 17538 raft_consensus.cc:705] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:55.955281 17547 raft_consensus.cc:2886] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:55.955377 17538 consensus_queue.cc:229] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.955927 17537 raft_consensus.cc:340] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.956102 17537 raft_consensus.cc:366] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.956159 17537 raft_consensus.cc:705] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER W0401 16:41:55.956219 17373 leader_election.cc:348] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:55.956339 17537 consensus_queue.cc:229] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.957736 17547 raft_consensus.cc:494] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.958806 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "27493696fabc490ea8fdd9dcae6b18c1" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" I0401 16:41:55.958952 17341 raft_consensus.cc:2886] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:55.959321 17537 ts_tablet_manager.cc:1081] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.007s user 0.001s sys 0.000s I0401 16:41:55.959704 17537 tablet_bootstrap.cc:439] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:55.960923 17341 raft_consensus.cc:2346] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 1. I0401 16:41:55.961437 17537 tablet_bootstrap.cc:590] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:55.961874 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "27493696fabc490ea8fdd9dcae6b18c1" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" I0401 16:41:55.961977 17374 leader_election.cc:310] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:55.962019 17482 raft_consensus.cc:2886] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:55.962924 17540 ts_tablet_manager.cc:1081] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.010s user 0.001s sys 0.001s I0401 16:41:55.963172 17540 tablet_bootstrap.cc:439] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:55.963749 17551 raft_consensus.cc:2640] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:55.963891 17551 raft_consensus.cc:667] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Becoming Leader. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Running, Role: LEADER I0401 16:41:55.964145 17551 consensus_queue.cc:206] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.964604 17540 tablet_bootstrap.cc:590] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:55.964931 17482 raft_consensus.cc:2346] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 1. I0401 16:41:55.962328 17547 leader_election.cc:296] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:55.968109 17538 ts_tablet_manager.cc:1081] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.014s user 0.001s sys 0.000s I0401 16:41:55.968612 17538 tablet_bootstrap.cc:439] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:55.970847 17537 tablet_bootstrap.cc:439] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:55.972111 17537 ts_tablet_manager.cc:1053] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.001s I0401 16:41:55.972316 17540 tablet_bootstrap.cc:439] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:55.972059 17140 catalog_manager.cc:3977] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d reported cstate change: term changed from 0 to 1, leader changed from to 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2). New cstate: current_term: 1 leader_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: UNKNOWN } } } I0401 16:41:55.972445 17540 ts_tablet_manager.cc:1053] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.002s I0401 16:41:55.972740 17538 tablet_bootstrap.cc:590] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:55.973512 17540 raft_consensus.cc:340] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.974581 17540 raft_consensus.cc:366] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.974800 17540 raft_consensus.cc:705] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:55.974865 17538 tablet_bootstrap.cc:439] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:55.975039 17538 ts_tablet_manager.cc:1053] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.001s I0401 16:41:55.974982 17537 raft_consensus.cc:340] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.975594 17537 raft_consensus.cc:366] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.975664 17537 raft_consensus.cc:705] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:55.976398 17538 raft_consensus.cc:340] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.977277 17538 raft_consensus.cc:366] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.977344 17538 raft_consensus.cc:705] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:55.976172 17537 consensus_queue.cc:229] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.975450 17540 consensus_queue.cc:229] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.978132 17540 ts_tablet_manager.cc:1081] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s I0401 16:41:55.979666 17540 tablet_bootstrap.cc:439] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:55.977547 17538 consensus_queue.cc:229] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.983078 17537 ts_tablet_manager.cc:1081] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.010s user 0.002s sys 0.000s I0401 16:41:55.983458 17538 ts_tablet_manager.cc:1081] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s I0401 16:41:55.983597 17537 tablet_bootstrap.cc:439] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:55.983705 17538 tablet_bootstrap.cc:439] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:55.984589 17540 tablet_bootstrap.cc:590] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:55.984843 17538 tablet_bootstrap.cc:590] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:55.984896 17537 tablet_bootstrap.cc:590] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:55.994716 17537 tablet_bootstrap.cc:439] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:55.994902 17537 ts_tablet_manager.cc:1053] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.011s user 0.001s sys 0.007s I0401 16:41:55.995450 17540 tablet_bootstrap.cc:439] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:55.995566 17540 ts_tablet_manager.cc:1053] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.016s user 0.004s sys 0.004s I0401 16:41:55.995880 17538 tablet_bootstrap.cc:439] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:55.995982 17538 ts_tablet_manager.cc:1053] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.000s I0401 16:41:55.995918 17537 raft_consensus.cc:340] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.996096 17537 raft_consensus.cc:366] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.996160 17537 raft_consensus.cc:705] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:55.996274 17540 raft_consensus.cc:340] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.996451 17540 raft_consensus.cc:366] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.996361 17537 consensus_queue.cc:229] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.996501 17540 raft_consensus.cc:705] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:55.996522 17538 raft_consensus.cc:340] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.996953 17538 raft_consensus.cc:366] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:55.996711 17540 consensus_queue.cc:229] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.997774 17540 ts_tablet_manager.cc:1081] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:55.998060 17540 tablet_bootstrap.cc:439] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:55.997020 17538 raft_consensus.cc:705] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:55.999438 17538 consensus_queue.cc:229] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:55.999699 17537 ts_tablet_manager.cc:1081] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I0401 16:41:56.001202 17540 tablet_bootstrap.cc:590] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:56.000751 17538 ts_tablet_manager.cc:1081] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s I0401 16:41:56.002179 17538 tablet_bootstrap.cc:439] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:56.002470 17537 tablet_bootstrap.cc:439] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:56.003775 17538 tablet_bootstrap.cc:590] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:56.003852 17537 tablet_bootstrap.cc:590] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:56.004369 17540 tablet_bootstrap.cc:439] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:56.004478 17540 ts_tablet_manager.cc:1053] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s I0401 16:41:56.005162 17540 raft_consensus.cc:340] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.005292 17540 raft_consensus.cc:366] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.005367 17540 raft_consensus.cc:705] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:56.005532 17540 consensus_queue.cc:229] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.006038 17540 ts_tablet_manager.cc:1081] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:56.006271 17540 tablet_bootstrap.cc:439] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:56.006418 17537 tablet_bootstrap.cc:439] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:56.006520 17537 ts_tablet_manager.cc:1053] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0401 16:41:56.007144 17537 raft_consensus.cc:340] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.007325 17537 raft_consensus.cc:366] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.007369 17537 raft_consensus.cc:705] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:56.007514 17537 consensus_queue.cc:229] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.008005 17537 ts_tablet_manager.cc:1081] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:56.008085 17540 tablet_bootstrap.cc:590] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:56.008191 17537 tablet_bootstrap.cc:439] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:56.008734 17538 tablet_bootstrap.cc:439] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:56.008890 17538 ts_tablet_manager.cc:1053] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.007s user 0.001s sys 0.002s I0401 16:41:56.009922 17537 tablet_bootstrap.cc:590] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:56.010509 17538 raft_consensus.cc:340] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.010761 17538 raft_consensus.cc:366] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.010793 17538 raft_consensus.cc:705] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:56.010951 17538 consensus_queue.cc:229] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.012321 17538 ts_tablet_manager.cc:1081] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:56.012560 17538 tablet_bootstrap.cc:439] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:56.015823 17538 tablet_bootstrap.cc:590] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:56.015862 17537 tablet_bootstrap.cc:439] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:56.015959 17537 ts_tablet_manager.cc:1053] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s I0401 16:41:56.016453 17537 raft_consensus.cc:340] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.016577 17537 raft_consensus.cc:366] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.016608 17537 raft_consensus.cc:705] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:56.016755 17537 consensus_queue.cc:229] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.017212 17540 tablet_bootstrap.cc:439] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:56.017287 17537 ts_tablet_manager.cc:1081] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:41:56.017398 17540 ts_tablet_manager.cc:1053] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.011s user 0.002s sys 0.002s I0401 16:41:56.017549 17537 tablet_bootstrap.cc:439] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:56.017855 17538 tablet_bootstrap.cc:439] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:56.018155 17538 ts_tablet_manager.cc:1053] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s I0401 16:41:56.019323 17537 tablet_bootstrap.cc:590] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:56.020859 17538 raft_consensus.cc:340] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.021558 17538 raft_consensus.cc:366] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.021597 17538 raft_consensus.cc:705] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:56.021298 17540 raft_consensus.cc:340] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.021682 17540 raft_consensus.cc:366] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.021723 17540 raft_consensus.cc:705] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:56.021836 17538 consensus_queue.cc:229] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.021888 17540 consensus_queue.cc:229] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.022101 17537 tablet_bootstrap.cc:439] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:56.022208 17537 ts_tablet_manager.cc:1053] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s I0401 16:41:56.022908 17537 raft_consensus.cc:340] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.023064 17537 raft_consensus.cc:366] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.023097 17537 raft_consensus.cc:705] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:56.023265 17537 consensus_queue.cc:229] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.025696 17537 ts_tablet_manager.cc:1081] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:41:56.025998 17537 tablet_bootstrap.cc:439] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:56.027098 17540 ts_tablet_manager.cc:1081] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s I0401 16:41:56.027736 17540 tablet_bootstrap.cc:439] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:56.028744 17538 ts_tablet_manager.cc:1081] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s I0401 16:41:56.029003 17538 tablet_bootstrap.cc:439] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:56.030416 17537 tablet_bootstrap.cc:590] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:56.030422 17540 tablet_bootstrap.cc:590] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:56.031219 17538 tablet_bootstrap.cc:590] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:56.033269 17537 tablet_bootstrap.cc:439] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:56.033381 17537 ts_tablet_manager.cc:1053] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.003s I0401 16:41:56.033383 17540 tablet_bootstrap.cc:439] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:56.033526 17540 ts_tablet_manager.cc:1053] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s I0401 16:41:56.034150 17538 tablet_bootstrap.cc:439] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:56.034243 17538 ts_tablet_manager.cc:1053] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.001s I0401 16:41:56.034179 17540 raft_consensus.cc:340] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.034179 17537 raft_consensus.cc:340] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.034396 17540 raft_consensus.cc:366] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.034410 17537 raft_consensus.cc:366] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.034436 17537 raft_consensus.cc:705] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:56.034435 17540 raft_consensus.cc:705] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:56.034606 17537 consensus_queue.cc:229] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.034775 17538 raft_consensus.cc:340] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.034938 17538 raft_consensus.cc:366] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.034976 17538 raft_consensus.cc:705] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:56.035111 17538 consensus_queue.cc:229] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.035223 17537 ts_tablet_manager.cc:1081] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:41:56.035538 17537 tablet_bootstrap.cc:439] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247: Bootstrap starting. I0401 16:41:56.034606 17540 consensus_queue.cc:229] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.035955 17540 ts_tablet_manager.cc:1081] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:41:56.036219 17540 tablet_bootstrap.cc:439] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:56.036913 17544 raft_consensus.cc:472] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.037091 17544 raft_consensus.cc:494] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.037952 17544 leader_election.cc:296] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.038098 17540 tablet_bootstrap.cc:590] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:56.038506 17551 raft_consensus.cc:472] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.040031 17538 ts_tablet_manager.cc:1081] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s I0401 16:41:56.040261 17551 raft_consensus.cc:494] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.041090 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d98e804572ea4ff5aaa26ed95fefd12a" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" is_pre_election: true I0401 16:41:56.041438 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d98e804572ea4ff5aaa26ed95fefd12a" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" is_pre_election: true I0401 16:41:56.041520 17341 raft_consensus.cc:2346] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 0. I0401 16:41:56.042599 17538 tablet_bootstrap.cc:439] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:56.042971 17551 leader_election.cc:296] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.043045 17374 leader_election.cc:310] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: W0401 16:41:56.043367 17373 leader_election.cc:348] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:56.043867 17551 raft_consensus.cc:2640] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.044028 17551 raft_consensus.cc:472] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.044201 17551 raft_consensus.cc:2886] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.045797 17537 tablet_bootstrap.cc:590] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247: No blocks or log segments found. Creating new log. I0401 16:41:56.046555 17551 raft_consensus.cc:494] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.048358 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d98e804572ea4ff5aaa26ed95fefd12a" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" I0401 16:41:56.049140 17542 raft_consensus.cc:472] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.049147 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d98e804572ea4ff5aaa26ed95fefd12a" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" I0401 16:41:56.049624 17341 raft_consensus.cc:2886] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.049629 17542 raft_consensus.cc:494] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.050437 17542 leader_election.cc:296] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) W0401 16:41:56.051542 17373 leader_election.cc:348] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158): Illegal state: must be running to vote when last-logged opid is not known I0401 16:41:56.051806 17341 raft_consensus.cc:2346] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 1. I0401 16:41:56.052492 17551 leader_election.cc:296] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.059227 17374 leader_election.cc:310] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: fddd89494a344d12a1cd2756b2e57247 I0401 16:41:56.060621 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ab6de6d13ad245149610ecb56be02a4f" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" is_pre_election: true I0401 16:41:56.061035 17551 raft_consensus.cc:2640] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.061094 17341 raft_consensus.cc:2346] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 0. I0401 16:41:56.061242 17551 raft_consensus.cc:667] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Becoming Leader. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Running, Role: LEADER I0401 16:41:56.061661 17444 leader_election.cc:310] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.061552 17551 consensus_queue.cc:206] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.061980 17542 raft_consensus.cc:2640] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.062135 17542 raft_consensus.cc:472] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.062276 17542 raft_consensus.cc:2886] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.061815 17540 tablet_bootstrap.cc:439] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:56.065426 17538 tablet_bootstrap.cc:590] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:56.065318 17542 raft_consensus.cc:494] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.066126 17542 leader_election.cc:296] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:56.066344 17540 ts_tablet_manager.cc:1053] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.027s user 0.002s sys 0.006s I0401 16:41:56.068437 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ab6de6d13ad245149610ecb56be02a4f" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" I0401 16:41:56.069602 17540 raft_consensus.cc:340] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.070421 17341 raft_consensus.cc:2886] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.073202 17412 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "38c212dc9ad74daf9483c8a684ed5e88" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" is_pre_election: true I0401 16:41:56.073448 17412 raft_consensus.cc:2346] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 0. I0401 16:41:56.073319 17140 catalog_manager.cc:3977] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d reported cstate change: term changed from 0 to 1, leader changed from to 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2). New cstate: current_term: 1 leader_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: UNKNOWN } } } I0401 16:41:56.073905 17303 leader_election.cc:310] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:56.074462 17544 raft_consensus.cc:2640] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.074592 17544 raft_consensus.cc:472] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.074728 17544 raft_consensus.cc:2886] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.075232 17341 raft_consensus.cc:2346] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 1. I0401 16:41:56.077102 17542 raft_consensus.cc:472] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.077214 17540 raft_consensus.cc:366] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.081173 17444 leader_election.cc:310] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.082556 17542 raft_consensus.cc:494] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.082716 17540 raft_consensus.cc:705] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:56.082937 17537 tablet_bootstrap.cc:439] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247: No bootstrap required, opened a new log I0401 16:41:56.083600 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "38c212dc9ad74daf9483c8a684ed5e88" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" is_pre_election: true I0401 16:41:56.085387 17482 raft_consensus.cc:2346] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 0. I0401 16:41:56.085742 17544 raft_consensus.cc:494] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.086386 17544 leader_election.cc:296] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 election: Requested vote from peers 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.086484 17542 leader_election.cc:296] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:56.086665 17542 raft_consensus.cc:2640] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.086902 17542 raft_consensus.cc:667] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 1 LEADER]: Becoming Leader. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Running, Role: LEADER I0401 16:41:56.086894 17412 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "38c212dc9ad74daf9483c8a684ed5e88" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" I0401 16:41:56.087108 17412 raft_consensus.cc:2886] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.087199 17542 consensus_queue.cc:206] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.088300 17537 ts_tablet_manager.cc:1053] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247: Time spent bootstrapping tablet: real 0.048s user 0.003s sys 0.014s I0401 16:41:56.086896 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "38c212dc9ad74daf9483c8a684ed5e88" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" I0401 16:41:56.088138 17540 consensus_queue.cc:229] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.089201 17482 raft_consensus.cc:2886] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.089958 17540 ts_tablet_manager.cc:1081] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.023s user 0.001s sys 0.000s I0401 16:41:56.090121 17537 raft_consensus.cc:340] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.090394 17537 raft_consensus.cc:366] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.090461 17540 tablet_bootstrap.cc:439] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:56.090550 17537 raft_consensus.cc:705] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Initialized, Role: FOLLOWER I0401 16:41:56.090961 17412 raft_consensus.cc:2346] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 1. I0401 16:41:56.090842 17537 consensus_queue.cc:229] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.093178 17303 leader_election.cc:310] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:56.093492 17544 raft_consensus.cc:2640] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.094982 17482 raft_consensus.cc:2346] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 1. I0401 16:41:56.097189 17540 tablet_bootstrap.cc:590] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:56.098533 17544 raft_consensus.cc:667] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 LEADER]: Becoming Leader. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Running, Role: LEADER I0401 16:41:56.099035 17544 consensus_queue.cc:206] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.100503 17538 tablet_bootstrap.cc:439] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:56.102572 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ab0ee02e1ff34496884c6b99fb4366f1" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" is_pre_election: true I0401 16:41:56.102906 17341 raft_consensus.cc:2346] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 0. I0401 16:41:56.102912 17412 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ab6de6d13ad245149610ecb56be02a4f" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" is_pre_election: true I0401 16:41:56.103232 17412 raft_consensus.cc:2346] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 0. I0401 16:41:56.103233 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ab6de6d13ad245149610ecb56be02a4f" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" I0401 16:41:56.103440 17411 raft_consensus.cc:2886] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.103437 17444 leader_election.cc:310] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.103161 17140 catalog_manager.cc:3977] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 reported cstate change: term changed from 0 to 1, leader changed from to fddd89494a344d12a1cd2756b2e57247 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "fddd89494a344d12a1cd2756b2e57247" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: HEALTHY } } } I0401 16:41:56.103634 17410 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ab0ee02e1ff34496884c6b99fb4366f1" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" is_pre_election: true I0401 16:41:56.103953 17410 raft_consensus.cc:2346] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 0. I0401 16:41:56.104254 17537 ts_tablet_manager.cc:1081] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247: Time spent starting tablet: real 0.012s user 0.000s sys 0.004s I0401 16:41:56.109817 17411 raft_consensus.cc:2346] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 1. I0401 16:41:56.110283 17538 ts_tablet_manager.cc:1053] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.060s user 0.002s sys 0.017s I0401 16:41:56.110509 17579 raft_consensus.cc:2640] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.110666 17579 raft_consensus.cc:472] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.110992 17579 raft_consensus.cc:2886] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.111362 17538 raft_consensus.cc:340] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.111658 17538 raft_consensus.cc:366] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.111871 17538 raft_consensus.cc:705] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:56.112179 17538 consensus_queue.cc:229] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.112535 17140 catalog_manager.cc:3977] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 reported cstate change: term changed from 0 to 1, leader changed from to 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: UNKNOWN } } } I0401 16:41:56.113008 17538 ts_tablet_manager.cc:1081] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:41:56.113337 17538 tablet_bootstrap.cc:439] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154: Bootstrap starting. I0401 16:41:56.114037 17579 raft_consensus.cc:494] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.115455 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ab0ee02e1ff34496884c6b99fb4366f1" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" I0401 16:41:56.115664 17341 raft_consensus.cc:2886] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.116497 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ab0ee02e1ff34496884c6b99fb4366f1" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" I0401 16:41:56.116691 17411 raft_consensus.cc:2886] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.117892 17341 raft_consensus.cc:2346] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 1. I0401 16:41:56.118083 17544 raft_consensus.cc:472] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.118255 17544 raft_consensus.cc:494] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.118650 17538 tablet_bootstrap.cc:590] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154: No blocks or log segments found. Creating new log. I0401 16:41:56.118718 17540 tablet_bootstrap.cc:439] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:56.118777 17411 raft_consensus.cc:2346] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 1. I0401 16:41:56.118966 17544 leader_election.cc:296] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.119685 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "94335152d3e84229bd5dc92dd1af2988" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" is_pre_election: true I0401 16:41:56.119951 17482 raft_consensus.cc:2346] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 0. I0401 16:41:56.119946 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "94335152d3e84229bd5dc92dd1af2988" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" is_pre_election: true I0401 16:41:56.120158 17411 raft_consensus.cc:2346] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 0. I0401 16:41:56.120581 17303 leader_election.cc:310] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:56.120657 17579 leader_election.cc:296] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:56.119685 17444 leader_election.cc:310] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.121171 17579 raft_consensus.cc:2640] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.119007 17540 ts_tablet_manager.cc:1053] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.029s user 0.003s sys 0.005s I0401 16:41:56.123059 17579 raft_consensus.cc:667] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 1 LEADER]: Becoming Leader. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Running, Role: LEADER I0401 16:41:56.123360 17579 consensus_queue.cc:206] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.124152 17544 raft_consensus.cc:2640] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.124315 17544 raft_consensus.cc:472] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.124152 17540 raft_consensus.cc:340] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.124476 17544 raft_consensus.cc:2886] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.124852 17540 raft_consensus.cc:366] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.125000 17540 raft_consensus.cc:705] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:56.125252 17540 consensus_queue.cc:229] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.127218 17540 ts_tablet_manager.cc:1081] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0401 16:41:56.129026 17538 tablet_bootstrap.cc:439] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154: No bootstrap required, opened a new log I0401 16:41:56.129227 17538 ts_tablet_manager.cc:1053] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent bootstrapping tablet: real 0.016s user 0.002s sys 0.006s I0401 16:41:56.129235 17544 raft_consensus.cc:494] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.130758 17540 tablet_bootstrap.cc:439] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d: Bootstrap starting. I0401 16:41:56.130074 17140 catalog_manager.cc:3977] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 reported cstate change: term changed from 0 to 1, leader changed from to fddd89494a344d12a1cd2756b2e57247 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "fddd89494a344d12a1cd2756b2e57247" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: HEALTHY } } } I0401 16:41:56.130074 17538 raft_consensus.cc:340] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.131151 17538 raft_consensus.cc:366] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.131297 17538 raft_consensus.cc:705] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Initialized, Role: FOLLOWER I0401 16:41:56.131620 17538 consensus_queue.cc:229] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.132433 17538 ts_tablet_manager.cc:1081] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0401 16:41:56.136029 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "94335152d3e84229bd5dc92dd1af2988" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" I0401 16:41:56.136250 17411 raft_consensus.cc:2886] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.136548 17540 tablet_bootstrap.cc:590] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d: No blocks or log segments found. Creating new log. I0401 16:41:56.138314 17411 raft_consensus.cc:2346] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 1. I0401 16:41:56.138667 17303 leader_election.cc:310] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:56.138952 17580 raft_consensus.cc:2640] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.140027 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "94335152d3e84229bd5dc92dd1af2988" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" I0401 16:41:56.141461 17580 raft_consensus.cc:667] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 LEADER]: Becoming Leader. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Running, Role: LEADER I0401 16:41:56.141587 17544 leader_election.cc:296] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 election: Requested vote from peers 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.141782 17482 raft_consensus.cc:2886] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.141901 17580 consensus_queue.cc:206] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.143879 17540 tablet_bootstrap.cc:439] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d: No bootstrap required, opened a new log I0401 16:41:56.144093 17540 ts_tablet_manager.cc:1053] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent bootstrapping tablet: real 0.014s user 0.003s sys 0.005s I0401 16:41:56.144421 17482 raft_consensus.cc:2346] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 1. I0401 16:41:56.145002 17540 raft_consensus.cc:340] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.145298 17540 raft_consensus.cc:366] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:41:56.145454 17540 raft_consensus.cc:705] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Initialized, Role: FOLLOWER I0401 16:41:56.145701 17540 consensus_queue.cc:229] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.146296 17540 ts_tablet_manager.cc:1081] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:41:56.146936 17140 catalog_manager.cc:3977] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 reported cstate change: term changed from 0 to 1, leader changed from to 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: UNKNOWN } } } I0401 16:41:56.161041 17580 raft_consensus.cc:472] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.161152 17580 raft_consensus.cc:494] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.161909 17580 leader_election.cc:296] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.162096 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "470984c7f7894fc4af997e17431ab35b" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" is_pre_election: true I0401 16:41:56.162117 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "470984c7f7894fc4af997e17431ab35b" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" is_pre_election: true I0401 16:41:56.162287 17482 raft_consensus.cc:2346] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 0. I0401 16:41:56.162281 17411 raft_consensus.cc:2346] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 0. I0401 16:41:56.162638 17302 leader_election.cc:310] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.162952 17580 raft_consensus.cc:2640] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.163081 17580 raft_consensus.cc:472] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.163216 17580 raft_consensus.cc:2886] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.165035 17580 raft_consensus.cc:494] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.165518 17580 leader_election.cc:296] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 election: Requested vote from peers 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.165818 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "470984c7f7894fc4af997e17431ab35b" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" I0401 16:41:56.165879 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "470984c7f7894fc4af997e17431ab35b" candidate_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" I0401 16:41:56.166007 17411 raft_consensus.cc:2886] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.166193 17482 raft_consensus.cc:2886] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.167675 17411 raft_consensus.cc:2346] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 1. I0401 16:41:56.167749 17482 raft_consensus.cc:2346] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6ef9f21c58f44f249dd738b3b7ed8154 in term 1. I0401 16:41:56.168112 17303 leader_election.cc:310] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:56.168397 17580 raft_consensus.cc:2640] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.168941 17580 raft_consensus.cc:667] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 LEADER]: Becoming Leader. State: Replica: 6ef9f21c58f44f249dd738b3b7ed8154, State: Running, Role: LEADER I0401 16:41:56.169281 17580 consensus_queue.cc:206] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.170109 17551 raft_consensus.cc:472] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.170413 17551 raft_consensus.cc:494] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.171103 17551 leader_election.cc:296] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.171617 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "cc9be6d6b120481fb19df463acdb154b" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" is_pre_election: true I0401 16:41:56.171814 17341 raft_consensus.cc:2346] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 0. I0401 16:41:56.172092 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "cc9be6d6b120481fb19df463acdb154b" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" is_pre_election: true I0401 16:41:56.172260 17374 leader_election.cc:310] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:56.172317 17482 raft_consensus.cc:2346] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 0. I0401 16:41:56.172564 17551 raft_consensus.cc:2640] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.172677 17551 raft_consensus.cc:472] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.172807 17551 raft_consensus.cc:2886] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.174712 17551 raft_consensus.cc:494] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.174712 17140 catalog_manager.cc:3977] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 reported cstate change: term changed from 0 to 1, leader changed from to 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: UNKNOWN } } } I0401 16:41:56.175401 17551 leader_election.cc:296] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.175642 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "cc9be6d6b120481fb19df463acdb154b" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" I0401 16:41:56.175886 17341 raft_consensus.cc:2886] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.175894 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "cc9be6d6b120481fb19df463acdb154b" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" I0401 16:41:56.176082 17482 raft_consensus.cc:2886] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.177945 17341 raft_consensus.cc:2346] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 1. I0401 16:41:56.178349 17374 leader_election.cc:310] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d; no voters: I0401 16:41:56.178644 17551 raft_consensus.cc:2640] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.178836 17551 raft_consensus.cc:667] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Becoming Leader. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Running, Role: LEADER I0401 16:41:56.179112 17551 consensus_queue.cc:206] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.179467 17482 raft_consensus.cc:2346] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 1. I0401 16:41:56.186579 17140 catalog_manager.cc:3977] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d reported cstate change: term changed from 0 to 1, leader changed from to 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2). New cstate: current_term: 1 leader_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: UNKNOWN } } } I0401 16:41:56.207551 17579 raft_consensus.cc:472] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.207690 17579 raft_consensus.cc:494] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.208415 17579 leader_election.cc:296] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:56.208806 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b4ebb6880f65472aa60108d6a84a711f" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" is_pre_election: true I0401 16:41:56.208868 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b4ebb6880f65472aa60108d6a84a711f" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" is_pre_election: true I0401 16:41:56.209125 17341 raft_consensus.cc:2346] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 0. I0401 16:41:56.209128 17411 raft_consensus.cc:2346] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 0. I0401 16:41:56.209549 17444 leader_election.cc:310] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8a8c7a6b3840239c7d98a3e8a8202d, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.209866 17579 raft_consensus.cc:2640] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.209996 17579 raft_consensus.cc:472] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.210139 17579 raft_consensus.cc:2886] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.211694 17579 raft_consensus.cc:494] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.212216 17579 leader_election.cc:296] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:56.212602 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b4ebb6880f65472aa60108d6a84a711f" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" I0401 16:41:56.212653 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "b4ebb6880f65472aa60108d6a84a711f" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" I0401 16:41:56.212803 17341 raft_consensus.cc:2886] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.212807 17411 raft_consensus.cc:2886] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.214541 17341 raft_consensus.cc:2346] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 1. I0401 16:41:56.214735 17411 raft_consensus.cc:2346] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fddd89494a344d12a1cd2756b2e57247 in term 1. I0401 16:41:56.215281 17444 leader_election.cc:310] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8a8c7a6b3840239c7d98a3e8a8202d, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.215867 17579 raft_consensus.cc:2640] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.216053 17579 raft_consensus.cc:667] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 1 LEADER]: Becoming Leader. State: Replica: fddd89494a344d12a1cd2756b2e57247, State: Running, Role: LEADER I0401 16:41:56.216339 17579 consensus_queue.cc:206] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.218629 17139 catalog_manager.cc:3977] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 reported cstate change: term changed from 0 to 1, leader changed from to fddd89494a344d12a1cd2756b2e57247 (127.11.224.3). New cstate: current_term: 1 leader_uuid: "fddd89494a344d12a1cd2756b2e57247" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: HEALTHY } } } I0401 16:41:56.235565 17551 raft_consensus.cc:472] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.235668 17551 raft_consensus.cc:494] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.236706 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8d3c98fd34794ba1bbdc75598989b855" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" is_pre_election: true I0401 16:41:56.236752 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8d3c98fd34794ba1bbdc75598989b855" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" is_pre_election: true I0401 16:41:56.236935 17341 raft_consensus.cc:2346] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 0. I0401 16:41:56.237099 17551 leader_election.cc:296] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.237108 17482 raft_consensus.cc:2346] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 0. I0401 16:41:56.237534 17373 leader_election.cc:310] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8a8c7a6b3840239c7d98a3e8a8202d, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.237915 17551 raft_consensus.cc:2640] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:41:56.238000 17551 raft_consensus.cc:472] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:56.238113 17551 raft_consensus.cc:2886] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.239729 17551 raft_consensus.cc:494] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.240227 17551 leader_election.cc:296] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Requested vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), fddd89494a344d12a1cd2756b2e57247 (127.11.224.3:39158) I0401 16:41:56.240553 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8d3c98fd34794ba1bbdc75598989b855" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" I0401 16:41:56.240780 17341 raft_consensus.cc:2886] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.240780 17482 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8d3c98fd34794ba1bbdc75598989b855" candidate_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fddd89494a344d12a1cd2756b2e57247" I0401 16:41:56.241147 17482 raft_consensus.cc:2886] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.243067 17341 raft_consensus.cc:2346] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 1. I0401 16:41:56.243067 17482 raft_consensus.cc:2346] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in term 1. I0401 16:41:56.243427 17373 leader_election.cc:310] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7b8a8c7a6b3840239c7d98a3e8a8202d, fddd89494a344d12a1cd2756b2e57247; no voters: I0401 16:41:56.243750 17551 raft_consensus.cc:2640] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:41:56.244087 17551 raft_consensus.cc:667] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Becoming Leader. State: Replica: 7b8a8c7a6b3840239c7d98a3e8a8202d, State: Running, Role: LEADER I0401 16:41:56.244478 17551 consensus_queue.cc:206] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.246727 17140 catalog_manager.cc:3977] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d reported cstate change: term changed from 0 to 1, leader changed from to 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2). New cstate: current_term: 1 leader_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } health_report { overall_health: UNKNOWN } } } I0401 16:41:56.319823 17296 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab: acquiring CA information for follower catalog manager: success I0401 16:41:56.321573 17296 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:56.323180 17579 raft_consensus.cc:472] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:56.323285 17579 raft_consensus.cc:494] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 } } peers { permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 } } peers { permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 } } I0401 16:41:56.323957 17579 leader_election.cc:296] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541), 7b8a8c7a6b3840239c7d98a3e8a8202d (127.11.224.2:44328) I0401 16:41:56.324383 17341 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d98e804572ea4ff5aaa26ed95fefd12a" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" is_pre_election: true I0401 16:41:56.324636 17341 raft_consensus.cc:2276] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate fddd89494a344d12a1cd2756b2e57247 in current term 1: Already voted for candidate 7b8a8c7a6b3840239c7d98a3e8a8202d in this term. I0401 16:41:56.325409 17411 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d98e804572ea4ff5aaa26ed95fefd12a" candidate_uuid: "fddd89494a344d12a1cd2756b2e57247" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" is_pre_election: true I0401 16:41:56.325654 17411 raft_consensus.cc:2307] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate fddd89494a344d12a1cd2756b2e57247 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:41:56.326040 17444 leader_election.cc:310] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: fddd89494a344d12a1cd2756b2e57247; no voters: 6ef9f21c58f44f249dd738b3b7ed8154, 7b8a8c7a6b3840239c7d98a3e8a8202d I0401 16:41:56.326498 17579 raft_consensus.cc:2886] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:41:56.327699 17299 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: acquiring CA information for follower catalog manager: success I0401 16:41:56.328424 17579 raft_consensus.cc:2588] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:41:56.329042 17299 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:41:56.406430 12160 master.cc:270] Master@127.11.224.62:36670 shutting down... I0401 16:41:56.418085 17125 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:41:56.418493 17124 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:41:56.419003 17124 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:41:56.420083 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:56.420343 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:56.420647 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P d7805c86420e4a78bd9449f7fe578dc7: stopping tablet replica I0401 16:41:56.427443 17341 raft_consensus.cc:1181] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Refusing update from remote peer 7b8a8c7a6b3840239c7d98a3e8a8202d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.427927 17551 consensus_queue.cc:984] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.429093 17125 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:41:56.430104 17124 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:41:56.431010 17124 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:41:56.432238 17482 raft_consensus.cc:1181] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Refusing update from remote peer 7b8a8c7a6b3840239c7d98a3e8a8202d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.432693 17551 consensus_queue.cc:984] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.434981 17124 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:41:56.435724 17125 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:41:56.451644 12160 master.cc:281] Master@127.11.224.62:36670 shutdown complete. I0401 16:41:56.478368 17482 raft_consensus.cc:1181] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Refusing update from remote peer 7b8a8c7a6b3840239c7d98a3e8a8202d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.478803 17551 consensus_queue.cc:984] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.484269 17341 raft_consensus.cc:1181] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Refusing update from remote peer 7b8a8c7a6b3840239c7d98a3e8a8202d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.485749 17552 consensus_queue.cc:984] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.539908 17482 raft_consensus.cc:1181] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Refusing update from remote peer 6ef9f21c58f44f249dd738b3b7ed8154: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.540356 17580 consensus_queue.cc:984] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.543860 17411 raft_consensus.cc:1181] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Refusing update from remote peer 6ef9f21c58f44f249dd738b3b7ed8154: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.544945 17586 consensus_queue.cc:984] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.545796 17411 raft_consensus.cc:1181] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Refusing update from remote peer fddd89494a344d12a1cd2756b2e57247: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.546185 17579 consensus_queue.cc:984] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.555778 17341 raft_consensus.cc:1181] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Refusing update from remote peer fddd89494a344d12a1cd2756b2e57247: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.556622 17542 consensus_queue.cc:984] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.589370 17482 raft_consensus.cc:1181] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Refusing update from remote peer 7b8a8c7a6b3840239c7d98a3e8a8202d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.589764 17552 consensus_queue.cc:984] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.595633 17341 raft_consensus.cc:1181] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Refusing update from remote peer 7b8a8c7a6b3840239c7d98a3e8a8202d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.596745 17552 consensus_queue.cc:984] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.606292 17410 raft_consensus.cc:1181] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Refusing update from remote peer fddd89494a344d12a1cd2756b2e57247: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.606669 17579 consensus_queue.cc:984] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.613274 17341 raft_consensus.cc:1181] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Refusing update from remote peer fddd89494a344d12a1cd2756b2e57247: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.613965 17542 consensus_queue.cc:984] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.625972 17341 raft_consensus.cc:1181] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Refusing update from remote peer fddd89494a344d12a1cd2756b2e57247: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.626402 17542 consensus_queue.cc:984] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.630105 17410 raft_consensus.cc:1181] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Refusing update from remote peer fddd89494a344d12a1cd2756b2e57247: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.630708 17579 consensus_queue.cc:984] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.704553 17482 raft_consensus.cc:1181] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Refusing update from remote peer 7b8a8c7a6b3840239c7d98a3e8a8202d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.705044 17552 consensus_queue.cc:984] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.709055 17341 raft_consensus.cc:1181] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Refusing update from remote peer 7b8a8c7a6b3840239c7d98a3e8a8202d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.709617 17547 consensus_queue.cc:984] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [LEADER]: Connected to new peer: Peer: permanent_uuid: "6ef9f21c58f44f249dd738b3b7ed8154" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 43541 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.733438 17410 raft_consensus.cc:1181] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Refusing update from remote peer 6ef9f21c58f44f249dd738b3b7ed8154: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.733819 17586 consensus_queue.cc:984] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.737794 17482 raft_consensus.cc:1181] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Refusing update from remote peer 6ef9f21c58f44f249dd738b3b7ed8154: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.738272 17586 consensus_queue.cc:984] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.754513 17482 raft_consensus.cc:1181] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Refusing update from remote peer 6ef9f21c58f44f249dd738b3b7ed8154: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.754894 17586 consensus_queue.cc:984] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fddd89494a344d12a1cd2756b2e57247" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 39158 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:56.758245 17410 raft_consensus.cc:1181] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Refusing update from remote peer 6ef9f21c58f44f249dd738b3b7ed8154: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:41:56.759111 17580 consensus_queue.cc:984] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7b8a8c7a6b3840239c7d98a3e8a8202d" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 44328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:41:57.752091 17641 raft_consensus.cc:472] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7805c86420e4a78bd9449f7fe578dc7) I0401 16:41:57.752221 17641 raft_consensus.cc:494] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:57.752876 17641 leader_election.cc:296] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670), 1e37da2047f04022872d01162bce6fab (127.11.224.60:53465) I0401 16:41:57.753137 17642 raft_consensus.cc:472] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d7805c86420e4a78bd9449f7fe578dc7) I0401 16:41:57.753211 17642 raft_consensus.cc:494] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:57.753777 17642 leader_election.cc:296] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670), 6493c51091c34650bb4ad4c001bfbed8 (127.11.224.61:49689) I0401 16:41:57.754300 17208 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e37da2047f04022872d01162bce6fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "6493c51091c34650bb4ad4c001bfbed8" is_pre_election: true I0401 16:41:57.754464 17208 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e37da2047f04022872d01162bce6fab in term 1. W0401 16:41:57.755087 17237 leader_election.cc:341] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670): Network error: Client connection negotiation failed: client connection to 127.11.224.62:36670: connect: Connection refused (error 111) I0401 16:41:57.755292 17236 leader_election.cc:310] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e37da2047f04022872d01162bce6fab, 6493c51091c34650bb4ad4c001bfbed8; no voters: d7805c86420e4a78bd9449f7fe578dc7 W0401 16:41:57.755373 17180 leader_election.cc:341] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670): Network error: Client connection negotiation failed: client connection to 127.11.224.62:36670: connect: Connection refused (error 111) I0401 16:41:57.755448 17265 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6493c51091c34650bb4ad4c001bfbed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "1e37da2047f04022872d01162bce6fab" is_pre_election: true I0401 16:41:57.755589 17265 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6493c51091c34650bb4ad4c001bfbed8 in term 1. I0401 16:41:57.755687 17642 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 1 FOLLOWER]: Leader pre-election won for term 2 I0401 16:41:57.755733 17642 raft_consensus.cc:472] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7805c86420e4a78bd9449f7fe578dc7) I0401 16:41:57.755805 17642 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 1 FOLLOWER]: Advancing to term 2 I0401 16:41:57.755975 17180 leader_election.cc:310] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e37da2047f04022872d01162bce6fab, 6493c51091c34650bb4ad4c001bfbed8; no voters: d7805c86420e4a78bd9449f7fe578dc7 I0401 16:41:57.756148 17641 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 1 FOLLOWER]: Leader pre-election won for term 2 I0401 16:41:57.756214 17641 raft_consensus.cc:472] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader d7805c86420e4a78bd9449f7fe578dc7) I0401 16:41:57.756289 17641 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 1 FOLLOWER]: Advancing to term 2 I0401 16:41:57.758615 17641 raft_consensus.cc:494] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:57.758615 17642 raft_consensus.cc:494] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:57.759469 17642 leader_election.cc:296] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [CANDIDATE]: Term 2 election: Requested vote from peers d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670), 6493c51091c34650bb4ad4c001bfbed8 (127.11.224.61:49689) I0401 16:41:57.759778 17208 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1e37da2047f04022872d01162bce6fab" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "6493c51091c34650bb4ad4c001bfbed8" I0401 16:41:57.759972 17208 raft_consensus.cc:2276] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e37da2047f04022872d01162bce6fab in current term 2: Already voted for candidate 6493c51091c34650bb4ad4c001bfbed8 in this term. W0401 16:41:57.760166 17237 leader_election.cc:341] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670): Network error: Client connection negotiation failed: client connection to 127.11.224.62:36670: connect: Connection refused (error 111) I0401 16:41:57.760259 17641 leader_election.cc:296] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 2 election: Requested vote from peers d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670), 1e37da2047f04022872d01162bce6fab (127.11.224.60:53465) I0401 16:41:57.760464 17236 leader_election.cc:310] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e37da2047f04022872d01162bce6fab; no voters: 6493c51091c34650bb4ad4c001bfbed8, d7805c86420e4a78bd9449f7fe578dc7 W0401 16:41:57.760733 17180 leader_election.cc:341] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670): Network error: Client connection negotiation failed: client connection to 127.11.224.62:36670: connect: Connection refused (error 111) I0401 16:41:57.760823 17265 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6493c51091c34650bb4ad4c001bfbed8" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "1e37da2047f04022872d01162bce6fab" I0401 16:41:57.760877 17642 raft_consensus.cc:2588] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority I0401 16:41:57.760998 17265 raft_consensus.cc:2276] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6493c51091c34650bb4ad4c001bfbed8 in current term 2: Already voted for candidate 1e37da2047f04022872d01162bce6fab in this term. I0401 16:41:57.761390 17180 leader_election.cc:310] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6493c51091c34650bb4ad4c001bfbed8; no voters: 1e37da2047f04022872d01162bce6fab, d7805c86420e4a78bd9449f7fe578dc7 I0401 16:41:57.761615 17641 raft_consensus.cc:2588] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority I0401 16:41:59.793442 17645 raft_consensus.cc:472] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:41:59.793535 17645 raft_consensus.cc:494] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:59.794066 17645 leader_election.cc:296] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670), 1e37da2047f04022872d01162bce6fab (127.11.224.60:53465) W0401 16:41:59.794849 17180 leader_election.cc:341] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670): Network error: Client connection negotiation failed: client connection to 127.11.224.62:36670: connect: Connection refused (error 111) I0401 16:41:59.794836 17265 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6493c51091c34650bb4ad4c001bfbed8" candidate_term: 3 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "1e37da2047f04022872d01162bce6fab" is_pre_election: true I0401 16:41:59.794972 17265 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6493c51091c34650bb4ad4c001bfbed8 in term 2. I0401 16:41:59.795267 17180 leader_election.cc:310] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e37da2047f04022872d01162bce6fab, 6493c51091c34650bb4ad4c001bfbed8; no voters: d7805c86420e4a78bd9449f7fe578dc7 I0401 16:41:59.795491 17645 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 2 FOLLOWER]: Leader pre-election won for term 3 I0401 16:41:59.795541 17645 raft_consensus.cc:472] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:41:59.795609 17645 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 2 FOLLOWER]: Advancing to term 3 I0401 16:41:59.797525 17645 raft_consensus.cc:494] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:59.798084 17645 leader_election.cc:296] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 3 election: Requested vote from peers d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670), 1e37da2047f04022872d01162bce6fab (127.11.224.60:53465) I0401 16:41:59.798547 17265 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6493c51091c34650bb4ad4c001bfbed8" candidate_term: 3 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "1e37da2047f04022872d01162bce6fab" I0401 16:41:59.798712 17265 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 2 FOLLOWER]: Advancing to term 3 W0401 16:41:59.799166 17180 leader_election.cc:341] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer d7805c86420e4a78bd9449f7fe578dc7 (127.11.224.62:36670): Network error: Client connection negotiation failed: client connection to 127.11.224.62:36670: connect: Connection refused (error 111) I0401 16:41:59.800097 17265 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6493c51091c34650bb4ad4c001bfbed8 in term 3. I0401 16:41:59.800354 17180 leader_election.cc:310] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e37da2047f04022872d01162bce6fab, 6493c51091c34650bb4ad4c001bfbed8; no voters: d7805c86420e4a78bd9449f7fe578dc7 I0401 16:41:59.800525 17645 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 3 FOLLOWER]: Leader election won for term 3 I0401 16:41:59.800786 17645 raft_consensus.cc:667] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 3 LEADER]: Becoming Leader. State: Replica: 6493c51091c34650bb4ad4c001bfbed8, State: Running, Role: LEADER I0401 16:41:59.800981 17645 consensus_queue.cc:206] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } I0401 16:41:59.802497 17647 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6493c51091c34650bb4ad4c001bfbed8. Latest consensus state: current_term: 3 leader_uuid: "6493c51091c34650bb4ad4c001bfbed8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d7805c86420e4a78bd9449f7fe578dc7" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 36670 } } peers { permanent_uuid: "6493c51091c34650bb4ad4c001bfbed8" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 49689 } } peers { permanent_uuid: "1e37da2047f04022872d01162bce6fab" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 53465 } } } I0401 16:41:59.802848 17647 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [sys.catalog]: This master's current role is: LEADER I0401 16:41:59.803243 17649 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:41:59.805092 17649 catalog_manager.cc:354] Loaded metadata for table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904] I0401 16:41:59.806325 17649 catalog_manager.cc:408] Loaded metadata for tablet 27493696fabc490ea8fdd9dcae6b18c1 (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.806622 17649 catalog_manager.cc:408] Loaded metadata for tablet 38c212dc9ad74daf9483c8a684ed5e88 (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.806828 17649 catalog_manager.cc:408] Loaded metadata for tablet 470984c7f7894fc4af997e17431ab35b (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.807031 17649 catalog_manager.cc:408] Loaded metadata for tablet 8d3c98fd34794ba1bbdc75598989b855 (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.807235 17649 catalog_manager.cc:408] Loaded metadata for tablet 94335152d3e84229bd5dc92dd1af2988 (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.807448 17649 catalog_manager.cc:408] Loaded metadata for tablet ab0ee02e1ff34496884c6b99fb4366f1 (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.807636 17649 catalog_manager.cc:408] Loaded metadata for tablet ab6de6d13ad245149610ecb56be02a4f (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.807844 17649 catalog_manager.cc:408] Loaded metadata for tablet b4ebb6880f65472aa60108d6a84a711f (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.808142 17649 catalog_manager.cc:408] Loaded metadata for tablet cc9be6d6b120481fb19df463acdb154b (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.808362 17649 catalog_manager.cc:408] Loaded metadata for tablet d98e804572ea4ff5aaa26ed95fefd12a (table ksck-test-table [id=5c8396c0c82944afbe20fca3d8337904]) I0401 16:41:59.808495 17649 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:41:59.810689 17649 catalog_manager.cc:1075] Loading token signing keys... I0401 16:41:59.811671 17649 catalog_manager.cc:4292] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: Loaded TSK: 0 I0401 16:41:59.827528 17365 heartbeater.cc:467] Master 127.11.224.61:49689 was elected leader, sending a full tablet report... I0401 16:41:59.831337 17506 heartbeater.cc:467] Master 127.11.224.61:49689 was elected leader, sending a full tablet report... I0401 16:41:59.831398 17436 heartbeater.cc:467] Master 127.11.224.61:49689 was elected leader, sending a full tablet report... I0401 16:41:59.864526 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:59.883208 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:59.883324 12160 tablet_replica.cc:264] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.883468 12160 raft_consensus.cc:2143] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.883582 12160 raft_consensus.cc:2170] T 8d3c98fd34794ba1bbdc75598989b855 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.884161 12160 tablet_replica.cc:264] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.884258 12160 raft_consensus.cc:2143] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.884337 12160 raft_consensus.cc:2170] T b4ebb6880f65472aa60108d6a84a711f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.884690 12160 tablet_replica.cc:264] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.884780 12160 raft_consensus.cc:2143] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.884860 12160 raft_consensus.cc:2170] T cc9be6d6b120481fb19df463acdb154b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.885222 12160 tablet_replica.cc:264] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.885314 12160 raft_consensus.cc:2143] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.885494 12160 raft_consensus.cc:2170] T 470984c7f7894fc4af997e17431ab35b P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.885866 12160 tablet_replica.cc:264] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.885970 12160 raft_consensus.cc:2143] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.886049 12160 raft_consensus.cc:2170] T ab6de6d13ad245149610ecb56be02a4f P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.886435 12160 tablet_replica.cc:264] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.886519 12160 raft_consensus.cc:2143] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.886596 12160 raft_consensus.cc:2170] T d98e804572ea4ff5aaa26ed95fefd12a P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.887004 12160 tablet_replica.cc:264] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.887090 12160 raft_consensus.cc:2143] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.887167 12160 raft_consensus.cc:2170] T 27493696fabc490ea8fdd9dcae6b18c1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.887553 12160 tablet_replica.cc:264] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.887639 12160 raft_consensus.cc:2143] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.887799 12160 raft_consensus.cc:2170] T 38c212dc9ad74daf9483c8a684ed5e88 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.888177 12160 tablet_replica.cc:264] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.888262 12160 raft_consensus.cc:2143] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.888411 12160 raft_consensus.cc:2170] T 94335152d3e84229bd5dc92dd1af2988 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.888777 12160 tablet_replica.cc:264] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154: stopping tablet replica I0401 16:41:59.888867 12160 raft_consensus.cc:2143] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.888964 12160 raft_consensus.cc:2170] T ab0ee02e1ff34496884c6b99fb4366f1 P 6ef9f21c58f44f249dd738b3b7ed8154 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.906776 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:59.906836 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:59.907009 12160 tablet_server.cc:179] TabletServer shutdown complete. W0401 16:41:59.923390 17374 consensus_peers.cc:457] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d -> Peer 6ef9f21c58f44f249dd738b3b7ed8154 (127.11.224.1:43541): Couldn't send request to peer 6ef9f21c58f44f249dd738b3b7ed8154. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:43541: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:41:59.929841 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:59.944526 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:59.944617 12160 tablet_replica.cc:264] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.944758 12160 raft_consensus.cc:2143] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.944988 12160 raft_consensus.cc:2170] T cc9be6d6b120481fb19df463acdb154b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.945555 12160 tablet_replica.cc:264] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.945662 12160 raft_consensus.cc:2143] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.946046 12160 raft_consensus.cc:2170] T b4ebb6880f65472aa60108d6a84a711f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.946650 12160 tablet_replica.cc:264] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.946918 12160 raft_consensus.cc:2143] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.947080 12160 raft_consensus.cc:2170] T 8d3c98fd34794ba1bbdc75598989b855 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.947597 12160 tablet_replica.cc:264] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.947686 12160 raft_consensus.cc:2143] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.947762 12160 raft_consensus.cc:2170] T 470984c7f7894fc4af997e17431ab35b P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.948143 12160 tablet_replica.cc:264] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.948232 12160 raft_consensus.cc:2143] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.948307 12160 raft_consensus.cc:2170] T ab6de6d13ad245149610ecb56be02a4f P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.948650 12160 tablet_replica.cc:264] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.948734 12160 raft_consensus.cc:2143] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.948910 12160 raft_consensus.cc:2170] T d98e804572ea4ff5aaa26ed95fefd12a P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.949381 12160 tablet_replica.cc:264] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.949514 12160 raft_consensus.cc:2143] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.949626 12160 raft_consensus.cc:2170] T 38c212dc9ad74daf9483c8a684ed5e88 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.950176 12160 tablet_replica.cc:264] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.950263 12160 raft_consensus.cc:2143] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.950337 12160 raft_consensus.cc:2170] T ab0ee02e1ff34496884c6b99fb4366f1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.950685 12160 tablet_replica.cc:264] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.950767 12160 raft_consensus.cc:2143] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.950861 12160 raft_consensus.cc:2170] T 94335152d3e84229bd5dc92dd1af2988 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.951213 12160 tablet_replica.cc:264] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d: stopping tablet replica I0401 16:41:59.951301 12160 raft_consensus.cc:2143] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.951458 12160 raft_consensus.cc:2170] T 27493696fabc490ea8fdd9dcae6b18c1 P 7b8a8c7a6b3840239c7d98a3e8a8202d [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.958380 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:59.958464 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:59.958624 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:59.962221 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:59.975107 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:41:59.975198 12160 tablet_replica.cc:264] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.975316 12160 raft_consensus.cc:2143] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.975414 12160 raft_consensus.cc:2170] T d98e804572ea4ff5aaa26ed95fefd12a P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.975950 12160 tablet_replica.cc:264] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.976029 12160 raft_consensus.cc:2143] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.976191 12160 raft_consensus.cc:2170] T ab6de6d13ad245149610ecb56be02a4f P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.976533 12160 tablet_replica.cc:264] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.976606 12160 raft_consensus.cc:2143] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.976671 12160 raft_consensus.cc:2170] T cc9be6d6b120481fb19df463acdb154b P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.977035 12160 tablet_replica.cc:264] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.977110 12160 raft_consensus.cc:2143] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.977174 12160 raft_consensus.cc:2170] T 8d3c98fd34794ba1bbdc75598989b855 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.977502 12160 tablet_replica.cc:264] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.977577 12160 raft_consensus.cc:2143] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.977641 12160 raft_consensus.cc:2170] T 94335152d3e84229bd5dc92dd1af2988 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.977999 12160 tablet_replica.cc:264] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.978071 12160 raft_consensus.cc:2143] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.978206 12160 raft_consensus.cc:2170] T ab0ee02e1ff34496884c6b99fb4366f1 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.978533 12160 tablet_replica.cc:264] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.978606 12160 raft_consensus.cc:2143] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.978670 12160 raft_consensus.cc:2170] T 38c212dc9ad74daf9483c8a684ed5e88 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.979028 12160 tablet_replica.cc:264] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.979099 12160 raft_consensus.cc:2143] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.979163 12160 raft_consensus.cc:2170] T 27493696fabc490ea8fdd9dcae6b18c1 P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.979485 12160 tablet_replica.cc:264] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.979557 12160 raft_consensus.cc:2143] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:41:59.979621 12160 raft_consensus.cc:2170] T 470984c7f7894fc4af997e17431ab35b P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.979964 12160 tablet_replica.cc:264] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247: stopping tablet replica I0401 16:41:59.980031 12160 raft_consensus.cc:2143] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 1 LEADER]: Raft consensus shutting down. I0401 16:41:59.980165 12160 raft_consensus.cc:2170] T b4ebb6880f65472aa60108d6a84a711f P fddd89494a344d12a1cd2756b2e57247 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:41:59.996899 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:41:59.996955 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:41:59.997095 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:00.014575 12160 master.cc:270] Master@127.11.224.61:49689 shutting down... I0401 16:42:00.024585 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 3 LEADER]: Raft consensus shutting down. I0401 16:42:00.024808 12160 pending_rounds.cc:64] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: Trying to abort 1 pending transactions. I0401 16:42:00.024842 12160 pending_rounds.cc:70] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: Aborting transaction as it isn't in flight: id { term: 3 index: 16 } timestamp: 6365848042708008960 op_type: NO_OP noop_request { } I0401 16:42:00.024966 12160 raft_consensus.cc:2723] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 3 LEADER]: NO_OP replication failed: Aborted: Transaction aborted I0401 16:42:00.025032 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8 [term 3 FOLLOWER]: Raft consensus is shut down! I0401 16:42:00.025161 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 6493c51091c34650bb4ad4c001bfbed8: stopping tablet replica I0401 16:42:00.038844 12160 master.cc:281] Master@127.11.224.61:49689 shutdown complete. I0401 16:42:00.041844 12160 master.cc:270] Master@127.11.224.60:53465 shutting down... I0401 16:42:00.051712 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 3 FOLLOWER]: Raft consensus shutting down. I0401 16:42:00.051882 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab [term 3 FOLLOWER]: Raft consensus is shut down! I0401 16:42:00.051959 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 1e37da2047f04022872d01162bce6fab: stopping tablet replica I0401 16:42:00.065431 12160 master.cc:281] Master@127.11.224.60:53465 shutdown complete. [ OK ] RemoteKsckTest.TestLeaderMasterDown (4932 ms) [ RUN ] RemoteKsckTest.TestClusterWithLocation I0401 16:42:00.083273 12160 test_util.cc:212] Using random seed: -1860745404 I0401 16:42:00.083779 12160 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.11.224.62:37328,127.11.224.61:43829,127.11.224.60:39040 I0401 16:42:00.087071 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 850431us I0401 16:42:00.087211 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:00.087240 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:42:00.087304 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:42:00.087327 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:42:00.087738 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root/instance: uuid: "371b816bbc7f472d901ec12bd2fbc9f3" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.091863 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.001s I0401 16:42:00.092494 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:00.094298 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:42:00.094338 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root uuid: "371b816bbc7f472d901ec12bd2fbc9f3" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.094396 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:00.135051 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:37328 I0401 16:42:00.135710 12160 webserver.cc:308] Webserver started at http://127.11.224.62:57704/ using document root and password file I0401 16:42:00.136590 17713 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.138470 17713 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } has no permanent_uuid. Determining permanent_uuid... I0401 16:42:00.139513 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 850431us I0401 16:42:00.139710 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:00.139768 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:42:00.139880 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:42:00.139910 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:42:00.140362 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root/instance: uuid: "1afc84687f934a5a8055897bbf6c2a92" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.144333 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.000s sys 0.003s I0401 16:42:00.144383 17713 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } has no permanent_uuid. Determining permanent_uuid... W0401 16:42:00.145085 17713 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:43829: Network error: Client connection negotiation failed: client connection to 127.11.224.61:43829: connect: Connection refused (error 111) I0401 16:42:00.145340 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:00.147286 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0401 16:42:00.147327 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root uuid: "1afc84687f934a5a8055897bbf6c2a92" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.147392 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:00.182219 17713 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } attempt: 1 W0401 16:42:00.183023 17713 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.61:43829: Network error: Client connection negotiation failed: client connection to 127.11.224.61:43829: connect: Connection refused (error 111) I0401 16:42:00.186154 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:43829 I0401 16:42:00.186766 12160 webserver.cc:308] Webserver started at http://127.11.224.61:48003/ using document root and password file I0401 16:42:00.187726 17770 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.189617 17770 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } has no permanent_uuid. Determining permanent_uuid... I0401 16:42:00.190760 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 850431us I0401 16:42:00.190945 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:00.190976 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:42:00.191043 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:42:00.191076 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:42:00.191597 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root/instance: uuid: "65d85c8269a7417fa1b5f2304d9fd054" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.194609 17770 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } has no permanent_uuid. Determining permanent_uuid... I0401 16:42:00.196257 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.000s sys 0.002s I0401 16:42:00.197228 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:00.199746 17770 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } has no permanent_uuid. Determining permanent_uuid... I0401 16:42:00.199867 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:42:00.199908 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root uuid: "65d85c8269a7417fa1b5f2304d9fd054" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.199965 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0401 16:42:00.200474 17770 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:39040: Network error: Client connection negotiation failed: client connection to 127.11.224.60:39040: connect: Connection refused (error 111) I0401 16:42:00.219240 17713 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } attempt: 2 I0401 16:42:00.223861 17713 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } has no permanent_uuid. Determining permanent_uuid... W0401 16:42:00.224474 17713 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.11.224.60:39040: Network error: Client connection negotiation failed: client connection to 127.11.224.60:39040: connect: Connection refused (error 111) I0401 16:42:00.230857 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:39040 I0401 16:42:00.231510 12160 webserver.cc:308] Webserver started at http://127.11.224.60:51022/ using document root and password file I0401 16:42:00.231801 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0401 16:42:00.232398 17827 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.234308 17827 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } has no permanent_uuid. Determining permanent_uuid... I0401 16:42:00.238507 17827 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } has no permanent_uuid. Determining permanent_uuid... I0401 16:42:00.241817 17827 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } has no permanent_uuid. Determining permanent_uuid... I0401 16:42:00.247742 17827 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: Bootstrap starting. I0401 16:42:00.248919 17827 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: No blocks or log segments found. Creating new log. I0401 16:42:00.250545 17827 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: No bootstrap required, opened a new log I0401 16:42:00.251127 17827 raft_consensus.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.251273 17827 raft_consensus.cc:366] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.251328 17827 raft_consensus.cc:705] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d85c8269a7417fa1b5f2304d9fd054, State: Initialized, Role: FOLLOWER I0401 16:42:00.251477 17827 consensus_queue.cc:229] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.251986 17827 sys_catalog.cc:337] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.252123 17827 sys_catalog.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.252063 17831 sys_catalog.cc:337] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.252194 17831 sys_catalog.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.252537 17827 sys_catalog.cc:424] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: configured and running, proceeding with master startup. W0401 16:42:00.253821 17832 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:42:00.253866 17832 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:42:00.260681 17770 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } attempt: 1 I0401 16:42:00.266669 17770 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: Bootstrap starting. I0401 16:42:00.267746 17770 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: No blocks or log segments found. Creating new log. I0401 16:42:00.269179 17770 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: No bootstrap required, opened a new log I0401 16:42:00.269765 17770 raft_consensus.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.269928 17770 raft_consensus.cc:366] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.269959 17770 raft_consensus.cc:705] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1afc84687f934a5a8055897bbf6c2a92, State: Initialized, Role: FOLLOWER I0401 16:42:00.270140 17770 consensus_queue.cc:229] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.270537 17770 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.270673 17770 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.270591 17834 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.270764 17834 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.271096 17770 sys_catalog.cc:424] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: configured and running, proceeding with master startup. W0401 16:42:00.272353 17835 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:42:00.272397 17835 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:42:00.287659 17713 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } attempt: 1 I0401 16:42:00.293530 17713 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: Bootstrap starting. I0401 16:42:00.294674 17713 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: No blocks or log segments found. Creating new log. I0401 16:42:00.296262 17713 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: No bootstrap required, opened a new log I0401 16:42:00.296840 17713 raft_consensus.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.296984 17713 raft_consensus.cc:366] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.297036 17713 raft_consensus.cc:705] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b816bbc7f472d901ec12bd2fbc9f3, State: Initialized, Role: FOLLOWER I0401 16:42:00.297190 17713 consensus_queue.cc:229] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.297569 17713 sys_catalog.cc:337] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.297698 17713 sys_catalog.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.297662 17837 sys_catalog.cc:337] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.297793 17837 sys_catalog.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.298090 17713 sys_catalog.cc:424] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:42:00.298414 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 1 I0401 16:42:00.298470 12160 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 2 W0401 16:42:00.299729 17838 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0401 16:42:00.299803 17838 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0401 16:42:00.303236 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 850431us I0401 16:42:00.303380 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:00.303416 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:42:00.303488 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:42:00.303514 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:42:00.303944 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-0-root/instance: uuid: "6c95e30a87ab4955ba203d5c3c8e5772" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.307777 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s I0401 16:42:00.322589 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:00.324995 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:42:00.325049 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-0-root uuid: "6c95e30a87ab4955ba203d5c3c8e5772" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.325136 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:00.344228 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:42:00.344270 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:42:00.359648 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.1:33895 I0401 16:42:00.360424 12160 webserver.cc:308] Webserver started at http://127.11.224.1:34338/ using document root and password file I0401 16:42:00.373301 17903 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:00.373396 17903 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.373656 17903 heartbeater.cc:475] Master 127.11.224.60:39040 requested a full tablet report, sending... I0401 16:42:00.374760 17794 ts_manager.cc:159] Registered new tserver with Master: 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895) I0401 16:42:00.374961 17905 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:00.375030 17905 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.375213 17905 heartbeater.cc:475] Master 127.11.224.62:37328 requested a full tablet report, sending... I0401 16:42:00.375234 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 850431us I0401 16:42:00.375416 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:00.375444 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:42:00.375514 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:42:00.375540 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:42:00.375831 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:00.375921 17904 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.376085 17904 heartbeater.cc:475] Master 127.11.224.61:43829 requested a full tablet report, sending... I0401 16:42:00.376085 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-1-root/instance: uuid: "9fe51ce7e28a41b694019e780973d705" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.376309 17680 ts_manager.cc:159] Registered new tserver with Master: 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895) I0401 16:42:00.376961 17737 ts_manager.cc:159] Registered new tserver with Master: 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895) I0401 16:42:00.380527 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.003s I0401 16:42:00.381176 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:00.383589 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:42:00.383630 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-1-root uuid: "9fe51ce7e28a41b694019e780973d705" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.383692 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:00.402011 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:42:00.402053 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:42:00.419173 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.2:42268 I0401 16:42:00.420019 12160 webserver.cc:308] Webserver started at http://127.11.224.2:41269/ using document root and password file I0401 16:42:00.429000 17974 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:00.429136 17974 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.429374 17974 heartbeater.cc:475] Master 127.11.224.60:39040 requested a full tablet report, sending... I0401 16:42:00.430197 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:00.430259 17975 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.430387 17975 heartbeater.cc:475] Master 127.11.224.61:43829 requested a full tablet report, sending... I0401 16:42:00.430632 17794 ts_manager.cc:159] Registered new tserver with Master: 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.431176 17737 ts_manager.cc:159] Registered new tserver with Master: 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.432838 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 850431us I0401 16:42:00.433032 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:00.433073 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:42:00.433082 17976 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:00.433166 17976 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.433164 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:42:00.433271 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:42:00.433537 17976 heartbeater.cc:475] Master 127.11.224.62:37328 requested a full tablet report, sending... I0401 16:42:00.433816 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-2-root/instance: uuid: "e145fde928684f97872314204b7b48db" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.434307 17680 ts_manager.cc:159] Registered new tserver with Master: 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.438401 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s I0401 16:42:00.439118 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:00.442363 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0401 16:42:00.442412 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-2-root uuid: "e145fde928684f97872314204b7b48db" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:00.442484 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:00.458432 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:42:00.458477 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:42:00.474541 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.3:48514 I0401 16:42:00.477308 12160 webserver.cc:308] Webserver started at http://127.11.224.3:56808/ using document root and password file I0401 16:42:00.485275 18045 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:00.485350 18045 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.485535 18045 heartbeater.cc:475] Master 127.11.224.60:39040 requested a full tablet report, sending... I0401 16:42:00.486263 17794 ts_manager.cc:159] Registered new tserver with Master: e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.488160 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:00.488231 18046 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.488385 18046 heartbeater.cc:475] Master 127.11.224.61:43829 requested a full tablet report, sending... I0401 16:42:00.489243 17737 ts_manager.cc:159] Registered new tserver with Master: e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.490753 18048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:00.490819 18048 heartbeater.cc:426] Registering TS with master... I0401 16:42:00.491012 18048 heartbeater.cc:475] Master 127.11.224.62:37328 requested a full tablet report, sending... I0401 16:42:00.491696 17679 ts_manager.cc:159] Registered new tserver with Master: e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.492818 12160 internal_mini_cluster.cc:328] 3 TS(s) registered with all masters after 0.009553768s I0401 16:42:00.516046 17834 raft_consensus.cc:472] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.516153 17834 raft_consensus.cc:494] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.516818 17834 leader_election.cc:296] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 371b816bbc7f472d901ec12bd2fbc9f3 (127.11.224.62:37328), 65d85c8269a7417fa1b5f2304d9fd054 (127.11.224.60:39040) I0401 16:42:00.517169 17690 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1afc84687f934a5a8055897bbf6c2a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" is_pre_election: true I0401 16:42:00.517302 17690 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1afc84687f934a5a8055897bbf6c2a92 in term 0. I0401 16:42:00.517285 17804 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1afc84687f934a5a8055897bbf6c2a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d85c8269a7417fa1b5f2304d9fd054" is_pre_election: true I0401 16:42:00.517418 17804 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1afc84687f934a5a8055897bbf6c2a92 in term 0. I0401 16:42:00.517632 17720 leader_election.cc:310] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1afc84687f934a5a8055897bbf6c2a92, 371b816bbc7f472d901ec12bd2fbc9f3; no voters: I0401 16:42:00.517868 17834 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.517916 17834 raft_consensus.cc:472] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.517963 17834 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.519361 17834 raft_consensus.cc:494] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.519840 17834 leader_election.cc:296] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [CANDIDATE]: Term 1 election: Requested vote from peers 371b816bbc7f472d901ec12bd2fbc9f3 (127.11.224.62:37328), 65d85c8269a7417fa1b5f2304d9fd054 (127.11.224.60:39040) I0401 16:42:00.520108 17690 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1afc84687f934a5a8055897bbf6c2a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" I0401 16:42:00.520200 17690 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.520222 17804 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1afc84687f934a5a8055897bbf6c2a92" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "65d85c8269a7417fa1b5f2304d9fd054" I0401 16:42:00.520314 17804 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.521674 17690 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1afc84687f934a5a8055897bbf6c2a92 in term 1. I0401 16:42:00.521868 17804 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1afc84687f934a5a8055897bbf6c2a92 in term 1. I0401 16:42:00.522004 17720 leader_election.cc:310] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1afc84687f934a5a8055897bbf6c2a92, 371b816bbc7f472d901ec12bd2fbc9f3; no voters: I0401 16:42:00.522240 17834 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.522833 17834 raft_consensus.cc:667] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 LEADER]: Becoming Leader. State: Replica: 1afc84687f934a5a8055897bbf6c2a92, State: Running, Role: LEADER I0401 16:42:00.523047 17834 consensus_queue.cc:206] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:00.525737 18060 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1afc84687f934a5a8055897bbf6c2a92. Latest consensus state: current_term: 1 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.526373 18060 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: LEADER I0401 16:42:00.527062 18062 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:42:00.528432 18062 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:42:00.578078 17690 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Refusing update from remote peer 1afc84687f934a5a8055897bbf6c2a92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:42:00.578078 17804 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Refusing update from remote peer 1afc84687f934a5a8055897bbf6c2a92: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0401 16:42:00.578518 18060 consensus_queue.cc:984] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:42:00.578696 17834 consensus_queue.cc:984] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:42:00.582823 17837 sys_catalog.cc:337] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1afc84687f934a5a8055897bbf6c2a92. Latest consensus state: current_term: 1 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.583031 17837 sys_catalog.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.584628 17831 sys_catalog.cc:337] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1afc84687f934a5a8055897bbf6c2a92. Latest consensus state: current_term: 1 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.584777 17831 sys_catalog.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.586505 17834 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.586710 17834 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: LEADER I0401 16:42:00.587498 18062 catalog_manager.cc:950] Generated new certificate authority record I0401 16:42:00.588203 17831 sys_catalog.cc:337] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.588388 17831 sys_catalog.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.588408 18060 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.588582 18060 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: LEADER I0401 16:42:00.589040 17837 sys_catalog.cc:337] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:00.589226 17837 sys_catalog.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:00.589486 18062 catalog_manager.cc:1075] Loading token signing keys... I0401 16:42:00.605509 18062 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: Generated new TSK 0 I0401 16:42:00.615067 17735 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:56725 I0401 16:42:00.616895 17736 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:56722 I0401 16:42:00.618918 17737 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:56728 I0401 16:42:00.620388 17737 catalog_manager.cc:1416] Servicing CreateTable request from {username='jenkins'} at 127.11.224.61:56732: name: "ksck-test-table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\n\000\000\000\004\001\024\000\000\000\004\001\036\000\000\000\004\001(\000\000\000\004\0012\000\000\000\004\001<\000\000\000\004\001F\000\000\000\004\001P\000\000\000\004\001Z\000\000\000" } partition_schema { range_schema { columns { name: "key" } } } W0401 16:42:00.621187 17737 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table ksck-test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0401 16:42:00.626626 17975 heartbeater.cc:467] Master 127.11.224.61:43829 was elected leader, sending a full tablet report... I0401 16:42:00.629042 17904 heartbeater.cc:467] Master 127.11.224.61:43829 was elected leader, sending a full tablet report... I0401 16:42:00.630852 18046 heartbeater.cc:467] Master 127.11.224.61:43829 was elected leader, sending a full tablet report... I0401 16:42:00.655427 17941 tablet_service.cc:1006] Processing CreateTablet for tablet 660b85b59edb45bd84acef4a5db672b4 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:42:00.655465 17939 tablet_service.cc:1006] Processing CreateTablet for tablet e89daa9365924d10baee4f2be356fa73 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:42:00.655948 17939 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e89daa9365924d10baee4f2be356fa73. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.655982 17940 tablet_service.cc:1006] Processing CreateTablet for tablet 3ff724b280dc4b058bc22a20e5423eb6 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:42:00.656283 17940 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3ff724b280dc4b058bc22a20e5423eb6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.657338 17941 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 660b85b59edb45bd84acef4a5db672b4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.659374 17938 tablet_service.cc:1006] Processing CreateTablet for tablet 60d3d144b47f4cb3a77880b3c3ed26b6 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:42:00.660336 17870 tablet_service.cc:1006] Processing CreateTablet for tablet 660b85b59edb45bd84acef4a5db672b4 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:42:00.660629 17870 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 660b85b59edb45bd84acef4a5db672b4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.661949 17937 tablet_service.cc:1006] Processing CreateTablet for tablet 93119e4bbc1d4f6ba792c44cc4451934 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:42:00.662423 17936 tablet_service.cc:1006] Processing CreateTablet for tablet 04602a1066b94d2f84e90f2993ae9772 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:42:00.663130 17935 tablet_service.cc:1006] Processing CreateTablet for tablet d72e1acf78b3430e9a984932e6b2329b (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:42:00.664588 17934 tablet_service.cc:1006] Processing CreateTablet for tablet e292b104b2bf47ad809d9851ad79e549 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:42:00.664906 17934 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e292b104b2bf47ad809d9851ad79e549. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.664918 18077 tablet_bootstrap.cc:439] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.666376 17869 tablet_service.cc:1006] Processing CreateTablet for tablet 3ff724b280dc4b058bc22a20e5423eb6 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:42:00.666421 17868 tablet_service.cc:1006] Processing CreateTablet for tablet e89daa9365924d10baee4f2be356fa73 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:42:00.666745 17868 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e89daa9365924d10baee4f2be356fa73. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.666920 17869 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3ff724b280dc4b058bc22a20e5423eb6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.667366 17933 tablet_service.cc:1006] Processing CreateTablet for tablet 8a06eb2eca2a4b8b996ff80335b9432c (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:42:00.667711 17933 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8a06eb2eca2a4b8b996ff80335b9432c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.669090 17938 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 60d3d144b47f4cb3a77880b3c3ed26b6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.670011 17937 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 93119e4bbc1d4f6ba792c44cc4451934. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.670971 17936 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 04602a1066b94d2f84e90f2993ae9772. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.673516 17867 tablet_service.cc:1006] Processing CreateTablet for tablet 60d3d144b47f4cb3a77880b3c3ed26b6 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:42:00.673919 17867 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 60d3d144b47f4cb3a77880b3c3ed26b6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.674000 17935 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d72e1acf78b3430e9a984932e6b2329b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.677175 17939 tablet_service.cc:1006] Processing CreateTablet for tablet 6c38c7d058b3488696df48d169482458 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:42:00.678014 17939 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 6c38c7d058b3488696df48d169482458. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.681959 17866 tablet_service.cc:1006] Processing CreateTablet for tablet e292b104b2bf47ad809d9851ad79e549 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:42:00.681962 17865 tablet_service.cc:1006] Processing CreateTablet for tablet 6c38c7d058b3488696df48d169482458 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:42:00.682024 17864 tablet_service.cc:1006] Processing CreateTablet for tablet 8a06eb2eca2a4b8b996ff80335b9432c (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:42:00.682189 17867 tablet_service.cc:1006] Processing CreateTablet for tablet 04602a1066b94d2f84e90f2993ae9772 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:42:00.682369 17865 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 6c38c7d058b3488696df48d169482458. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.681962 17869 tablet_service.cc:1006] Processing CreateTablet for tablet 93119e4bbc1d4f6ba792c44cc4451934 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:42:00.682543 17864 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8a06eb2eca2a4b8b996ff80335b9432c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.682673 17869 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 93119e4bbc1d4f6ba792c44cc4451934. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.682924 17866 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e292b104b2bf47ad809d9851ad79e549. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.683099 17868 tablet_service.cc:1006] Processing CreateTablet for tablet d72e1acf78b3430e9a984932e6b2329b (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:42:00.683346 17868 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d72e1acf78b3430e9a984932e6b2329b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.688169 18077 tablet_bootstrap.cc:590] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.688222 17867 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 04602a1066b94d2f84e90f2993ae9772. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.690232 18078 tablet_bootstrap.cc:439] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.693682 18012 tablet_service.cc:1006] Processing CreateTablet for tablet 660b85b59edb45bd84acef4a5db672b4 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION VALUES < 10 I0401 16:42:00.693776 18011 tablet_service.cc:1006] Processing CreateTablet for tablet 3ff724b280dc4b058bc22a20e5423eb6 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 10 <= VALUES < 20 I0401 16:42:00.694026 18012 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 660b85b59edb45bd84acef4a5db672b4. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.694239 18011 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3ff724b280dc4b058bc22a20e5423eb6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.694473 18010 tablet_service.cc:1006] Processing CreateTablet for tablet e89daa9365924d10baee4f2be356fa73 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 20 <= VALUES < 30 I0401 16:42:00.694733 18010 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e89daa9365924d10baee4f2be356fa73. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.694754 18009 tablet_service.cc:1006] Processing CreateTablet for tablet 60d3d144b47f4cb3a77880b3c3ed26b6 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 30 <= VALUES < 40 I0401 16:42:00.695120 18009 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 60d3d144b47f4cb3a77880b3c3ed26b6. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.698108 18008 tablet_service.cc:1006] Processing CreateTablet for tablet 93119e4bbc1d4f6ba792c44cc4451934 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 40 <= VALUES < 50 I0401 16:42:00.698416 18008 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 93119e4bbc1d4f6ba792c44cc4451934. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.699195 18007 tablet_service.cc:1006] Processing CreateTablet for tablet 04602a1066b94d2f84e90f2993ae9772 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 50 <= VALUES < 60 I0401 16:42:00.699481 18007 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 04602a1066b94d2f84e90f2993ae9772. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.702456 18006 tablet_service.cc:1006] Processing CreateTablet for tablet d72e1acf78b3430e9a984932e6b2329b (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 60 <= VALUES < 70 I0401 16:42:00.702850 18006 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d72e1acf78b3430e9a984932e6b2329b. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.703341 18005 tablet_service.cc:1006] Processing CreateTablet for tablet e292b104b2bf47ad809d9851ad79e549 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 70 <= VALUES < 80 I0401 16:42:00.703699 18005 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e292b104b2bf47ad809d9851ad79e549. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.707126 18004 tablet_service.cc:1006] Processing CreateTablet for tablet 6c38c7d058b3488696df48d169482458 (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION 80 <= VALUES < 90 I0401 16:42:00.707413 18004 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 6c38c7d058b3488696df48d169482458. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.708241 18079 tablet_bootstrap.cc:439] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.710770 18079 tablet_bootstrap.cc:590] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.711099 18003 tablet_service.cc:1006] Processing CreateTablet for tablet 8a06eb2eca2a4b8b996ff80335b9432c (table=ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]), partition=RANGE (key) PARTITION VALUES >= 90 I0401 16:42:00.711397 18003 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8a06eb2eca2a4b8b996ff80335b9432c. 1 dirs total, 0 dirs full, 0 dirs failed I0401 16:42:00.719508 18078 tablet_bootstrap.cc:590] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.720517 18077 tablet_bootstrap.cc:439] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.720655 18077 ts_tablet_manager.cc:1053] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.056s user 0.002s sys 0.006s I0401 16:42:00.722278 18077 raft_consensus.cc:340] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.722764 18077 raft_consensus.cc:366] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.722841 18077 raft_consensus.cc:705] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.722956 18078 tablet_bootstrap.cc:439] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.723060 18078 ts_tablet_manager.cc:1053] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.033s user 0.003s sys 0.000s I0401 16:42:00.723026 18077 consensus_queue.cc:229] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.723214 18079 tablet_bootstrap.cc:439] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.723306 18079 ts_tablet_manager.cc:1053] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.015s user 0.002s sys 0.006s I0401 16:42:00.723697 18078 raft_consensus.cc:340] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.723980 18078 raft_consensus.cc:366] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.724010 18078 raft_consensus.cc:705] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.723917 18079 raft_consensus.cc:340] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.724313 18079 raft_consensus.cc:366] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.724344 18079 raft_consensus.cc:705] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.724154 18078 consensus_queue.cc:229] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.724535 18079 consensus_queue.cc:229] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.727973 18078 ts_tablet_manager.cc:1081] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.005s user 0.000s sys 0.002s I0401 16:42:00.728205 18078 tablet_bootstrap.cc:439] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.729524 18077 ts_tablet_manager.cc:1081] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.009s user 0.002s sys 0.001s I0401 16:42:00.729723 18077 tablet_bootstrap.cc:439] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.729832 18078 tablet_bootstrap.cc:590] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.733793 18077 tablet_bootstrap.cc:590] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.734643 18078 tablet_bootstrap.cc:439] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.734753 18078 ts_tablet_manager.cc:1053] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s I0401 16:42:00.735186 18079 ts_tablet_manager.cc:1081] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.012s user 0.001s sys 0.002s I0401 16:42:00.735399 18079 tablet_bootstrap.cc:439] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.735419 18078 raft_consensus.cc:340] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.735579 18078 raft_consensus.cc:366] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.735605 18078 raft_consensus.cc:705] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.735738 18078 consensus_queue.cc:229] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.736176 18078 ts_tablet_manager.cc:1081] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:42:00.736343 18078 tablet_bootstrap.cc:439] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.736716 18079 tablet_bootstrap.cc:590] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.738027 18078 tablet_bootstrap.cc:590] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.741371 18078 tablet_bootstrap.cc:439] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.741482 18078 ts_tablet_manager.cc:1053] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s I0401 16:42:00.742239 18078 raft_consensus.cc:340] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.742440 18078 raft_consensus.cc:366] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.742507 18078 raft_consensus.cc:705] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.742660 18079 tablet_bootstrap.cc:439] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.742787 18079 ts_tablet_manager.cc:1053] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.001s I0401 16:42:00.742787 18078 consensus_queue.cc:229] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.743842 18078 ts_tablet_manager.cc:1081] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s I0401 16:42:00.744122 18078 tablet_bootstrap.cc:439] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.744676 18083 raft_consensus.cc:472] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.744822 18079 raft_consensus.cc:340] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.745044 18079 raft_consensus.cc:366] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.745096 18079 raft_consensus.cc:705] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.744782 18083 raft_consensus.cc:494] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.745350 18079 consensus_queue.cc:229] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.745815 18083 leader_election.cc:296] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.747457 18078 tablet_bootstrap.cc:590] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.750480 18077 tablet_bootstrap.cc:439] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.750639 18077 ts_tablet_manager.cc:1053] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.006s I0401 16:42:00.752012 18079 ts_tablet_manager.cc:1081] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s I0401 16:42:00.752265 18079 tablet_bootstrap.cc:439] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.755247 18079 tablet_bootstrap.cc:590] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.756507 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3ff724b280dc4b058bc22a20e5423eb6" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" is_pre_election: true I0401 16:42:00.756693 18022 raft_consensus.cc:2346] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 0. I0401 16:42:00.757088 17913 leader_election.cc:310] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe51ce7e28a41b694019e780973d705, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:00.757336 18083 raft_consensus.cc:2640] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.757382 18083 raft_consensus.cc:472] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.757421 18083 raft_consensus.cc:2886] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.758102 18077 raft_consensus.cc:340] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.758270 18077 raft_consensus.cc:366] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.758306 18077 raft_consensus.cc:705] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.758651 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3ff724b280dc4b058bc22a20e5423eb6" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:00.758460 18077 consensus_queue.cc:229] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } W0401 16:42:00.759320 17912 leader_election.cc:348] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895): Illegal state: must be running to vote when last-logged opid is not known I0401 16:42:00.759299 18083 raft_consensus.cc:494] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.759891 18083 leader_election.cc:296] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 election: Requested vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.760231 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3ff724b280dc4b058bc22a20e5423eb6" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" I0401 16:42:00.760346 18022 raft_consensus.cc:2886] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.761080 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3ff724b280dc4b058bc22a20e5423eb6" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" W0401 16:42:00.761477 17912 leader_election.cc:348] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895): Illegal state: must be running to vote when last-logged opid is not known I0401 16:42:00.762475 18022 raft_consensus.cc:2346] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 1. I0401 16:42:00.762687 18078 tablet_bootstrap.cc:439] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.762786 17913 leader_election.cc:310] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9fe51ce7e28a41b694019e780973d705, e145fde928684f97872314204b7b48db; no voters: 6c95e30a87ab4955ba203d5c3c8e5772 I0401 16:42:00.762840 18078 ts_tablet_manager.cc:1053] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.019s user 0.001s sys 0.010s I0401 16:42:00.763031 18083 raft_consensus.cc:2640] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.763098 18083 raft_consensus.cc:667] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 1 LEADER]: Becoming Leader. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Running, Role: LEADER I0401 16:42:00.763273 18083 consensus_queue.cc:206] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.765110 18079 tablet_bootstrap.cc:439] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.765242 18079 ts_tablet_manager.cc:1053] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.013s user 0.002s sys 0.004s I0401 16:42:00.765300 18077 ts_tablet_manager.cc:1081] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.015s user 0.001s sys 0.001s I0401 16:42:00.766039 18077 tablet_bootstrap.cc:439] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.765341 18078 raft_consensus.cc:340] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.766448 18078 raft_consensus.cc:366] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.766513 18078 raft_consensus.cc:705] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.765982 18079 raft_consensus.cc:340] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.766702 18079 raft_consensus.cc:366] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.766764 18079 raft_consensus.cc:705] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.766775 18078 consensus_queue.cc:229] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.767763 18079 consensus_queue.cc:229] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.767998 18077 tablet_bootstrap.cc:590] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.770766 18079 ts_tablet_manager.cc:1081] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I0401 16:42:00.771522 18079 tablet_bootstrap.cc:439] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.773192 18079 tablet_bootstrap.cc:590] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.773872 18078 ts_tablet_manager.cc:1081] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.010s user 0.001s sys 0.000s I0401 16:42:00.774092 18078 tablet_bootstrap.cc:439] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.775565 18078 tablet_bootstrap.cc:590] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.776273 18077 tablet_bootstrap.cc:439] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.776404 18077 ts_tablet_manager.cc:1053] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s I0401 16:42:00.777029 18077 raft_consensus.cc:340] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.777218 18077 raft_consensus.cc:366] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.777278 18077 raft_consensus.cc:705] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.777446 18077 consensus_queue.cc:229] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.777945 18077 ts_tablet_manager.cc:1081] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:42:00.778144 18077 tablet_bootstrap.cc:439] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.779875 17735 catalog_manager.cc:3977] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 reported cstate change: term changed from 0 to 1, leader changed from to 9fe51ce7e28a41b694019e780973d705 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "9fe51ce7e28a41b694019e780973d705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: UNKNOWN } } } I0401 16:42:00.780253 18077 tablet_bootstrap.cc:590] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.782479 18078 tablet_bootstrap.cc:439] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.782620 18078 ts_tablet_manager.cc:1053] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.002s I0401 16:42:00.783308 18078 raft_consensus.cc:340] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.783746 18078 raft_consensus.cc:366] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.783835 18078 raft_consensus.cc:705] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.784569 18086 raft_consensus.cc:472] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.784653 18086 raft_consensus.cc:494] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.785428 18086 leader_election.cc:296] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.785089 18078 consensus_queue.cc:229] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.792131 18078 ts_tablet_manager.cc:1081] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s I0401 16:42:00.792182 18079 tablet_bootstrap.cc:439] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.792448 18079 ts_tablet_manager.cc:1053] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.004s I0401 16:42:00.792608 18078 tablet_bootstrap.cc:439] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.793233 18079 raft_consensus.cc:340] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.793407 18079 raft_consensus.cc:366] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.793448 18079 raft_consensus.cc:705] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.793614 18079 consensus_queue.cc:229] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.794620 18078 tablet_bootstrap.cc:590] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.795449 18079 ts_tablet_manager.cc:1081] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0401 16:42:00.795666 18079 tablet_bootstrap.cc:439] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.797099 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e89daa9365924d10baee4f2be356fa73" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:00.797267 17951 raft_consensus.cc:2346] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 0. I0401 16:42:00.797662 17986 leader_election.cc:310] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe51ce7e28a41b694019e780973d705, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:00.798128 18086 raft_consensus.cc:2640] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.798174 18086 raft_consensus.cc:472] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.798225 18086 raft_consensus.cc:2886] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.799271 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e89daa9365924d10baee4f2be356fa73" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:00.799492 17880 raft_consensus.cc:2346] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 0. I0401 16:42:00.800070 18079 tablet_bootstrap.cc:590] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.800184 18077 tablet_bootstrap.cc:439] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.800276 18077 ts_tablet_manager.cc:1053] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.022s user 0.002s sys 0.005s I0401 16:42:00.800544 18086 raft_consensus.cc:494] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.800822 18077 raft_consensus.cc:340] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.801168 18086 leader_election.cc:296] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Requested vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.801335 18077 raft_consensus.cc:366] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.801378 18077 raft_consensus.cc:705] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.801528 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e89daa9365924d10baee4f2be356fa73" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" I0401 16:42:00.801645 17880 raft_consensus.cc:2886] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.801537 18077 consensus_queue.cc:229] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.802384 18077 ts_tablet_manager.cc:1081] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:42:00.802590 18077 tablet_bootstrap.cc:439] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.801602 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e89daa9365924d10baee4f2be356fa73" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" I0401 16:42:00.803314 17951 raft_consensus.cc:2886] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.803679 17880 raft_consensus.cc:2346] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 1. I0401 16:42:00.803993 17983 leader_election.cc:310] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:00.805171 17951 raft_consensus.cc:2346] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 1. I0401 16:42:00.805871 18086 raft_consensus.cc:2640] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.806231 18086 raft_consensus.cc:667] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Becoming Leader. State: Replica: e145fde928684f97872314204b7b48db, State: Running, Role: LEADER I0401 16:42:00.806468 18086 consensus_queue.cc:206] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.805786 18077 tablet_bootstrap.cc:590] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.806933 18078 tablet_bootstrap.cc:439] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.807044 18078 ts_tablet_manager.cc:1053] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.007s I0401 16:42:00.807444 18079 tablet_bootstrap.cc:439] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.807530 18079 ts_tablet_manager.cc:1053] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s I0401 16:42:00.807649 18078 raft_consensus.cc:340] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.807945 18078 raft_consensus.cc:366] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.807996 18078 raft_consensus.cc:705] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.808277 18079 raft_consensus.cc:340] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.808387 18079 raft_consensus.cc:366] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.808421 18079 raft_consensus.cc:705] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.808537 18079 consensus_queue.cc:229] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.809020 18078 consensus_queue.cc:229] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.809267 18079 ts_tablet_manager.cc:1081] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0401 16:42:00.809382 18084 raft_consensus.cc:472] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.809473 18079 tablet_bootstrap.cc:439] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.809463 18084 raft_consensus.cc:494] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.810765 18079 tablet_bootstrap.cc:590] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.811091 18084 leader_election.cc:296] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.811818 18078 ts_tablet_manager.cc:1081] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I0401 16:42:00.812078 18078 tablet_bootstrap.cc:439] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.815179 18078 tablet_bootstrap.cc:590] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.816825 17736 catalog_manager.cc:3977] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db reported cstate change: term changed from 0 to 1, leader changed from to e145fde928684f97872314204b7b48db (127.11.224.3). New cstate: current_term: 1 leader_uuid: "e145fde928684f97872314204b7b48db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: HEALTHY } } } I0401 16:42:00.821769 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3ff724b280dc4b058bc22a20e5423eb6" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:00.822039 17951 raft_consensus.cc:2307] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 6c95e30a87ab4955ba203d5c3c8e5772 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:42:00.822803 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "3ff724b280dc4b058bc22a20e5423eb6" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" is_pre_election: true I0401 16:42:00.822991 18022 raft_consensus.cc:2276] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6c95e30a87ab4955ba203d5c3c8e5772 in current term 1: Already voted for candidate 9fe51ce7e28a41b694019e780973d705 in this term. I0401 16:42:00.823632 17842 leader_election.cc:310] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772; no voters: 9fe51ce7e28a41b694019e780973d705, e145fde928684f97872314204b7b48db I0401 16:42:00.824246 18078 tablet_bootstrap.cc:439] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.824396 18078 ts_tablet_manager.cc:1053] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.012s user 0.002s sys 0.000s I0401 16:42:00.825104 18077 tablet_bootstrap.cc:439] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.825268 18077 ts_tablet_manager.cc:1053] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.006s I0401 16:42:00.825340 18078 raft_consensus.cc:340] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.825522 18078 raft_consensus.cc:366] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.825556 18078 raft_consensus.cc:705] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.825701 18078 consensus_queue.cc:229] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.825994 18084 raft_consensus.cc:2886] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.825901 18077 raft_consensus.cc:340] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.826063 18077 raft_consensus.cc:366] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.826098 18077 raft_consensus.cc:705] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.826225 18077 consensus_queue.cc:229] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.826586 18078 ts_tablet_manager.cc:1081] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:42:00.826684 18077 ts_tablet_manager.cc:1081] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:42:00.826792 18078 tablet_bootstrap.cc:439] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.826889 18077 tablet_bootstrap.cc:439] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.830055 18078 tablet_bootstrap.cc:590] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.832500 18077 tablet_bootstrap.cc:590] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.833377 18084 raft_consensus.cc:2588] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:42:00.833950 18079 tablet_bootstrap.cc:439] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.833951 18078 tablet_bootstrap.cc:439] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.834071 18079 ts_tablet_manager.cc:1053] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.025s user 0.002s sys 0.001s I0401 16:42:00.834102 18078 ts_tablet_manager.cc:1053] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s I0401 16:42:00.834434 18077 tablet_bootstrap.cc:439] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.834537 18077 ts_tablet_manager.cc:1053] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.001s I0401 16:42:00.834658 18078 raft_consensus.cc:340] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.834777 18078 raft_consensus.cc:366] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.834807 18078 raft_consensus.cc:705] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.834708 18079 raft_consensus.cc:340] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.834895 18079 raft_consensus.cc:366] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.834928 18079 raft_consensus.cc:705] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.834962 18078 consensus_queue.cc:229] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.835134 18077 raft_consensus.cc:340] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.835314 18077 raft_consensus.cc:366] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.835371 18077 raft_consensus.cc:705] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.835445 18078 ts_tablet_manager.cc:1081] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0401 16:42:00.835669 18078 tablet_bootstrap.cc:439] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.835095 18079 consensus_queue.cc:229] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.835698 18077 consensus_queue.cc:229] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.837056 18078 tablet_bootstrap.cc:590] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.837908 18077 ts_tablet_manager.cc:1081] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0401 16:42:00.840409 18077 tablet_bootstrap.cc:439] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.840937 18079 ts_tablet_manager.cc:1081] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s I0401 16:42:00.841173 18079 tablet_bootstrap.cc:439] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.842738 18079 tablet_bootstrap.cc:590] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.843163 18077 tablet_bootstrap.cc:590] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.843461 18086 raft_consensus.cc:472] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.843521 18078 tablet_bootstrap.cc:439] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.843627 18078 ts_tablet_manager.cc:1053] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.002s I0401 16:42:00.843562 18086 raft_consensus.cc:494] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.844321 18086 leader_election.cc:296] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.844710 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "93119e4bbc1d4f6ba792c44cc4451934" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:00.844769 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "93119e4bbc1d4f6ba792c44cc4451934" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:00.844271 18078 raft_consensus.cc:340] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.845050 18078 raft_consensus.cc:366] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.845115 18078 raft_consensus.cc:705] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER W0401 16:42:00.845199 17986 leader_election.cc:348] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268): Illegal state: must be running to vote when last-logged opid is not known I0401 16:42:00.845365 18078 consensus_queue.cc:229] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.845706 17880 raft_consensus.cc:2346] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 0. I0401 16:42:00.845721 18077 tablet_bootstrap.cc:439] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.846032 17983 leader_election.cc:310] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: 9fe51ce7e28a41b694019e780973d705 I0401 16:42:00.846367 18086 raft_consensus.cc:2640] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.846411 18086 raft_consensus.cc:472] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.846143 18077 ts_tablet_manager.cc:1053] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.002s I0401 16:42:00.846463 18086 raft_consensus.cc:2886] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.847647 18079 tablet_bootstrap.cc:439] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.848031 18079 ts_tablet_manager.cc:1053] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.001s I0401 16:42:00.848137 18078 ts_tablet_manager.cc:1081] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:42:00.848673 18086 raft_consensus.cc:494] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.848989 18078 tablet_bootstrap.cc:439] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772: Bootstrap starting. I0401 16:42:00.849423 18086 leader_election.cc:296] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Requested vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.849714 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "93119e4bbc1d4f6ba792c44cc4451934" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" I0401 16:42:00.849766 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "93119e4bbc1d4f6ba792c44cc4451934" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" I0401 16:42:00.849761 18079 raft_consensus.cc:340] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.849869 17880 raft_consensus.cc:2886] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.849900 18079 raft_consensus.cc:366] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.849921 18079 raft_consensus.cc:705] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER W0401 16:42:00.850263 17986 leader_election.cc:348] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268): Illegal state: must be running to vote when last-logged opid is not known I0401 16:42:00.850489 18077 raft_consensus.cc:340] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.850634 18077 raft_consensus.cc:366] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.850663 18077 raft_consensus.cc:705] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.850788 18077 consensus_queue.cc:229] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.850050 18079 consensus_queue.cc:229] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.852058 17880 raft_consensus.cc:2346] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 1. I0401 16:42:00.853688 17983 leader_election.cc:310] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: 9fe51ce7e28a41b694019e780973d705 I0401 16:42:00.854133 18086 raft_consensus.cc:2640] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.854218 18086 raft_consensus.cc:667] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Becoming Leader. State: Replica: e145fde928684f97872314204b7b48db, State: Running, Role: LEADER I0401 16:42:00.854290 18077 ts_tablet_manager.cc:1081] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.005s user 0.001s sys 0.000s I0401 16:42:00.854413 18086 consensus_queue.cc:206] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.854965 18077 tablet_bootstrap.cc:439] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.855599 18079 ts_tablet_manager.cc:1081] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.008s user 0.001s sys 0.000s I0401 16:42:00.855904 18079 tablet_bootstrap.cc:439] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.855967 18078 tablet_bootstrap.cc:590] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772: No blocks or log segments found. Creating new log. I0401 16:42:00.856658 18077 tablet_bootstrap.cc:590] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.859153 18079 tablet_bootstrap.cc:590] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.859639 17735 catalog_manager.cc:3977] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db reported cstate change: term changed from 0 to 1, leader changed from to e145fde928684f97872314204b7b48db (127.11.224.3). New cstate: current_term: 1 leader_uuid: "e145fde928684f97872314204b7b48db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: HEALTHY } } } I0401 16:42:00.867838 18078 tablet_bootstrap.cc:439] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772: No bootstrap required, opened a new log I0401 16:42:00.867982 18078 ts_tablet_manager.cc:1053] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent bootstrapping tablet: real 0.019s user 0.003s sys 0.004s I0401 16:42:00.868046 18079 tablet_bootstrap.cc:439] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.868234 18079 ts_tablet_manager.cc:1053] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.002s I0401 16:42:00.868810 18078 raft_consensus.cc:340] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.869062 18078 raft_consensus.cc:366] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.869144 18078 raft_consensus.cc:705] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Initialized, Role: FOLLOWER I0401 16:42:00.868985 18079 raft_consensus.cc:340] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.869345 18079 raft_consensus.cc:366] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.869482 18079 raft_consensus.cc:705] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.869402 18078 consensus_queue.cc:229] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.870110 18077 tablet_bootstrap.cc:439] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.870479 18077 ts_tablet_manager.cc:1053] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.016s user 0.003s sys 0.006s I0401 16:42:00.870568 18078 ts_tablet_manager.cc:1081] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772: Time spent starting tablet: real 0.002s user 0.001s sys 0.001s I0401 16:42:00.870577 18084 raft_consensus.cc:472] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.869935 18079 consensus_queue.cc:229] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.870774 18084 raft_consensus.cc:494] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.871573 18084 leader_election.cc:296] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.872210 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a06eb2eca2a4b8b996ff80335b9432c" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:00.872388 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a06eb2eca2a4b8b996ff80335b9432c" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" is_pre_election: true I0401 16:42:00.872448 17951 raft_consensus.cc:2346] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c95e30a87ab4955ba203d5c3c8e5772 in term 0. I0401 16:42:00.873497 17844 leader_election.cc:310] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, 9fe51ce7e28a41b694019e780973d705; no voters: I0401 16:42:00.873546 18100 raft_consensus.cc:472] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.873715 18100 raft_consensus.cc:494] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.874011 18084 raft_consensus.cc:2640] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.874136 18084 raft_consensus.cc:472] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.874260 18084 raft_consensus.cc:2886] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 W0401 16:42:00.874459 17842 leader_election.cc:348] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e145fde928684f97872314204b7b48db (127.11.224.3:48514): Illegal state: must be running to vote when last-logged opid is not known I0401 16:42:00.874526 18100 leader_election.cc:296] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268), 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895) I0401 16:42:00.874935 18077 raft_consensus.cc:340] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.875097 18077 raft_consensus.cc:366] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.875172 18077 raft_consensus.cc:705] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.875324 18077 consensus_queue.cc:229] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.876688 18084 raft_consensus.cc:494] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.877714 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "6c38c7d058b3488696df48d169482458" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:00.877952 17880 raft_consensus.cc:2346] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 0. I0401 16:42:00.877506 18079 ts_tablet_manager.cc:1081] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.009s user 0.001s sys 0.000s I0401 16:42:00.877956 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "6c38c7d058b3488696df48d169482458" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:00.878248 17983 leader_election.cc:310] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: W0401 16:42:00.878517 17986 leader_election.cc:348] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268): Illegal state: must be running to vote when last-logged opid is not known I0401 16:42:00.878581 18077 ts_tablet_manager.cc:1081] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.006s user 0.001s sys 0.001s I0401 16:42:00.878937 18077 tablet_bootstrap.cc:439] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.879355 18079 tablet_bootstrap.cc:439] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.879400 18084 leader_election.cc:296] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 election: Requested vote from peers 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.879691 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a06eb2eca2a4b8b996ff80335b9432c" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" I0401 16:42:00.879942 17951 raft_consensus.cc:2886] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.880887 18079 tablet_bootstrap.cc:590] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.880977 18077 tablet_bootstrap.cc:590] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.878929 18086 raft_consensus.cc:2640] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.881929 18086 raft_consensus.cc:472] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.882935 18086 raft_consensus.cc:2886] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.882935 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a06eb2eca2a4b8b996ff80335b9432c" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" I0401 16:42:00.883038 17951 raft_consensus.cc:2346] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c95e30a87ab4955ba203d5c3c8e5772 in term 1. W0401 16:42:00.883615 17842 leader_election.cc:348] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e145fde928684f97872314204b7b48db (127.11.224.3:48514): Illegal state: must be running to vote when last-logged opid is not known I0401 16:42:00.884685 17844 leader_election.cc:310] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, 9fe51ce7e28a41b694019e780973d705; no voters: e145fde928684f97872314204b7b48db I0401 16:42:00.885133 18084 raft_consensus.cc:2640] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.885314 18084 raft_consensus.cc:667] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 LEADER]: Becoming Leader. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Running, Role: LEADER I0401 16:42:00.885735 18084 consensus_queue.cc:206] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.887087 18079 tablet_bootstrap.cc:439] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.887323 18079 ts_tablet_manager.cc:1053] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.002s I0401 16:42:00.887612 18086 raft_consensus.cc:494] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.888643 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "6c38c7d058b3488696df48d169482458" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" I0401 16:42:00.889282 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "6c38c7d058b3488696df48d169482458" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" I0401 16:42:00.889348 18086 leader_election.cc:296] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Requested vote from peers 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268), 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895) I0401 16:42:00.889217 18079 raft_consensus.cc:340] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.889511 17880 raft_consensus.cc:2886] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.889668 18079 raft_consensus.cc:366] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely W0401 16:42:00.889674 17986 leader_election.cc:348] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268): Illegal state: must be running to vote when last-logged opid is not known I0401 16:42:00.889849 18079 raft_consensus.cc:705] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.890065 18079 consensus_queue.cc:229] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.891840 18079 ts_tablet_manager.cc:1081] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0401 16:42:00.891844 17880 raft_consensus.cc:2346] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 1. I0401 16:42:00.892272 17983 leader_election.cc:310] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: 9fe51ce7e28a41b694019e780973d705 I0401 16:42:00.892730 18079 tablet_bootstrap.cc:439] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db: Bootstrap starting. I0401 16:42:00.893458 18086 raft_consensus.cc:2640] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.895448 18086 raft_consensus.cc:667] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Becoming Leader. State: Replica: e145fde928684f97872314204b7b48db, State: Running, Role: LEADER I0401 16:42:00.895362 17735 catalog_manager.cc:3977] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 reported cstate change: term changed from 0 to 1, leader changed from to 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: UNKNOWN } } } I0401 16:42:00.895769 18086 consensus_queue.cc:206] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.897419 18083 raft_consensus.cc:472] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.897588 18083 raft_consensus.cc:494] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.898303 18083 leader_election.cc:296] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.898584 17736 catalog_manager.cc:3977] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db reported cstate change: term changed from 0 to 1, leader changed from to e145fde928684f97872314204b7b48db (127.11.224.3). New cstate: current_term: 1 leader_uuid: "e145fde928684f97872314204b7b48db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: HEALTHY } } } I0401 16:42:00.899082 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e292b104b2bf47ad809d9851ad79e549" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:00.899319 17880 raft_consensus.cc:2346] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 0. I0401 16:42:00.899641 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e292b104b2bf47ad809d9851ad79e549" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" is_pre_election: true I0401 16:42:00.899916 18077 tablet_bootstrap.cc:439] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.899915 18022 raft_consensus.cc:2346] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 0. I0401 16:42:00.900110 18077 ts_tablet_manager.cc:1053] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.021s user 0.000s sys 0.008s I0401 16:42:00.900641 17912 leader_election.cc:310] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, 9fe51ce7e28a41b694019e780973d705; no voters: I0401 16:42:00.901121 18077 raft_consensus.cc:340] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.901372 18077 raft_consensus.cc:366] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.901504 18077 raft_consensus.cc:705] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.901721 18077 consensus_queue.cc:229] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.902063 18083 raft_consensus.cc:2640] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.902247 18079 tablet_bootstrap.cc:590] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db: No blocks or log segments found. Creating new log. I0401 16:42:00.902253 18083 raft_consensus.cc:472] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.902314 18077 ts_tablet_manager.cc:1081] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0401 16:42:00.902407 18083 raft_consensus.cc:2886] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.902621 18077 tablet_bootstrap.cc:439] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705: Bootstrap starting. I0401 16:42:00.906313 18083 raft_consensus.cc:494] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.906898 18077 tablet_bootstrap.cc:590] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705: No blocks or log segments found. Creating new log. I0401 16:42:00.907167 18083 leader_election.cc:296] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 election: Requested vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:00.907840 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e292b104b2bf47ad809d9851ad79e549" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" I0401 16:42:00.907946 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "e292b104b2bf47ad809d9851ad79e549" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" I0401 16:42:00.908047 18022 raft_consensus.cc:2886] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.908161 17880 raft_consensus.cc:2886] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.910380 17880 raft_consensus.cc:2346] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 1. I0401 16:42:00.910832 17912 leader_election.cc:310] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, 9fe51ce7e28a41b694019e780973d705; no voters: I0401 16:42:00.911137 18083 raft_consensus.cc:2640] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.911355 18083 raft_consensus.cc:667] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 1 LEADER]: Becoming Leader. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Running, Role: LEADER I0401 16:42:00.911643 18083 consensus_queue.cc:206] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.910380 18022 raft_consensus.cc:2346] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 1. I0401 16:42:00.915454 17736 catalog_manager.cc:3977] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 reported cstate change: term changed from 0 to 1, leader changed from to 9fe51ce7e28a41b694019e780973d705 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "9fe51ce7e28a41b694019e780973d705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: UNKNOWN } } } I0401 16:42:00.923030 18077 tablet_bootstrap.cc:439] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705: No bootstrap required, opened a new log I0401 16:42:00.923218 18077 ts_tablet_manager.cc:1053] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705: Time spent bootstrapping tablet: real 0.021s user 0.001s sys 0.005s I0401 16:42:00.923586 18079 tablet_bootstrap.cc:439] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db: No bootstrap required, opened a new log I0401 16:42:00.923818 18079 ts_tablet_manager.cc:1053] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db: Time spent bootstrapping tablet: real 0.031s user 0.003s sys 0.012s I0401 16:42:00.923856 18086 raft_consensus.cc:472] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.924058 18086 raft_consensus.cc:494] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.924203 18077 raft_consensus.cc:340] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.924439 18077 raft_consensus.cc:366] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.924554 18077 raft_consensus.cc:705] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Initialized, Role: FOLLOWER I0401 16:42:00.924863 18086 leader_election.cc:296] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.924738 18079 raft_consensus.cc:340] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.925091 18079 raft_consensus.cc:366] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0401 16:42:00.925087 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d72e1acf78b3430e9a984932e6b2329b" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:00.925088 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d72e1acf78b3430e9a984932e6b2329b" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:00.925222 18079 raft_consensus.cc:705] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e145fde928684f97872314204b7b48db, State: Initialized, Role: FOLLOWER I0401 16:42:00.925334 17880 raft_consensus.cc:2346] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 0. I0401 16:42:00.925333 17951 raft_consensus.cc:2346] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 0. I0401 16:42:00.925740 18077 consensus_queue.cc:229] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.925926 17983 leader_election.cc:310] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:00.926483 18086 raft_consensus.cc:2640] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.925498 18079 consensus_queue.cc:229] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.926954 18086 raft_consensus.cc:472] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.927461 18086 raft_consensus.cc:2886] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.931229 18077 ts_tablet_manager.cc:1081] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s I0401 16:42:00.931393 18079 ts_tablet_manager.cc:1081] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db: Time spent starting tablet: real 0.006s user 0.002s sys 0.000s I0401 16:42:00.934253 18086 raft_consensus.cc:494] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.934846 18086 leader_election.cc:296] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Requested vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.935196 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d72e1acf78b3430e9a984932e6b2329b" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" I0401 16:42:00.935271 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "d72e1acf78b3430e9a984932e6b2329b" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" I0401 16:42:00.935364 17880 raft_consensus.cc:2886] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.935417 17951 raft_consensus.cc:2886] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.936841 17880 raft_consensus.cc:2346] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 1. I0401 16:42:00.936841 17951 raft_consensus.cc:2346] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 1. I0401 16:42:00.937197 17983 leader_election.cc:310] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:00.937467 18086 raft_consensus.cc:2640] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.937572 18086 raft_consensus.cc:667] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 1 LEADER]: Becoming Leader. State: Replica: e145fde928684f97872314204b7b48db, State: Running, Role: LEADER I0401 16:42:00.937794 18086 consensus_queue.cc:206] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.939837 17736 catalog_manager.cc:3977] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db reported cstate change: term changed from 0 to 1, leader changed from to e145fde928684f97872314204b7b48db (127.11.224.3). New cstate: current_term: 1 leader_uuid: "e145fde928684f97872314204b7b48db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: HEALTHY } } } I0401 16:42:00.972280 18086 raft_consensus.cc:472] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:00.972400 18086 raft_consensus.cc:494] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.973146 18086 leader_election.cc:296] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.973438 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "04602a1066b94d2f84e90f2993ae9772" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:00.973513 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "04602a1066b94d2f84e90f2993ae9772" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:00.973616 17880 raft_consensus.cc:2346] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 0. I0401 16:42:00.973709 17951 raft_consensus.cc:2346] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 0. I0401 16:42:00.974040 17983 leader_election.cc:310] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:00.974421 18086 raft_consensus.cc:2640] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:00.974509 18086 raft_consensus.cc:472] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:00.974633 18086 raft_consensus.cc:2886] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.976686 18086 raft_consensus.cc:494] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.978211 18086 leader_election.cc:296] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Requested vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:00.978341 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "04602a1066b94d2f84e90f2993ae9772" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" I0401 16:42:00.978492 17880 raft_consensus.cc:2886] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.978898 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "04602a1066b94d2f84e90f2993ae9772" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" I0401 16:42:00.979023 17951 raft_consensus.cc:2886] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:00.980028 17880 raft_consensus.cc:2346] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 1. I0401 16:42:00.980331 17983 leader_election.cc:310] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:00.980490 17951 raft_consensus.cc:2346] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e145fde928684f97872314204b7b48db in term 1. I0401 16:42:00.980595 18086 raft_consensus.cc:2640] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:00.980945 18086 raft_consensus.cc:667] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Becoming Leader. State: Replica: e145fde928684f97872314204b7b48db, State: Running, Role: LEADER I0401 16:42:00.981166 18086 consensus_queue.cc:206] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:00.983186 17737 catalog_manager.cc:3977] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db reported cstate change: term changed from 0 to 1, leader changed from to e145fde928684f97872314204b7b48db (127.11.224.3). New cstate: current_term: 1 leader_uuid: "e145fde928684f97872314204b7b48db" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: HEALTHY } } } I0401 16:42:01.052280 18084 raft_consensus.cc:472] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:01.052395 18084 raft_consensus.cc:494] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.053177 18084 leader_election.cc:296] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:01.053364 18083 raft_consensus.cc:472] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:01.053529 18083 raft_consensus.cc:494] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.053653 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "660b85b59edb45bd84acef4a5db672b4" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" is_pre_election: true I0401 16:42:01.053869 18022 raft_consensus.cc:2346] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c95e30a87ab4955ba203d5c3c8e5772 in term 0. I0401 16:42:01.054224 18083 leader_election.cc:296] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:01.054369 17842 leader_election.cc:310] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:01.054437 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "660b85b59edb45bd84acef4a5db672b4" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:01.054705 17951 raft_consensus.cc:2346] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c95e30a87ab4955ba203d5c3c8e5772 in term 0. I0401 16:42:01.054705 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "60d3d144b47f4cb3a77880b3c3ed26b6" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" is_pre_election: true I0401 16:42:01.054802 18084 raft_consensus.cc:2640] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:01.054949 18084 raft_consensus.cc:472] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:01.055006 18022 raft_consensus.cc:2346] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 0. I0401 16:42:01.055003 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "60d3d144b47f4cb3a77880b3c3ed26b6" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:01.055080 18084 raft_consensus.cc:2886] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.055233 17880 raft_consensus.cc:2346] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 0. I0401 16:42:01.055382 17913 leader_election.cc:310] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9fe51ce7e28a41b694019e780973d705, e145fde928684f97872314204b7b48db; no voters: I0401 16:42:01.055691 18083 raft_consensus.cc:2640] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0401 16:42:01.055840 18083 raft_consensus.cc:472] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:01.055987 18083 raft_consensus.cc:2886] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.057596 18084 raft_consensus.cc:494] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.057811 18083 raft_consensus.cc:494] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.058440 18083 leader_election.cc:296] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 election: Requested vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:01.058441 18084 leader_election.cc:296] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 election: Requested vote from peers 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:01.058779 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "60d3d144b47f4cb3a77880b3c3ed26b6" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" I0401 16:42:01.058832 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "660b85b59edb45bd84acef4a5db672b4" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" I0401 16:42:01.058854 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "60d3d144b47f4cb3a77880b3c3ed26b6" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" I0401 16:42:01.058962 17880 raft_consensus.cc:2886] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.059059 18022 raft_consensus.cc:2886] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.059059 17951 raft_consensus.cc:2886] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.060683 17880 raft_consensus.cc:2346] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 1. I0401 16:42:01.061141 17951 raft_consensus.cc:2346] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c95e30a87ab4955ba203d5c3c8e5772 in term 1. I0401 16:42:01.061173 18022 raft_consensus.cc:2346] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9fe51ce7e28a41b694019e780973d705 in term 1. I0401 16:42:01.061478 17844 leader_election.cc:310] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, 9fe51ce7e28a41b694019e780973d705; no voters: I0401 16:42:01.061480 17912 leader_election.cc:310] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c95e30a87ab4955ba203d5c3c8e5772, 9fe51ce7e28a41b694019e780973d705; no voters: I0401 16:42:01.061879 18084 raft_consensus.cc:2640] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:01.062095 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "660b85b59edb45bd84acef4a5db672b4" candidate_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" I0401 16:42:01.062300 18022 raft_consensus.cc:2886] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.062808 18084 raft_consensus.cc:667] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 LEADER]: Becoming Leader. State: Replica: 6c95e30a87ab4955ba203d5c3c8e5772, State: Running, Role: LEADER I0401 16:42:01.061882 18083 raft_consensus.cc:2640] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader election won for term 1 I0401 16:42:01.063127 18084 consensus_queue.cc:206] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.063645 18083 raft_consensus.cc:667] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 1 LEADER]: Becoming Leader. State: Replica: 9fe51ce7e28a41b694019e780973d705, State: Running, Role: LEADER I0401 16:42:01.063905 18083 consensus_queue.cc:206] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.064127 18022 raft_consensus.cc:2346] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c95e30a87ab4955ba203d5c3c8e5772 in term 1. I0401 16:42:01.065433 17737 catalog_manager.cc:3977] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 reported cstate change: term changed from 0 to 1, leader changed from to 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1). New cstate: current_term: 1 leader_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: UNKNOWN } } } I0401 16:42:01.068323 17736 catalog_manager.cc:3977] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 reported cstate change: term changed from 0 to 1, leader changed from to 9fe51ce7e28a41b694019e780973d705 (127.11.224.2). New cstate: current_term: 1 leader_uuid: "9fe51ce7e28a41b694019e780973d705" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } health_report { overall_health: UNKNOWN } } } I0401 16:42:01.119992 18083 raft_consensus.cc:472] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:01.120115 18083 raft_consensus.cc:494] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.121372 18083 leader_election.cc:296] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:01.121572 18022 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "6c38c7d058b3488696df48d169482458" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" is_pre_election: true I0401 16:42:01.121574 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "6c38c7d058b3488696df48d169482458" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:01.121821 17880 raft_consensus.cc:2276] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fe51ce7e28a41b694019e780973d705 in current term 1: Already voted for candidate e145fde928684f97872314204b7b48db in this term. I0401 16:42:01.121830 18022 raft_consensus.cc:2307] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 9fe51ce7e28a41b694019e780973d705 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:42:01.122830 17912 leader_election.cc:310] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fe51ce7e28a41b694019e780973d705; no voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db I0401 16:42:01.123217 18083 raft_consensus.cc:2886] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.125495 18083 raft_consensus.cc:2588] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:42:01.126155 12160 master.cc:270] Master@127.11.224.62:37328 shutting down... I0401 16:42:01.129176 17664 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.133107 17661 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.134017 17661 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.141450 17664 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.143908 17661 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.144842 17661 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.145550 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:01.145694 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:01.145773 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: stopping tablet replica I0401 16:42:01.151458 12160 master.cc:281] Master@127.11.224.62:37328 shutdown complete. I0401 16:42:01.161715 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 850931us I0401 16:42:01.162075 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:01.162243 12160 fs_manager.cc:266] Using existing metadata directory in first data directory I0401 16:42:01.164121 12160 fs_manager.cc:399] Time spent opening directory manager: real 0.002s user 0.000s sys 0.001s I0401 16:42:01.164633 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:01.167997 12160 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.001s sys 0.000s I0401 16:42:01.168057 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root uuid: "371b816bbc7f472d901ec12bd2fbc9f3" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:01.168134 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:01.216008 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.62:37328 I0401 16:42:01.217775 12160 webserver.cc:308] Webserver started at http://127.11.224.62:39000/ using document root and password file I0401 16:42:01.219084 12160 master.cc:270] Master@127.11.224.61:43829 shutting down... I0401 16:42:01.220489 18022 raft_consensus.cc:1181] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Refusing update from remote peer 9fe51ce7e28a41b694019e780973d705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.220973 18083 consensus_queue.cc:984] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:42:01.228031 17718 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.229897 17720 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.236183 17905 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.237087 17720 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.239449 17718 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.240766 17720 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.240800 18048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.242378 17976 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.243083 18048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.247102 18185 sys_catalog.cc:188] Verifying existing consensus state I0401 16:42:01.248277 17720 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.250278 17718 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.250761 18048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.251613 17720 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.251785 17905 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.252493 18185 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: Bootstrap starting. I0401 16:42:01.254644 17976 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.256572 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:01.256948 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:01.257031 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: stopping tablet replica I0401 16:42:01.258282 17720 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.258602 17880 raft_consensus.cc:1181] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Refusing update from remote peer 9fe51ce7e28a41b694019e780973d705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.259291 17832 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: acquiring CA information for follower catalog manager: success I0401 16:42:01.259481 17976 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.260738 18083 consensus_queue.cc:984] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:42:01.260949 17720 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:01.262562 17905 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.263345 18048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.265568 17832 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:42:01.273738 17976 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.275323 18048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.277016 12160 master.cc:281] Master@127.11.224.61:43829 shutdown complete. I0401 16:42:01.279280 17905 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.284895 18185 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=13 ignored=0} mutations{seen=20 ignored=0} orphaned_commits=0. Pending: 0 replicates I0401 16:42:01.285441 18185 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: Bootstrap complete. I0401 16:42:01.285851 17976 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.286303 18185 raft_consensus.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:01.286509 18185 raft_consensus.cc:705] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 371b816bbc7f472d901ec12bd2fbc9f3, State: Initialized, Role: FOLLOWER I0401 16:42:01.286701 18185 consensus_queue.cc:229] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:01.286988 18048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.288539 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 850931us I0401 16:42:01.288763 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:01.288799 12160 fs_manager.cc:266] Using existing metadata directory in first data directory I0401 16:42:01.290594 12160 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s I0401 16:42:01.290741 17951 raft_consensus.cc:1181] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.291338 18086 consensus_queue.cc:984] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:42:01.291723 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:01.291730 18195 sys_catalog.cc:337] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:01.291898 18195 sys_catalog.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:01.292029 17905 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.292026 18185 sys_catalog.cc:337] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:01.292176 18185 sys_catalog.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:01.292696 18185 sys_catalog.cc:424] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:42:01.294919 17976 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.297765 18197 catalog_manager.cc:536] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting I0401 16:42:01.298454 17880 raft_consensus.cc:1181] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.299048 18100 consensus_queue.cc:984] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0401 16:42:01.299348 12160 fs_manager.cc:419] Time spent opening block manager: real 0.004s user 0.001s sys 0.001s I0401 16:42:01.299407 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root uuid: "1afc84687f934a5a8055897bbf6c2a92" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:01.299628 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-1-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:01.301512 18048 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.301620 17905 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.302409 17976 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:01.302793 18151 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "e145fde928684f97872314204b7b48db" instance_seqno: 1554162120471935) as {username='jenkins'} at 127.11.224.62:42026; Asking this server to re-register. I0401 16:42:01.303551 18048 heartbeater.cc:426] Registering TS with master... I0401 16:42:01.303922 18151 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" instance_seqno: 1554162120356133) as {username='jenkins'} at 127.11.224.62:42027; Asking this server to re-register. I0401 16:42:01.336855 18086 raft_consensus.cc:472] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:01.340536 18086 raft_consensus.cc:494] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.379688 17905 heartbeater.cc:426] Registering TS with master... I0401 16:42:01.375773 17951 raft_consensus.cc:1181] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.363360 18150 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "9fe51ce7e28a41b694019e780973d705" instance_seqno: 1554162120416063) as {username='jenkins'} at 127.11.224.62:42028; Asking this server to re-register. I0401 16:42:01.384156 18086 leader_election.cc:296] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:01.393106 18092 raft_consensus.cc:472] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:01.366144 17880 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a06eb2eca2a4b8b996ff80335b9432c" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:01.409229 17880 raft_consensus.cc:2307] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate e145fde928684f97872314204b7b48db for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:42:01.411396 17951 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "8a06eb2eca2a4b8b996ff80335b9432c" candidate_uuid: "e145fde928684f97872314204b7b48db" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9fe51ce7e28a41b694019e780973d705" is_pre_election: true I0401 16:42:01.431633 17951 raft_consensus.cc:2276] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e145fde928684f97872314204b7b48db in current term 1: Already voted for candidate 6c95e30a87ab4955ba203d5c3c8e5772 in this term. I0401 16:42:01.437469 17879 raft_consensus.cc:1181] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Refusing update from remote peer 9fe51ce7e28a41b694019e780973d705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.445586 17950 raft_consensus.cc:1181] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Refusing update from remote peer 6c95e30a87ab4955ba203d5c3c8e5772: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.448982 17878 raft_consensus.cc:1181] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.451684 17986 leader_election.cc:310] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e145fde928684f97872314204b7b48db; no voters: 6c95e30a87ab4955ba203d5c3c8e5772, 9fe51ce7e28a41b694019e780973d705 I0401 16:42:01.413264 18092 raft_consensus.cc:494] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 } } peers { permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 } } peers { permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 } } I0401 16:42:01.430315 18086 consensus_queue.cc:984] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.028s I0401 16:42:01.458513 17949 raft_consensus.cc:2886] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.460707 18100 raft_consensus.cc:2886] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 0 FOLLOWER]: Advancing to term 1 I0401 16:42:01.460587 17951 raft_consensus.cc:1181] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.473073 18103 consensus_queue.cc:984] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s I0401 16:42:01.479612 17878 raft_consensus.cc:1181] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.482251 17976 heartbeater.cc:426] Registering TS with master... I0401 16:42:01.485905 18092 leader_election.cc:296] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895), e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:01.492082 17950 raft_consensus.cc:1181] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.486341 18086 consensus_queue.cc:984] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s I0401 16:42:01.475781 18083 consensus_queue.cc:984] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s I0401 16:42:01.487537 18205 consensus_queue.cc:984] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s I0401 16:42:01.519609 18219 consensus_queue.cc:984] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s I0401 16:42:01.525128 18149 ts_manager.cc:159] Registered new tserver with Master: e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:01.525346 18020 raft_consensus.cc:1181] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Refusing update from remote peer 9fe51ce7e28a41b694019e780973d705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.500197 18208 consensus_queue.cc:984] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.030s I0401 16:42:01.547646 18019 raft_consensus.cc:1181] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Refusing update from remote peer 9fe51ce7e28a41b694019e780973d705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.507136 17878 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "93119e4bbc1d4f6ba792c44cc4451934" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" is_pre_election: true I0401 16:42:01.579737 18092 consensus_queue.cc:984] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s I0401 16:42:01.514678 18021 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "93119e4bbc1d4f6ba792c44cc4451934" candidate_uuid: "9fe51ce7e28a41b694019e780973d705" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e145fde928684f97872314204b7b48db" is_pre_election: true I0401 16:42:01.617395 17878 raft_consensus.cc:2276] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9fe51ce7e28a41b694019e780973d705 in current term 1: Already voted for candidate e145fde928684f97872314204b7b48db in this term. I0401 16:42:01.627766 18021 raft_consensus.cc:2307] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 9fe51ce7e28a41b694019e780973d705 for term 1 because replica is either leader or believes a valid leader to be alive. I0401 16:42:01.640599 18191 consensus_queue.cc:984] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s I0401 16:42:01.647040 17947 raft_consensus.cc:1181] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Refusing update from remote peer 6c95e30a87ab4955ba203d5c3c8e5772: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.652209 18021 raft_consensus.cc:1181] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Refusing update from remote peer 6c95e30a87ab4955ba203d5c3c8e5772: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.662997 18150 ts_manager.cc:159] Registered new tserver with Master: 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895) I0401 16:42:01.666707 18084 consensus_queue.cc:984] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s I0401 16:42:01.740209 17877 raft_consensus.cc:1181] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Refusing update from remote peer 9fe51ce7e28a41b694019e780973d705: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.741348 17913 leader_election.cc:310] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9fe51ce7e28a41b694019e780973d705; no voters: 6c95e30a87ab4955ba203d5c3c8e5772, e145fde928684f97872314204b7b48db I0401 16:42:01.749562 17880 raft_consensus.cc:1181] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:01.751883 18191 consensus_queue.cc:984] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s I0401 16:42:01.788889 17875 raft_consensus.cc:1181] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) W0401 16:42:01.808224 17913 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.224.3:48514, user_credentials={real_user=jenkins}} blocked reactor thread for 124335us I0401 16:42:01.797340 18208 consensus_queue.cc:984] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s I0401 16:42:01.816126 18218 consensus_queue.cc:984] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" member_type: VOTER last_known_addr { host: "127.11.224.1" port: 33895 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s I0401 16:42:01.861382 18149 ts_manager.cc:159] Registered new tserver with Master: 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:01.959014 18084 consensus_queue.cc:984] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s W0401 16:42:02.063407 17844 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.224.2:42268, user_credentials={real_user=jenkins}} blocked reactor thread for 68703.6us W0401 16:42:02.148792 17912 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.224.1:33895, user_credentials={real_user=jenkins}} blocked reactor thread for 60140.4us W0401 16:42:02.189361 18100 consensus_meta.cc:220] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db: Time spent flushing consensus metadata: real 0.724s user 0.002s sys 0.052s I0401 16:42:02.189963 18100 raft_consensus.cc:2588] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:42:02.195711 18022 raft_consensus.cc:1181] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Refusing update from remote peer 6c95e30a87ab4955ba203d5c3c8e5772: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:02.201880 18256 consensus_queue.cc:984] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e145fde928684f97872314204b7b48db" member_type: VOTER last_known_addr { host: "127.11.224.3" port: 48514 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s W0401 16:42:02.206022 17949 consensus_meta.cc:220] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705: Time spent flushing consensus metadata: real 0.743s user 0.002s sys 0.043s I0401 16:42:02.207098 17949 raft_consensus.cc:1181] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Refusing update from remote peer e145fde928684f97872314204b7b48db: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0401 16:42:02.207955 18191 raft_consensus.cc:2588] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0401 16:42:02.212831 18100 consensus_queue.cc:984] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [LEADER]: Connected to new peer: Peer: permanent_uuid: "9fe51ce7e28a41b694019e780973d705" member_type: VOTER last_known_addr { host: "127.11.224.2" port: 42268 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s I0401 16:42:02.318451 18197 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: acquiring CA information for follower catalog manager: success I0401 16:42:02.340227 18197 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:42:02.437955 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.61:43829 I0401 16:42:02.438935 12160 webserver.cc:308] Webserver started at http://127.11.224.61:58468/ using document root and password file I0401 16:42:02.440611 12160 master.cc:270] Master@127.11.224.60:39040 shutting down... I0401 16:42:02.452291 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.452816 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.454941 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.470769 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.472985 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.478119 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.482575 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.486126 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.496146 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.498948 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.503455 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.510433 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.513334 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.521365 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.521461 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.525831 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.528430 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.534626 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.546995 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.548903 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.551380 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.555099 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.555866 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.563624 18309 sys_catalog.cc:188] Verifying existing consensus state I0401 16:42:02.568286 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.568671 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.573194 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.575561 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.585124 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.590611 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.591254 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.593065 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.600281 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.603449 18313 raft_consensus.cc:472] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:02.607105 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.608666 18314 raft_consensus.cc:472] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1afc84687f934a5a8055897bbf6c2a92) I0401 16:42:02.610903 18313 raft_consensus.cc:494] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:02.615622 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.617724 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.609743 18314 raft_consensus.cc:494] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:02.621381 18313 leader_election.cc:296] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1afc84687f934a5a8055897bbf6c2a92 (127.11.224.61:43829), 65d85c8269a7417fa1b5f2304d9fd054 (127.11.224.60:39040) I0401 16:42:02.625959 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.631474 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.633083 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.631830 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.635277 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.635690 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:02.639879 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.643472 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:02.643887 18314 leader_election.cc:296] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b816bbc7f472d901ec12bd2fbc9f3 (127.11.224.62:37328), 1afc84687f934a5a8055897bbf6c2a92 (127.11.224.61:43829) I0401 16:42:02.648542 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: stopping tablet replica I0401 16:42:02.662771 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.677636 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.685739 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.686332 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.687307 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.688957 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.696162 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.701536 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.702924 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.707391 18309 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: Bootstrap starting. I0401 16:42:02.708034 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.716740 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.718137 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.718922 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.720672 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.723712 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.730307 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.731353 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.733042 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.745322 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.746635 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.749086 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.748489 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.754240 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.760948 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.763989 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.764061 18161 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65d85c8269a7417fa1b5f2304d9fd054" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" is_pre_election: true I0401 16:42:02.765086 18161 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d85c8269a7417fa1b5f2304d9fd054 in term 1. I0401 16:42:02.766662 17777 leader_election.cc:310] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 371b816bbc7f472d901ec12bd2fbc9f3, 65d85c8269a7417fa1b5f2304d9fd054; no voters: W0401 16:42:02.767798 17777 raft_consensus.cc:2543] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: Unable to run election callback: Service unavailable: Thread pool token was shut down I0401 16:42:02.770998 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.772379 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.776494 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.777429 17776 messenger.cc:381] Service unavailable: service kudu.consensus.ConsensusService not registered on Master I0401 16:42:02.785720 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.787322 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.789816 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.803339 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.804250 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.805450 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.810111 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.818405 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.822468 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.831079 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.832703 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.833966 18309 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=13 ignored=0} mutations{seen=20 ignored=0} orphaned_commits=0. Pending: 0 replicates I0401 16:42:02.834282 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.837225 18309 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: Bootstrap complete. I0401 16:42:02.838645 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.839567 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.842664 18309 raft_consensus.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:02.844177 18309 raft_consensus.cc:705] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1afc84687f934a5a8055897bbf6c2a92, State: Initialized, Role: FOLLOWER I0401 16:42:02.844434 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.847267 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.846320 18309 consensus_queue.cc:229] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:02.854434 18309 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:02.855545 18309 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:02.854794 18323 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:02.856261 18323 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:02.856600 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.857023 18309 sys_catalog.cc:424] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:42:02.857028 18285 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "65d85c8269a7417fa1b5f2304d9fd054" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "1afc84687f934a5a8055897bbf6c2a92" is_pre_election: true I0401 16:42:02.859536 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.857137 18286 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "1afc84687f934a5a8055897bbf6c2a92" is_pre_election: true I0401 16:42:02.860481 18285 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 65d85c8269a7417fa1b5f2304d9fd054 in term 1. I0401 16:42:02.863494 17904 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.864253 17975 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.866086 18286 raft_consensus.cc:2321] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 371b816bbc7f472d901ec12bd2fbc9f3 for term 2 because replica is already servicing an update from a current leader or another vote. I0401 16:42:02.869343 18046 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:02.870120 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.871524 18273 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "9fe51ce7e28a41b694019e780973d705" instance_seqno: 1554162120416063) as {username='jenkins'} at 127.11.224.61:56890; Asking this server to re-register. I0401 16:42:02.873457 17975 heartbeater.cc:426] Registering TS with master... I0401 16:42:02.873461 18274 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" instance_seqno: 1554162120356133) as {username='jenkins'} at 127.11.224.61:56889; Asking this server to re-register. I0401 16:42:02.875317 17904 heartbeater.cc:426] Registering TS with master... I0401 16:42:02.876591 18275 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "e145fde928684f97872314204b7b48db" instance_seqno: 1554162120471935) as {username='jenkins'} at 127.11.224.61:56891; Asking this server to re-register. I0401 16:42:02.877800 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:02.879145 18046 heartbeater.cc:426] Registering TS with master... I0401 16:42:02.925065 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.025982 18273 ts_manager.cc:159] Registered new tserver with Master: 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895) I0401 16:42:03.032109 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.158943 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.200760 18276 ts_manager.cc:159] Registered new tserver with Master: e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:03.232030 18274 ts_manager.cc:159] Registered new tserver with Master: 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:03.239241 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.252975 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master W0401 16:42:03.237659 17986 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.224.2:42268, user_credentials={real_user=jenkins}} blocked reactor thread for 44607.1us I0401 16:42:03.270052 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.272013 18324 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: acquiring CA information for follower catalog manager: success I0401 16:42:03.275535 18324 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:42:03.286036 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.313463 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.315116 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.328047 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.331121 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.340740 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.343125 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.352619 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.355099 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.365072 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.366829 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.377049 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.379652 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.389770 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.394440 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.401720 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.407128 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.413807 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.418550 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.425765 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.435411 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.437258 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.448236 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.450161 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.462343 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master I0401 16:42:03.463893 17777 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master W0401 16:42:03.468287 17776 connection.cc:554] Connection torn down before Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.11.224.60:58574 (request call id 1) could send its response I0401 16:42:03.468747 17776 messenger.cc:381] Service unavailable: service kudu.master.MasterService not registered on Master W0401 16:42:03.468850 17776 connection.cc:554] Connection torn down before Call kudu.master.MasterService.Ping from 127.11.224.60:58405 (request call id 121) could send its response W0401 16:42:03.469882 18135 leader_election.cc:341] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 65d85c8269a7417fa1b5f2304d9fd054 (127.11.224.60:39040): Network error: recv got EOF from 127.11.224.60:39040 (error 108) I0401 16:42:03.470288 18135 leader_election.cc:310] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 371b816bbc7f472d901ec12bd2fbc9f3; no voters: 1afc84687f934a5a8055897bbf6c2a92, 65d85c8269a7417fa1b5f2304d9fd054 I0401 16:42:03.472788 18333 raft_consensus.cc:2588] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority I0401 16:42:03.496412 12160 master.cc:281] Master@127.11.224.60:39040 shutdown complete. I0401 16:42:03.518419 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 851931us I0401 16:42:03.518934 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:03.519168 12160 fs_manager.cc:266] Using existing metadata directory in first data directory I0401 16:42:03.521440 12160 fs_manager.cc:399] Time spent opening directory manager: real 0.002s user 0.001s sys 0.001s I0401 16:42:03.523126 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:03.526824 12160 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0401 16:42:03.527024 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root uuid: "65d85c8269a7417fa1b5f2304d9fd054" format_stamp: "Formatted at 2019-04-01 23:42:00 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:03.527487 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/master-2-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:03.599161 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.60:39040 I0401 16:42:03.601815 12160 webserver.cc:308] Webserver started at http://127.11.224.60:46482/ using document root and password file I0401 16:42:03.618021 18391 sys_catalog.cc:188] Verifying existing consensus state I0401 16:42:03.627063 17974 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.628368 12160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 851931us I0401 16:42:03.628767 18391 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: Bootstrap starting. I0401 16:42:03.629202 12160 fs_manager.cc:263] Metadata directory not provided I0401 16:42:03.629745 17903 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.631085 12160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0401 16:42:03.631397 12160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0401 16:42:03.631763 12160 server_base.cc:434] Attempting to create new FS layout instead I0401 16:42:03.635725 12160 fs_manager.cc:602] Generated new instance metadata in path /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-3-root/instance: uuid: "0f71ca65a4224307b7ab82ad8d8315e5" format_stamp: "Formatted at 2019-04-01 23:42:03 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:03.636875 18045 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.639467 17974 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.644659 17903 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.645215 12160 fs_manager.cc:503] Time spent creating directory manager: real 0.009s user 0.005s sys 0.002s I0401 16:42:03.648234 12160 file_cache.cc:466] Constructed file cache lbm with capacity 13107 I0401 16:42:03.649653 18045 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.652591 17974 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.658054 12160 fs_manager.cc:419] Time spent opening block manager: real 0.006s user 0.000s sys 0.004s I0401 16:42:03.658372 12160 fs_manager.cc:436] Opened local filesystem: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-3-root uuid: "0f71ca65a4224307b7ab82ad8d8315e5" format_stamp: "Formatted at 2019-04-01 23:42:03 on quasar-eitwqx-1.vpc.cloudera.com" I0401 16:42:03.658875 12160 fs_report.cc:352] FS layout report -------------------- wal directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-3-root metadata directory: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-3-root 1 data directories: /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160/minicluster-data/ts-3-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0401 16:42:03.659881 17903 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.665143 18045 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.670228 17974 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.671443 18391 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=0 applied=15 ignored=0} inserts{seen=13 ignored=0} mutations{seen=20 ignored=0} orphaned_commits=0. Pending: 0 replicates I0401 16:42:03.672593 18391 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: Bootstrap complete. I0401 16:42:03.672634 17903 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.674754 18391 raft_consensus.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:03.675122 18391 raft_consensus.cc:705] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 65d85c8269a7417fa1b5f2304d9fd054, State: Initialized, Role: FOLLOWER I0401 16:42:03.675329 18391 consensus_queue.cc:229] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:03.676249 18391 sys_catalog.cc:337] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:03.676859 18391 sys_catalog.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:03.677588 18045 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.677731 18391 sys_catalog.cc:424] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: configured and running, proceeding with master startup. I0401 16:42:03.679355 18358 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "e145fde928684f97872314204b7b48db" instance_seqno: 1554162120471935) as {username='jenkins'} at 127.11.224.60:58609; Asking this server to re-register. I0401 16:42:03.680224 18045 heartbeater.cc:426] Registering TS with master... I0401 16:42:03.676354 18402 sys_catalog.cc:337] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:03.680451 18402 sys_catalog.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:03.738968 17903 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.766382 17974 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:03.787875 18358 ts_manager.cc:159] Registered new tserver with Master: e145fde928684f97872314204b7b48db (127.11.224.3:48514) I0401 16:42:03.800232 18356 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "6c95e30a87ab4955ba203d5c3c8e5772" instance_seqno: 1554162120356133) as {username='jenkins'} at 127.11.224.60:58607; Asking this server to re-register. I0401 16:42:03.810667 17903 heartbeater.cc:426] Registering TS with master... I0401 16:42:03.791653 18357 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "9fe51ce7e28a41b694019e780973d705" instance_seqno: 1554162120416063) as {username='jenkins'} at 127.11.224.60:58608; Asking this server to re-register. I0401 16:42:03.815336 17974 heartbeater.cc:426] Registering TS with master... I0401 16:42:03.941546 18356 ts_manager.cc:159] Registered new tserver with Master: 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268) I0401 16:42:04.032996 18358 ts_manager.cc:159] Registered new tserver with Master: 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895) I0401 16:42:04.107100 18403 catalog_manager.cc:1111] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: acquiring CA information for follower catalog manager: success I0401 16:42:04.127264 18403 catalog_manager.cc:1139] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0401 16:42:04.183873 12160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0401 16:42:04.184679 12160 ts_tablet_manager.cc:376] Registered 0 tablets I0401 16:42:04.411758 12160 rpc_server.cc:205] RPC server started. Bound to: 127.11.224.4:51931 I0401 16:42:04.414705 12160 webserver.cc:308] Webserver started at http://127.11.224.4:38932/ using document root and password file I0401 16:42:04.535967 18468 heartbeater.cc:345] Connected to a master server at 127.11.224.61:43829 I0401 16:42:04.536552 18468 heartbeater.cc:426] Registering TS with master... I0401 16:42:04.538105 18468 heartbeater.cc:475] Master 127.11.224.61:43829 requested a full tablet report, sending... I0401 16:42:04.548313 18467 heartbeater.cc:345] Connected to a master server at 127.11.224.60:39040 I0401 16:42:04.549204 18467 heartbeater.cc:426] Registering TS with master... I0401 16:42:04.550598 18467 heartbeater.cc:475] Master 127.11.224.60:39040 requested a full tablet report, sending... I0401 16:42:04.672878 18275 ts_manager.cc:159] Registered new tserver with Master: 0f71ca65a4224307b7ab82ad8d8315e5 (127.11.224.4:51931) I0401 16:42:04.762713 18357 ts_manager.cc:159] Registered new tserver with Master: 0f71ca65a4224307b7ab82ad8d8315e5 (127.11.224.4:51931) I0401 16:42:04.782604 18470 heartbeater.cc:345] Connected to a master server at 127.11.224.62:37328 I0401 16:42:04.787305 18470 heartbeater.cc:426] Registering TS with master... I0401 16:42:04.791807 18470 heartbeater.cc:475] Master 127.11.224.62:37328 requested a full tablet report, sending... I0401 16:42:04.906250 18150 ts_manager.cc:159] Registered new tserver with Master: 0f71ca65a4224307b7ab82ad8d8315e5 (127.11.224.4:51931) I0401 16:42:04.912808 18484 raft_consensus.cc:472] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0401 16:42:04.920300 18484 raft_consensus.cc:494] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:04.981318 18484 leader_election.cc:296] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 371b816bbc7f472d901ec12bd2fbc9f3 (127.11.224.62:37328), 65d85c8269a7417fa1b5f2304d9fd054 (127.11.224.60:39040) I0401 16:42:05.121675 18161 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1afc84687f934a5a8055897bbf6c2a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" is_pre_election: true I0401 16:42:05.123915 18161 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1afc84687f934a5a8055897bbf6c2a92 in term 1. I0401 16:42:05.126010 18204 leader_election.cc:310] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1afc84687f934a5a8055897bbf6c2a92, 371b816bbc7f472d901ec12bd2fbc9f3; no voters: I0401 16:42:05.127521 18484 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Leader pre-election won for term 2 I0401 16:42:05.127934 18484 raft_consensus.cc:472] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0401 16:42:05.128554 18484 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 1 FOLLOWER]: Advancing to term 2 I0401 16:42:05.159050 18368 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1afc84687f934a5a8055897bbf6c2a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "65d85c8269a7417fa1b5f2304d9fd054" is_pre_election: true I0401 16:42:05.165263 18368 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1afc84687f934a5a8055897bbf6c2a92 in term 1. I0401 16:42:05.177111 18484 raft_consensus.cc:494] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:05.184187 18161 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1afc84687f934a5a8055897bbf6c2a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" I0401 16:42:05.185807 18161 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 1 FOLLOWER]: Advancing to term 2 I0401 16:42:05.186244 18368 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1afc84687f934a5a8055897bbf6c2a92" candidate_term: 2 candidate_status { last_received { term: 1 index: 15 } } ignore_live_leader: false dest_uuid: "65d85c8269a7417fa1b5f2304d9fd054" I0401 16:42:05.190129 18368 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 1 FOLLOWER]: Advancing to term 2 I0401 16:42:05.195904 18484 leader_election.cc:296] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [CANDIDATE]: Term 2 election: Requested vote from peers 371b816bbc7f472d901ec12bd2fbc9f3 (127.11.224.62:37328), 65d85c8269a7417fa1b5f2304d9fd054 (127.11.224.60:39040) I0401 16:42:05.218861 18368 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1afc84687f934a5a8055897bbf6c2a92 in term 2. I0401 16:42:05.219887 18161 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1afc84687f934a5a8055897bbf6c2a92 in term 2. I0401 16:42:05.220566 18206 leader_election.cc:310] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1afc84687f934a5a8055897bbf6c2a92, 65d85c8269a7417fa1b5f2304d9fd054; no voters: I0401 16:42:05.225297 18484 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 2 FOLLOWER]: Leader election won for term 2 I0401 16:42:05.230983 18484 raft_consensus.cc:667] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 2 LEADER]: Becoming Leader. State: Replica: 1afc84687f934a5a8055897bbf6c2a92, State: Running, Role: LEADER I0401 16:42:05.232275 18484 consensus_queue.cc:206] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 1.15, Last appended by leader: 15, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } I0401 16:42:05.250814 18490 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1afc84687f934a5a8055897bbf6c2a92. Latest consensus state: current_term: 2 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:05.251804 18490 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: LEADER I0401 16:42:05.254302 18492 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0401 16:42:05.271595 18492 catalog_manager.cc:354] Loaded metadata for table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295] I0401 16:42:05.278156 18492 catalog_manager.cc:408] Loaded metadata for tablet 04602a1066b94d2f84e90f2993ae9772 (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.280370 18492 catalog_manager.cc:408] Loaded metadata for tablet 3ff724b280dc4b058bc22a20e5423eb6 (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.283661 18492 catalog_manager.cc:408] Loaded metadata for tablet 60d3d144b47f4cb3a77880b3c3ed26b6 (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.286243 18492 catalog_manager.cc:408] Loaded metadata for tablet 660b85b59edb45bd84acef4a5db672b4 (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.288041 18492 catalog_manager.cc:408] Loaded metadata for tablet 6c38c7d058b3488696df48d169482458 (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.290702 18492 catalog_manager.cc:408] Loaded metadata for tablet 8a06eb2eca2a4b8b996ff80335b9432c (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.291960 18492 catalog_manager.cc:408] Loaded metadata for tablet 93119e4bbc1d4f6ba792c44cc4451934 (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.293992 18492 catalog_manager.cc:408] Loaded metadata for tablet d72e1acf78b3430e9a984932e6b2329b (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.295939 18492 catalog_manager.cc:408] Loaded metadata for tablet e292b104b2bf47ad809d9851ad79e549 (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.296916 18492 catalog_manager.cc:408] Loaded metadata for tablet e89daa9365924d10baee4f2be356fa73 (table ksck-test-table [id=4ac4df03697d4f00b78e5e7c70efb295]) I0401 16:42:05.297252 18492 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0401 16:42:05.309880 18492 catalog_manager.cc:1075] Loading token signing keys... I0401 16:42:05.316467 18492 catalog_manager.cc:4292] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: Loaded TSK: 0 I0401 16:42:05.336875 17904 heartbeater.cc:467] Master 127.11.224.61:43829 was elected leader, sending a full tablet report... I0401 16:42:05.343230 17975 heartbeater.cc:467] Master 127.11.224.61:43829 was elected leader, sending a full tablet report... I0401 16:42:05.346777 18274 master_service.cc:271] Signed X509 certificate for tserver {username='jenkins'} at 127.11.224.61:56930 I0401 16:42:05.347801 18046 heartbeater.cc:467] Master 127.11.224.61:43829 was elected leader, sending a full tablet report... I0401 16:42:05.390591 18468 heartbeater.cc:467] Master 127.11.224.61:43829 was elected leader, sending a full tablet report... I0401 16:42:05.635180 18368 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 2 FOLLOWER]: Refusing update from remote peer 1afc84687f934a5a8055897bbf6c2a92: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 2 index: 16. (index mismatch) I0401 16:42:05.636013 18490 consensus_queue.cc:984] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s I0401 16:42:05.649906 18493 sys_catalog.cc:337] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1afc84687f934a5a8055897bbf6c2a92. Latest consensus state: current_term: 2 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:05.652662 18493 sys_catalog.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:05.657827 18161 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 2 FOLLOWER]: Refusing update from remote peer 1afc84687f934a5a8055897bbf6c2a92: Log matching property violated. Preceding OpId in replica: term: 1 index: 15. Preceding OpId from leader: term: 2 index: 16. (index mismatch) I0401 16:42:05.656430 18484 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:05.661085 18490 consensus_queue.cc:984] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [LEADER]: Connected to new peer: Peer: permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s I0401 16:42:05.662115 18484 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: LEADER I0401 16:42:05.675637 18493 sys_catalog.cc:337] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:05.676554 18493 sys_catalog.cc:340] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:05.684500 18501 sys_catalog.cc:337] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:05.685945 18501 sys_catalog.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:05.686529 18498 sys_catalog.cc:337] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1afc84687f934a5a8055897bbf6c2a92. Latest consensus state: current_term: 2 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:05.688163 18498 sys_catalog.cc:340] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [sys.catalog]: This master's current role is: FOLLOWER I0401 16:42:06.135430 18496 sys_catalog.cc:337] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1afc84687f934a5a8055897bbf6c2a92" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "371b816bbc7f472d901ec12bd2fbc9f3" member_type: VOTER last_known_addr { host: "127.11.224.62" port: 37328 } } peers { permanent_uuid: "1afc84687f934a5a8055897bbf6c2a92" member_type: VOTER last_known_addr { host: "127.11.224.61" port: 43829 } } peers { permanent_uuid: "65d85c8269a7417fa1b5f2304d9fd054" member_type: VOTER last_known_addr { host: "127.11.224.60" port: 39040 } } } I0401 16:42:06.135743 18496 sys_catalog.cc:340] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [sys.catalog]: This master's current role is: LEADER /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tools/ksck_remote-test.cc:542: Failure Failed Bad status: Corruption: there are master consensus conflicts /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_util.cc:326: Failure Failed Timed out waiting for assertion to pass. I0401 16:42:35.964449 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:42:35.999356 17844 messenger.cc:381] Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer W0401 16:42:36.000578 17983 consensus_peers.cc:457] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db -> Peer 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895): Couldn't send request to peer 6c95e30a87ab4955ba203d5c3c8e5772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry. I0401 16:42:36.012979 17844 messenger.cc:381] Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer W0401 16:42:36.013356 17983 consensus_peers.cc:457] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db -> Peer 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895): Couldn't send request to peer 6c95e30a87ab4955ba203d5c3c8e5772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry. I0401 16:42:36.034763 17844 messenger.cc:381] Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer W0401 16:42:36.035269 17912 consensus_peers.cc:457] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 -> Peer 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895): Couldn't send request to peer 6c95e30a87ab4955ba203d5c3c8e5772. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry. I0401 16:42:36.048418 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:42:36.048626 12160 tablet_replica.cc:264] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.048835 12160 raft_consensus.cc:2143] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.049093 12160 raft_consensus.cc:2170] T 93119e4bbc1d4f6ba792c44cc4451934 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.050169 12160 tablet_replica.cc:264] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.050380 12160 raft_consensus.cc:2143] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.050534 12160 raft_consensus.cc:2170] T e292b104b2bf47ad809d9851ad79e549 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.051127 12160 tablet_replica.cc:264] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.051285 12160 raft_consensus.cc:2143] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.051575 12160 raft_consensus.cc:2170] T 8a06eb2eca2a4b8b996ff80335b9432c P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.052224 12160 tablet_replica.cc:264] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.052352 12160 raft_consensus.cc:2143] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.052518 12160 raft_consensus.cc:2170] T 3ff724b280dc4b058bc22a20e5423eb6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.053059 12160 tablet_replica.cc:264] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.053166 12160 raft_consensus.cc:2143] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.053261 12160 raft_consensus.cc:2170] T d72e1acf78b3430e9a984932e6b2329b P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.053633 12160 tablet_replica.cc:264] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.053740 12160 raft_consensus.cc:2143] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.053848 12160 raft_consensus.cc:2170] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.054219 12160 tablet_replica.cc:264] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.054324 12160 raft_consensus.cc:2143] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.054421 12160 raft_consensus.cc:2170] T 04602a1066b94d2f84e90f2993ae9772 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.054783 12160 tablet_replica.cc:264] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.054904 12160 raft_consensus.cc:2143] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.054996 12160 raft_consensus.cc:2170] T e89daa9365924d10baee4f2be356fa73 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.055428 12160 tablet_replica.cc:264] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.055706 12160 raft_consensus.cc:2143] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.055853 12160 raft_consensus.cc:2170] T 6c38c7d058b3488696df48d169482458 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.056388 12160 tablet_replica.cc:264] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772: stopping tablet replica I0401 16:42:36.056491 12160 raft_consensus.cc:2143] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.056670 12160 raft_consensus.cc:2170] T 660b85b59edb45bd84acef4a5db672b4 P 6c95e30a87ab4955ba203d5c3c8e5772 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.076285 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:36.076345 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:42:36.076508 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:36.083410 12160 tablet_server.cc:165] TabletServer shutting down... W0401 16:42:36.105813 17912 consensus_peers.cc:457] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 -> Peer 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895): Couldn't send request to peer 6c95e30a87ab4955ba203d5c3c8e5772. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:33895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:42:36.126678 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:42:36.126832 12160 tablet_replica.cc:264] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.126989 12160 raft_consensus.cc:2143] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.127105 12160 raft_consensus.cc:2170] T 93119e4bbc1d4f6ba792c44cc4451934 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.127665 12160 tablet_replica.cc:264] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.127774 12160 raft_consensus.cc:2143] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.127939 12160 raft_consensus.cc:2170] T 6c38c7d058b3488696df48d169482458 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.128387 12160 tablet_replica.cc:264] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.128487 12160 raft_consensus.cc:2143] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.128577 12160 raft_consensus.cc:2170] T 660b85b59edb45bd84acef4a5db672b4 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.129072 12160 tablet_replica.cc:264] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.129215 12160 raft_consensus.cc:2143] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.129328 12160 raft_consensus.cc:2170] T d72e1acf78b3430e9a984932e6b2329b P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.129895 12160 tablet_replica.cc:264] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.130003 12160 raft_consensus.cc:2143] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.130213 12160 raft_consensus.cc:2170] T 60d3d144b47f4cb3a77880b3c3ed26b6 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.130591 12160 tablet_replica.cc:264] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.130702 12160 raft_consensus.cc:2143] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.130802 12160 raft_consensus.cc:2170] T 8a06eb2eca2a4b8b996ff80335b9432c P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.131206 12160 tablet_replica.cc:264] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.131314 12160 raft_consensus.cc:2143] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.131482 12160 raft_consensus.cc:2170] T e292b104b2bf47ad809d9851ad79e549 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.132033 12160 tablet_replica.cc:264] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.132238 12160 raft_consensus.cc:2143] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.132411 12160 raft_consensus.cc:2170] T 04602a1066b94d2f84e90f2993ae9772 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.133136 12160 tablet_replica.cc:264] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.133586 12160 raft_consensus.cc:2143] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.134358 12160 raft_consensus.cc:2170] T e89daa9365924d10baee4f2be356fa73 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.135085 12160 tablet_replica.cc:264] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705: stopping tablet replica I0401 16:42:36.135185 12160 raft_consensus.cc:2143] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.135365 12160 raft_consensus.cc:2170] T 3ff724b280dc4b058bc22a20e5423eb6 P 9fe51ce7e28a41b694019e780973d705 [term 1 FOLLOWER]: Raft consensus is shut down! W0401 16:42:36.142683 17986 consensus_peers.cc:457] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db -> Peer 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268): Couldn't send request to peer 9fe51ce7e28a41b694019e780973d705. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.2:42268: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:42:36.152434 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:36.152485 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:42:36.152638 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:36.160431 12160 tablet_server.cc:165] TabletServer shutting down... W0401 16:42:36.193462 17983 consensus_peers.cc:457] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db -> Peer 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895): Couldn't send request to peer 6c95e30a87ab4955ba203d5c3c8e5772. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:33895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:42:36.197721 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:42:36.197857 12160 tablet_replica.cc:264] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.197996 12160 raft_consensus.cc:2143] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.198118 12160 raft_consensus.cc:2170] T 8a06eb2eca2a4b8b996ff80335b9432c P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.198688 12160 tablet_replica.cc:264] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.198810 12160 raft_consensus.cc:2143] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.198906 12160 raft_consensus.cc:2170] T e292b104b2bf47ad809d9851ad79e549 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.199277 12160 tablet_replica.cc:264] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db: stopping tablet replica W0401 16:42:36.207124 17986 consensus_peers.cc:457] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db -> Peer 9fe51ce7e28a41b694019e780973d705 (127.11.224.2:42268): Couldn't send request to peer 9fe51ce7e28a41b694019e780973d705. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.2:42268: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:42:36.226169 12160 raft_consensus.cc:2143] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.226544 12160 raft_consensus.cc:2170] T 93119e4bbc1d4f6ba792c44cc4451934 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.227305 12160 tablet_replica.cc:264] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.227454 12160 raft_consensus.cc:2143] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus shutting down. W0401 16:42:36.227425 17983 consensus_peers.cc:457] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db -> Peer 6c95e30a87ab4955ba203d5c3c8e5772 (127.11.224.1:33895): Couldn't send request to peer 6c95e30a87ab4955ba203d5c3c8e5772. Status: Network error: Client connection negotiation failed: client connection to 127.11.224.1:33895: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0401 16:42:36.227588 12160 raft_consensus.cc:2170] T 60d3d144b47f4cb3a77880b3c3ed26b6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.228307 12160 tablet_replica.cc:264] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.228524 12160 raft_consensus.cc:2143] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.228847 12160 raft_consensus.cc:2170] T d72e1acf78b3430e9a984932e6b2329b P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.229410 12160 tablet_replica.cc:264] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.229521 12160 raft_consensus.cc:2143] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.229697 12160 raft_consensus.cc:2170] T 6c38c7d058b3488696df48d169482458 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.230098 12160 tablet_replica.cc:264] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.230197 12160 raft_consensus.cc:2143] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.230288 12160 raft_consensus.cc:2170] T 660b85b59edb45bd84acef4a5db672b4 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.230654 12160 tablet_replica.cc:264] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.230753 12160 raft_consensus.cc:2143] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.230942 12160 raft_consensus.cc:2170] T 04602a1066b94d2f84e90f2993ae9772 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.231302 12160 tablet_replica.cc:264] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.231400 12160 raft_consensus.cc:2143] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 1 LEADER]: Raft consensus shutting down. I0401 16:42:36.231561 12160 raft_consensus.cc:2170] T e89daa9365924d10baee4f2be356fa73 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.231961 12160 tablet_replica.cc:264] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db: stopping tablet replica I0401 16:42:36.232064 12160 raft_consensus.cc:2143] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.232158 12160 raft_consensus.cc:2170] T 3ff724b280dc4b058bc22a20e5423eb6 P e145fde928684f97872314204b7b48db [term 1 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.248208 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:36.248265 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:42:36.248430 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:36.254528 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:42:36.286103 12160 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0401 16:42:36.299198 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:36.299250 12160 tablet_server.cc:165] TabletServer shutting down... I0401 16:42:36.299451 12160 tablet_server.cc:179] TabletServer shutdown complete. I0401 16:42:36.302018 12160 master.cc:270] Master@127.11.224.62:37328 shutting down... I0401 16:42:36.326167 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 2 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.326339 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3 [term 2 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.326426 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 371b816bbc7f472d901ec12bd2fbc9f3: stopping tablet replica I0401 16:42:36.340487 12160 master.cc:281] Master@127.11.224.62:37328 shutdown complete. I0401 16:42:36.343462 12160 master.cc:270] Master@127.11.224.61:43829 shutting down... I0401 16:42:36.365860 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 2 LEADER]: Raft consensus shutting down. I0401 16:42:36.366149 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92 [term 2 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.366221 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 1afc84687f934a5a8055897bbf6c2a92: stopping tablet replica I0401 16:42:36.380589 12160 master.cc:281] Master@127.11.224.61:43829 shutdown complete. I0401 16:42:36.409669 12160 master.cc:270] Master@127.11.224.60:39040 shutting down... I0401 16:42:36.431120 12160 raft_consensus.cc:2143] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 2 FOLLOWER]: Raft consensus shutting down. I0401 16:42:36.431288 12160 raft_consensus.cc:2170] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054 [term 2 FOLLOWER]: Raft consensus is shut down! I0401 16:42:36.431370 12160 tablet_replica.cc:264] T 00000000000000000000000000000000 P 65d85c8269a7417fa1b5f2304d9fd054: stopping tablet replica I0401 16:42:36.444733 12160 master.cc:281] Master@127.11.224.60:39040 shutdown complete. I0401 16:42:36.453467 12160 test_util.cc:135] ----------------------------------------------- I0401 16:42:36.453557 12160 test_util.cc:136] Had fatal failures, leaving test files at /data/somelongdirectorytoavoidrpathissues/src/kudutest/ksck_remote-test.0.RemoteKsckTest.TestClusterWithLocation.1554162092376624-12160 [ FAILED ] RemoteKsckTest.TestClusterWithLocation (36371 ms) [----------] 11 tests from RemoteKsckTest (64060 ms total) [----------] Global test environment tear-down [==========] 11 tests from 1 test case ran. (64060 ms total) [ PASSED ] 10 tests. [ FAILED ] 1 test, listed below: [ FAILED ] RemoteKsckTest.TestClusterWithLocation 1 FAILED TEST