Note: This is test shard 3 of 8. [==========] Running 2 tests from 1 test case. [----------] Global test environment set-up. [----------] 2 tests from DeleteTableTest [ RUN ] DeleteTableTest.TestAtomicDeleteTablet I1010 20:59:08.133823 128 external_mini_cluster.cc:586] Running /tmp/run_tha_testYB8Zs0/build/release/bin/kudu-master kudu-master --fs_wal_dir=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/master-0 --fs_data_dirs=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/master-0 --rpc_bind_addresses=127.0.0.1:0 --webserver_interface=localhost --webserver_port=0 --metrics_log_interval_ms=1000 --log_dir=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/master-0 --server_dump_info_path=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/master-0/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --logtostderr --logbuflevel=-1 --unlock_experimental_flags --unlock_unsafe_flags WARNING: Logging before InitGoogleLogging() is written to STDERR W1010 20:59:08.139201 133 flags.cc:294] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true I1010 20:59:08.139801 133 mem_tracker.cc:140] MemTracker: hard memory limit is 11.777661 GB I1010 20:59:08.139818 133 mem_tracker.cc:142] MemTracker: soft memory limit is 7.066597 GB I1010 20:59:08.140837 133 master_main.cc:58] Initializing master server... I1010 20:59:08.140940 133 hybrid_clock.cc:177] HybridClock initialized. Resolution in nanos?: 1 Wait times tolerance adjustment: 1.0005 Current error: 1060068 I1010 20:59:08.141746 133 server_base.cc:167] Could not load existing FS layout: Not found: /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/master-0/instance: No such file or directory (error 2) I1010 20:59:08.141765 133 server_base.cc:168] Creating new FS layout I1010 20:59:08.319385 133 fs_manager.cc:354] Generated new instance metadata in path /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/master-0/instance: uuid: "37358b7333e04bc1bc42e1dec5253251" format_stamp: "Formatted at 2016-10-10 20:59:08 on dist-test-slave-dist-test-slave-aqxu" I1010 20:59:08.331454 133 fs_manager.cc:243] Opened local filesystem: /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/master-0 uuid: "37358b7333e04bc1bc42e1dec5253251" format_stamp: "Formatted at 2016-10-10 20:59:08 on dist-test-slave-dist-test-slave-aqxu" I1010 20:59:08.333519 133 master_main.cc:61] Starting Master server... I1010 20:59:08.338102 133 rpc_server.cc:164] RPC server started. Bound to: 127.0.0.1:59693 I1010 20:59:08.338145 133 webserver.cc:125] Starting webserver on localhost:0 I1010 20:59:08.338165 133 webserver.cc:136] Document root disabled I1010 20:59:08.338433 133 net_util.cc:195] Address 127.0.0.1:0 for localhost:0 duplicates an earlier resolved entry. I1010 20:59:08.338564 133 webserver.cc:220] Webserver started. Bound to: http://127.0.0.1:44646/ I1010 20:59:08.338663 133 server_base.cc:239] Dumped server information to /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/master-0/info.pb I1010 20:59:08.379554 128 external_mini_cluster.cc:622] Started /tmp/run_tha_testYB8Zs0/build/release/bin/kudu-master as pid 133 I1010 20:59:08.379633 128 external_mini_cluster.cc:586] Running /tmp/run_tha_testYB8Zs0/build/release/bin/kudu-tserver kudu-tserver --fs_wal_dir=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-0 --fs_data_dirs=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-0 --rpc_bind_addresses=127.0.128.0:0 --local_ip_for_outbound_sockets=127.0.128.0 --webserver_interface=127.0.128.0 --webserver_port=0 --tserver_master_addrs=127.0.0.1:59693 --metrics_log_interval_ms=1000 --log_dir=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-0 --never_fsync --server_dump_info_path=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-0/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --logtostderr --logbuflevel=-1 --unlock_experimental_flags --unlock_unsafe_flags I1010 20:59:08.384629 187 tablet_bootstrap.cc:380] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251: Bootstrap starting. I1010 20:59:08.384807 187 tablet_bootstrap.cc:542] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1010 20:59:08.384932 187 tablet_bootstrap.cc:482] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251: No blocks or log segments found. Creating new log. I1010 20:59:08.385041 187 log.cc:347] Log is configured to *not* fsync() on all Append() calls WARNING: Logging before InitGoogleLogging() is written to STDERR W1010 20:59:08.386205 188 flags.cc:294] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W1010 20:59:08.386266 188 flags.cc:294] Enabled unsafe flag: --never_fsync=true W1010 20:59:08.386714 188 flags.cc:294] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.128.0 I1010 20:59:08.386813 188 mem_tracker.cc:140] MemTracker: hard memory limit is 11.777661 GB I1010 20:59:08.386824 188 mem_tracker.cc:142] MemTracker: soft memory limit is 7.066597 GB I1010 20:59:08.387737 188 tablet_server_main.cc:54] Initializing tablet server... I1010 20:59:08.387854 188 hybrid_clock.cc:177] HybridClock initialized. Resolution in nanos?: 1 Wait times tolerance adjustment: 1.0005 Current error: 1060068 I1010 20:59:08.388672 188 server_base.cc:167] Could not load existing FS layout: Not found: /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-0/instance: No such file or directory (error 2) I1010 20:59:08.388686 188 server_base.cc:168] Creating new FS layout I1010 20:59:08.389740 188 fs_manager.cc:354] Generated new instance metadata in path /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-0/instance: uuid: "b0326d6a607048b08ec7e3bb3e79f82e" format_stamp: "Formatted at 2016-10-10 20:59:08 on dist-test-slave-dist-test-slave-aqxu" I1010 20:59:08.390236 187 tablet_bootstrap.cc:380] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251: No bootstrap required, opened a new log I1010 20:59:08.390414 188 fs_manager.cc:243] Opened local filesystem: /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-0 uuid: "b0326d6a607048b08ec7e3bb3e79f82e" format_stamp: "Formatted at 2016-10-10 20:59:08 on dist-test-slave-dist-test-slave-aqxu" I1010 20:59:08.390512 187 raft_consensus.cc:275] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37358b7333e04bc1bc42e1dec5253251" member_type: VOTER } I1010 20:59:08.390524 187 raft_consensus.cc:306] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1010 20:59:08.390533 187 raft_consensus.cc:502] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 37358b7333e04bc1bc42e1dec5253251, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I1010 20:59:08.390547 187 consensus_queue.cc:168] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1010 20:59:08.390550 187 raft_consensus.cc:319] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I1010 20:59:08.390553 187 raft_consensus.cc:375] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 0 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:08.390555 187 raft_consensus.cc:2031] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 0 FOLLOWER]: Advancing to term 1 I1010 20:59:08.390719 187 raft_consensus.cc:1981] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.580s I1010 20:59:08.390733 187 raft_consensus.cc:391] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 1 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37358b7333e04bc1bc42e1dec5253251" member_type: VOTER } I1010 20:59:08.393524 188 tablet_server_main.cc:57] Starting tablet server... I1010 20:59:08.402215 188 rpc_server.cc:164] RPC server started. Bound to: 127.0.128.0:59041 I1010 20:59:08.402252 188 webserver.cc:125] Starting webserver on 127.0.128.0:0 I1010 20:59:08.402257 188 webserver.cc:136] Document root disabled I1010 20:59:08.402355 188 webserver.cc:220] Webserver started. Bound to: http://127.0.128.0:42434/ I1010 20:59:08.402465 188 server_base.cc:239] Dumped server information to /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-0/info.pb I1010 20:59:08.402737 188 tablet_server_main.cc:60] Tablet server successfully started. I1010 20:59:08.404294 305 heartbeater.cc:292] Connected to a master server at 127.0.0.1:59693 I1010 20:59:08.404315 305 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.404330 305 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.404539 305 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 I1010 20:59:08.404556 305 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.404568 305 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.404747 305 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 I1010 20:59:08.404760 305 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.404772 305 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.404920 305 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 W1010 20:59:08.404945 305 heartbeater.cc:323] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. I1010 20:59:08.410276 128 external_mini_cluster.cc:622] Started /tmp/run_tha_testYB8Zs0/build/release/bin/kudu-tserver as pid 188 I1010 20:59:08.410342 128 external_mini_cluster.cc:586] Running /tmp/run_tha_testYB8Zs0/build/release/bin/kudu-tserver kudu-tserver --fs_wal_dir=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-1 --fs_data_dirs=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-1 --rpc_bind_addresses=127.0.128.1:0 --local_ip_for_outbound_sockets=127.0.128.1 --webserver_interface=127.0.128.1 --webserver_port=0 --tserver_master_addrs=127.0.0.1:59693 --metrics_log_interval_ms=1000 --log_dir=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-1 --never_fsync --server_dump_info_path=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-1/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --logtostderr --logbuflevel=-1 --unlock_experimental_flags --unlock_unsafe_flags WARNING: Logging before InitGoogleLogging() is written to STDERR W1010 20:59:08.414522 309 flags.cc:294] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W1010 20:59:08.414585 309 flags.cc:294] Enabled unsafe flag: --never_fsync=true W1010 20:59:08.414973 309 flags.cc:294] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.128.1 I1010 20:59:08.415071 309 mem_tracker.cc:140] MemTracker: hard memory limit is 11.777661 GB I1010 20:59:08.415083 309 mem_tracker.cc:142] MemTracker: soft memory limit is 7.066597 GB I1010 20:59:08.416771 309 tablet_server_main.cc:54] Initializing tablet server... I1010 20:59:08.416872 309 hybrid_clock.cc:177] HybridClock initialized. Resolution in nanos?: 1 Wait times tolerance adjustment: 1.0005 Current error: 1060068 I1010 20:59:08.417565 309 server_base.cc:167] Could not load existing FS layout: Not found: /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-1/instance: No such file or directory (error 2) I1010 20:59:08.417578 309 server_base.cc:168] Creating new FS layout I1010 20:59:08.418534 309 fs_manager.cc:354] Generated new instance metadata in path /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-1/instance: uuid: "3dd229c6b31f46078f6912755db424aa" format_stamp: "Formatted at 2016-10-10 20:59:08 on dist-test-slave-dist-test-slave-aqxu" I1010 20:59:08.419178 309 fs_manager.cc:243] Opened local filesystem: /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-1 uuid: "3dd229c6b31f46078f6912755db424aa" format_stamp: "Formatted at 2016-10-10 20:59:08 on dist-test-slave-dist-test-slave-aqxu" I1010 20:59:08.421313 309 tablet_server_main.cc:57] Starting tablet server... I1010 20:59:08.430778 309 rpc_server.cc:164] RPC server started. Bound to: 127.0.128.1:56847 I1010 20:59:08.430836 309 webserver.cc:125] Starting webserver on 127.0.128.1:0 I1010 20:59:08.430865 309 webserver.cc:136] Document root disabled I1010 20:59:08.430968 309 webserver.cc:220] Webserver started. Bound to: http://127.0.128.1:53467/ I1010 20:59:08.431077 309 server_base.cc:239] Dumped server information to /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-1/info.pb I1010 20:59:08.431296 309 tablet_server_main.cc:60] Tablet server successfully started. I1010 20:59:08.432075 423 heartbeater.cc:292] Connected to a master server at 127.0.0.1:59693 I1010 20:59:08.432096 423 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.432109 423 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.432288 423 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 I1010 20:59:08.432312 423 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.432325 423 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.432469 423 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 I1010 20:59:08.432484 423 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.432495 423 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.432667 423 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 W1010 20:59:08.432680 423 heartbeater.cc:323] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. I1010 20:59:08.440980 128 external_mini_cluster.cc:622] Started /tmp/run_tha_testYB8Zs0/build/release/bin/kudu-tserver as pid 309 I1010 20:59:08.441041 128 external_mini_cluster.cc:586] Running /tmp/run_tha_testYB8Zs0/build/release/bin/kudu-tserver kudu-tserver --fs_wal_dir=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-2 --fs_data_dirs=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-2 --rpc_bind_addresses=127.0.128.2:0 --local_ip_for_outbound_sockets=127.0.128.2 --webserver_interface=127.0.128.2 --webserver_port=0 --tserver_master_addrs=127.0.0.1:59693 --metrics_log_interval_ms=1000 --log_dir=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-2 --never_fsync --server_dump_info_path=/tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-2/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --logtostderr --logbuflevel=-1 --unlock_experimental_flags --unlock_unsafe_flags WARNING: Logging before InitGoogleLogging() is written to STDERR W1010 20:59:08.445931 426 flags.cc:294] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W1010 20:59:08.446013 426 flags.cc:294] Enabled unsafe flag: --never_fsync=true W1010 20:59:08.446434 426 flags.cc:294] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.128.2 I1010 20:59:08.446554 426 mem_tracker.cc:140] MemTracker: hard memory limit is 11.777661 GB I1010 20:59:08.446578 426 mem_tracker.cc:142] MemTracker: soft memory limit is 7.066597 GB I1010 20:59:08.447577 426 tablet_server_main.cc:54] Initializing tablet server... I1010 20:59:08.447696 426 hybrid_clock.cc:177] HybridClock initialized. Resolution in nanos?: 1 Wait times tolerance adjustment: 1.0005 Current error: 1060068 I1010 20:59:08.448377 426 server_base.cc:167] Could not load existing FS layout: Not found: /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-2/instance: No such file or directory (error 2) I1010 20:59:08.448390 426 server_base.cc:168] Creating new FS layout I1010 20:59:08.449554 426 fs_manager.cc:354] Generated new instance metadata in path /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-2/instance: uuid: "f7c5a4998d4643b895c467337426b93a" format_stamp: "Formatted at 2016-10-10 20:59:08 on dist-test-slave-dist-test-slave-aqxu" I1010 20:59:08.450122 426 fs_manager.cc:243] Opened local filesystem: /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-2 uuid: "f7c5a4998d4643b895c467337426b93a" format_stamp: "Formatted at 2016-10-10 20:59:08 on dist-test-slave-dist-test-slave-aqxu" I1010 20:59:08.452775 426 tablet_server_main.cc:57] Starting tablet server... I1010 20:59:08.460682 426 rpc_server.cc:164] RPC server started. Bound to: 127.0.128.2:55652 I1010 20:59:08.460718 426 webserver.cc:125] Starting webserver on 127.0.128.2:0 I1010 20:59:08.460724 426 webserver.cc:136] Document root disabled I1010 20:59:08.460844 426 webserver.cc:220] Webserver started. Bound to: http://127.0.128.2:50136/ I1010 20:59:08.460950 426 server_base.cc:239] Dumped server information to /tmp/kudutest-1000/delete_table-test.DeleteTableTest.TestAtomicDeleteTablet.1476133148126302-128/minicluster-data/ts-2/info.pb I1010 20:59:08.461175 426 tablet_server_main.cc:60] Tablet server successfully started. I1010 20:59:08.461638 128 external_mini_cluster.cc:622] Started /tmp/run_tha_testYB8Zs0/build/release/bin/kudu-tserver as pid 426 I1010 20:59:08.461982 540 heartbeater.cc:292] Connected to a master server at 127.0.0.1:59693 I1010 20:59:08.462002 540 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.462013 540 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.462169 540 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 I1010 20:59:08.462187 540 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.462198 540 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.462352 540 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 I1010 20:59:08.462368 540 heartbeater.cc:359] Registering TS with master... I1010 20:59:08.462378 540 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... W1010 20:59:08.462587 540 heartbeater.cc:453] Failed to heartbeat to 127.0.0.1:59693: Service unavailable: Catalog manager is not initialized. State: 1 W1010 20:59:08.462602 540 heartbeater.cc:323] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. I1010 20:59:08.557605 187 leader_election.cc:248] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I1010 20:59:08.557890 187 sys_catalog.cc:257] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletPeer. Latest consensus state: current_term: 1 config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37358b7333e04bc1bc42e1dec5253251" member_type: VOTER } } I1010 20:59:08.557910 187 sys_catalog.cc:260] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [sys.catalog]: This master's current role is: FOLLOWER I1010 20:59:08.557921 544 raft_consensus.cc:1981] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.551s I1010 20:59:08.557960 544 raft_consensus.cc:1861] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 1 FOLLOWER]: Leader election won for term 1 I1010 20:59:08.558794 544 raft_consensus.cc:467] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [term 1 LEADER]: Becoming Leader. State: Replica: 37358b7333e04bc1bc42e1dec5253251, State: 1, Role: LEADER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I1010 20:59:08.558840 544 consensus_queue.cc:151] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 1, Majority size: 1, State: 1, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37358b7333e04bc1bc42e1dec5253251" member_type: VOTER } I1010 20:59:08.560282 546 sys_catalog.cc:257] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 37358b7333e04bc1bc42e1dec5253251. Latest consensus state: current_term: 1 leader_uuid: "37358b7333e04bc1bc42e1dec5253251" config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37358b7333e04bc1bc42e1dec5253251" member_type: VOTER } } I1010 20:59:08.560343 187 sys_catalog.cc:335] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [sys.catalog]: configured and running, proceeding with master startup. I1010 20:59:08.560353 546 sys_catalog.cc:260] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [sys.catalog]: This master's current role is: LEADER I1010 20:59:08.560495 545 sys_catalog.cc:257] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "37358b7333e04bc1bc42e1dec5253251" config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "37358b7333e04bc1bc42e1dec5253251" member_type: VOTER } } I1010 20:59:08.560513 545 sys_catalog.cc:260] T 00000000000000000000000000000000 P 37358b7333e04bc1bc42e1dec5253251 [sys.catalog]: This master's current role is: LEADER W1010 20:59:08.560675 548 catalog_manager.cc:365] Catalog manager background task thread going to sleep: Service unavailable: Catalog manager is not initialized. State: 1 I1010 20:59:08.560735 133 master_main.cc:64] Master server successfully started. I1010 20:59:08.560775 547 catalog_manager.cc:660] Loading table and tablet metadata into memory... I1010 20:59:09.405334 305 heartbeater.cc:292] Connected to a master server at 127.0.0.1:59693 I1010 20:59:09.405369 305 heartbeater.cc:359] Registering TS with master... I1010 20:59:09.405388 305 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... I1010 20:59:09.405496 154 ts_manager.cc:76] Registered new tserver with Master: b0326d6a607048b08ec7e3bb3e79f82e (127.0.128.0:59041) I1010 20:59:09.433009 423 heartbeater.cc:292] Connected to a master server at 127.0.0.1:59693 I1010 20:59:09.433032 423 heartbeater.cc:359] Registering TS with master... I1010 20:59:09.433048 423 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... I1010 20:59:09.433161 154 ts_manager.cc:76] Registered new tserver with Master: 3dd229c6b31f46078f6912755db424aa (127.0.128.1:56847) I1010 20:59:09.463011 540 heartbeater.cc:292] Connected to a master server at 127.0.0.1:59693 I1010 20:59:09.463033 540 heartbeater.cc:359] Registering TS with master... I1010 20:59:09.463044 540 heartbeater.cc:373] Master 127.0.0.1:59693 requested a full tablet report, sending... I1010 20:59:09.463160 154 ts_manager.cc:76] Registered new tserver with Master: f7c5a4998d4643b895c467337426b93a (127.0.128.2:55652) I1010 20:59:09.463291 128 external_mini_cluster.cc:341] 3 TS(s) registered with all masters I1010 20:59:09.468665 153 catalog_manager.cc:789] CreateTable from {real_user=slave, eff_user=} at 127.0.0.1:40197: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I1010 20:59:09.470824 242 tablet_service.cc:619] Processing CreateTablet for tablet 1232c6af4b4449588e47fe45b6eb2743 (table=test-workload [id=69fd470dc8574a5eb878dfb88c4836f0]), partition=range: [, ) I1010 20:59:09.470943 360 tablet_service.cc:619] Processing CreateTablet for tablet 1232c6af4b4449588e47fe45b6eb2743 (table=test-workload [id=69fd470dc8574a5eb878dfb88c4836f0]), partition=range: [, ) I1010 20:59:09.470969 477 tablet_service.cc:619] Processing CreateTablet for tablet 1232c6af4b4449588e47fe45b6eb2743 (table=test-workload [id=69fd470dc8574a5eb878dfb88c4836f0]), partition=range: [, ) I1010 20:59:09.472003 477 ts_tablet_manager.cc:766] Registered tablet 1232c6af4b4449588e47fe45b6eb2743 I1010 20:59:09.472321 242 ts_tablet_manager.cc:766] Registered tablet 1232c6af4b4449588e47fe45b6eb2743 I1010 20:59:09.472388 360 ts_tablet_manager.cc:766] Registered tablet 1232c6af4b4449588e47fe45b6eb2743 I1010 20:59:09.472512 571 ts_tablet_manager.cc:632] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Bootstrapping tablet I1010 20:59:09.472735 572 ts_tablet_manager.cc:632] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Bootstrapping tablet I1010 20:59:09.472748 571 tablet_bootstrap.cc:380] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Bootstrap starting. I1010 20:59:09.472825 570 ts_tablet_manager.cc:632] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Bootstrapping tablet I1010 20:59:09.472909 571 tablet_bootstrap.cc:542] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1010 20:59:09.472913 572 tablet_bootstrap.cc:380] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Bootstrap starting. I1010 20:59:09.472998 570 tablet_bootstrap.cc:380] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Bootstrap starting. I1010 20:59:09.473034 571 tablet_bootstrap.cc:482] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: No blocks or log segments found. Creating new log. I1010 20:59:09.473050 572 tablet_bootstrap.cc:542] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1010 20:59:09.473141 570 tablet_bootstrap.cc:542] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Time spent opening tablet: real 0.000s user 0.000s sys 0.000s I1010 20:59:09.473162 572 tablet_bootstrap.cc:482] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: No blocks or log segments found. Creating new log. I1010 20:59:09.473220 571 log.cc:347] Log is configured to *not* fsync() on all Append() calls I1010 20:59:09.473309 572 log.cc:347] Log is configured to *not* fsync() on all Append() calls I1010 20:59:09.473317 570 tablet_bootstrap.cc:482] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: No blocks or log segments found. Creating new log. I1010 20:59:09.474344 570 log.cc:347] Log is configured to *not* fsync() on all Append() calls I1010 20:59:09.510759 571 tablet_bootstrap.cc:380] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: No bootstrap required, opened a new log I1010 20:59:09.510762 570 tablet_bootstrap.cc:380] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: No bootstrap required, opened a new log I1010 20:59:09.510762 572 tablet_bootstrap.cc:380] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: No bootstrap required, opened a new log I1010 20:59:09.510788 570 ts_tablet_manager.cc:637] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.000s I1010 20:59:09.510788 572 ts_tablet_manager.cc:637] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.000s I1010 20:59:09.510788 571 ts_tablet_manager.cc:637] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Time spent bootstrapping tablet: real 0.038s user 0.000s sys 0.000s I1010 20:59:09.511248 571 raft_consensus.cc:275] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:09.511253 572 raft_consensus.cc:275] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:09.511253 570 raft_consensus.cc:275] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:09.511270 571 raft_consensus.cc:306] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1010 20:59:09.511270 572 raft_consensus.cc:306] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1010 20:59:09.511272 570 raft_consensus.cc:306] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I1010 20:59:09.511284 571 raft_consensus.cc:502] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b0326d6a607048b08ec7e3bb3e79f82e, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I1010 20:59:09.511286 570 raft_consensus.cc:502] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f7c5a4998d4643b895c467337426b93a, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I1010 20:59:09.511286 572 raft_consensus.cc:502] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3dd229c6b31f46078f6912755db424aa, State: 1, Role: FOLLOWER Watermarks: {Received: term: 0 index: 0 Committed: term: 0 index: 0} I1010 20:59:09.511296 571 consensus_queue.cc:168] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1010 20:59:09.511296 572 consensus_queue.cc:168] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1010 20:59:09.511296 570 consensus_queue.cc:168] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Current term: 0, Majority size: -1, State: 1, Mode: NON_LEADER I1010 20:59:09.511462 571 ts_tablet_manager.cc:664] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I1010 20:59:09.511482 572 ts_tablet_manager.cc:664] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I1010 20:59:09.511462 305 heartbeater.cc:365] Master 127.0.0.1:59693 was elected leader, sending a full tablet report... I1010 20:59:09.511507 423 heartbeater.cc:365] Master 127.0.0.1:59693 was elected leader, sending a full tablet report... I1010 20:59:09.511584 540 heartbeater.cc:365] Master 127.0.0.1:59693 was elected leader, sending a full tablet report... I1010 20:59:09.511700 570 ts_tablet_manager.cc:664] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I1010 20:59:09.732249 581 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 0 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:09.732291 581 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 0 FOLLOWER]: Advancing to term 1 I1010 20:59:09.732651 581 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.597s I1010 20:59:09.732704 581 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:09.741314 580 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 0 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:09.741334 580 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 0 FOLLOWER]: Advancing to term 1 I1010 20:59:09.741600 580 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.576s I1010 20:59:09.741660 580 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:09.925285 579 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 0 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:09.925319 579 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 0 FOLLOWER]: Advancing to term 1 I1010 20:59:09.925652 579 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.570s I1010 20:59:09.925704 579 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:09.931947 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 1 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:09.931994 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 1 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:09.932013 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 1 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:09.932023 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 1 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:09.933351 380 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 1: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:09.933473 430 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 1 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 1: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:09.933624 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 1: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:09.933724 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 1 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 1: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:10.111136 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 1 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:10.111156 262 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 1: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:10.111177 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 1 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:10.111316 261 raft_consensus.cc:1654] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a for term 1 because replica is already servicing an update from a current leader or another vote. I1010 20:59:10.111413 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 1 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 1: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:10.111443 315 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. I1010 20:59:10.111587 432 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 1 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Service unavailable: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a for term 1 because replica is already servicing an update from a current leader or another vote. I1010 20:59:10.111611 432 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. I1010 20:59:10.111824 591 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.603s I1010 20:59:10.111860 591 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: None given I1010 20:59:10.112061 590 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.553s I1010 20:59:10.112118 590 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Leader election lost for term 1. Reason: None given I1010 20:59:10.112217 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 1: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:10.112325 197 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 1 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 1: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:10.112440 380 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 1: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:10.112566 195 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 1 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 1: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:10.112586 195 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. I1010 20:59:10.112720 592 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.628s I1010 20:59:10.112735 592 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: None given I1010 20:59:13.526029 579 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:13.526065 579 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 1 FOLLOWER]: Advancing to term 2 I1010 20:59:13.744850 581 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:13.744884 581 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 1 FOLLOWER]: Advancing to term 2 I1010 20:59:13.902241 580 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:13.902259 580 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 1 FOLLOWER]: Advancing to term 2 I1010 20:59:14.024688 579 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.534s I1010 20:59:14.024750 581 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.579s I1010 20:59:14.024750 580 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.623s I1010 20:59:14.024775 579 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:14.024788 581 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:14.024790 580 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:14.277434 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 2 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:14.277434 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 2 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:14.277501 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 2 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:14.277505 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 2 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:14.277693 380 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 2: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:14.277739 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 2: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:14.277832 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 2 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 2: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:14.277864 430 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 2 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 2: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:14.278996 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 2 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:14.279016 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 2 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:14.279070 261 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 2: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:14.279124 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 2: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:14.279167 262 raft_consensus.cc:1654] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa for term 2 because replica is already servicing an update from a current leader or another vote. I1010 20:59:14.279230 197 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 2 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 2: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:14.279292 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 2 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Service unavailable: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa for term 2 because replica is already servicing an update from a current leader or another vote. I1010 20:59:14.279299 432 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 2 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 2: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:14.279305 315 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. I1010 20:59:14.279309 432 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. I1010 20:59:14.279321 380 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 2: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:14.279474 593 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.560s I1010 20:59:14.279475 594 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.576s I1010 20:59:14.279485 195 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 2 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 2: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:14.279489 594 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: None given I1010 20:59:14.279494 195 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. I1010 20:59:14.279518 593 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Leader election lost for term 2. Reason: None given I1010 20:59:14.279639 595 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.619s I1010 20:59:14.279656 595 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Leader election lost for term 2. Reason: None given I1010 20:59:17.382290 580 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:17.382325 580 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 2 FOLLOWER]: Advancing to term 3 I1010 20:59:17.382716 580 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.567s I1010 20:59:17.382834 580 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:17.509553 581 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:17.509583 581 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 2 FOLLOWER]: Advancing to term 3 I1010 20:59:17.509989 581 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.701s I1010 20:59:17.510062 581 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:17.533586 579 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:17.533617 579 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 2 FOLLOWER]: Advancing to term 3 I1010 20:59:17.534102 579 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.566s I1010 20:59:17.534153 579 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } W1010 20:59:18.062876 579 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Time spent flushing consensus metadata: real 0.529s user 0.000s sys 0.000s I1010 20:59:18.063069 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 3 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:18.063141 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 3 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a W1010 20:59:18.094123 580 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Time spent flushing consensus metadata: real 0.711s user 0.000s sys 0.000s I1010 20:59:18.094274 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 3 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:18.094301 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 3 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:18.094296 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 3: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:18.094455 262 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 3: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:18.094559 197 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 3 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 3: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:18.094642 432 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 3 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 3: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. W1010 20:59:18.095116 581 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Time spent flushing consensus metadata: real 0.585s user 0.000s sys 0.000s I1010 20:59:18.095309 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 3 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:18.095342 380 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 3: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:18.095350 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 3 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:18.095453 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 3: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:18.095456 379 raft_consensus.cc:1654] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a for term 3 because replica is already servicing an update from a current leader or another vote. I1010 20:59:18.095468 262 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 3: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:18.095535 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 3 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 3: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:18.095574 195 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 3 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 3: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:18.095574 430 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 3 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Service unavailable: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a for term 3 because replica is already servicing an update from a current leader or another vote. I1010 20:59:18.095602 430 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. I1010 20:59:18.095602 195 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. I1010 20:59:18.095710 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 3 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 3: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:18.095723 315 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. I1010 20:59:18.095764 597 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.733s I1010 20:59:18.095777 597 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: None given I1010 20:59:18.095773 596 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.680s I1010 20:59:18.095787 596 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Leader election lost for term 3. Reason: None given I1010 20:59:18.095825 598 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.875s I1010 20:59:18.095851 598 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Leader election lost for term 3. Reason: None given I1010 20:59:21.283804 579 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:21.283826 579 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 3 FOLLOWER]: Advancing to term 4 I1010 20:59:21.284215 579 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.505s I1010 20:59:21.284292 579 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:21.774178 581 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:21.774233 581 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 3 FOLLOWER]: Advancing to term 4 I1010 20:59:21.774547 581 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.661s I1010 20:59:21.774581 581 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:21.929033 580 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:21.929055 580 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 3 FOLLOWER]: Advancing to term 4 I1010 20:59:21.929385 580 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.041s I1010 20:59:21.929419 580 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } W1010 20:59:22.808799 581 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Time spent flushing consensus metadata: real 1.034s user 0.000s sys 0.000s W1010 20:59:22.808799 579 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Time spent flushing consensus metadata: real 1.524s user 0.000s sys 0.004s I1010 20:59:22.808940 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 4 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:22.808954 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 4 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:22.808979 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 4 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:22.808986 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 4 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:22.809131 379 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 4: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:22.809137 262 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 4: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:22.809221 195 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 4 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 4: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:22.809242 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 4 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 4: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. W1010 20:59:22.809602 580 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Time spent flushing consensus metadata: real 0.880s user 0.000s sys 0.000s I1010 20:59:22.809746 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 4 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:22.809782 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 4 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:22.809783 496 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 4: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:22.809824 497 raft_consensus.cc:1654] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e for term 4 because replica is already servicing an update from a current leader or another vote. I1010 20:59:22.809864 379 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 4: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:22.809871 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 4 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 4: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:22.809895 315 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. I1010 20:59:22.809926 197 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 4 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Service unavailable: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e for term 4 because replica is already servicing an update from a current leader or another vote. I1010 20:59:22.809953 197 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. I1010 20:59:22.809969 430 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 4 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 4: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:22.810070 599 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.048s I1010 20:59:22.810093 262 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 4: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:22.810108 599 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Leader election lost for term 4. Reason: None given I1010 20:59:22.810117 600 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.018s I1010 20:59:22.810127 600 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Leader election lost for term 4. Reason: None given I1010 20:59:22.810163 432 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 4 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 4: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:22.810181 432 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. I1010 20:59:22.810350 601 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.717s I1010 20:59:22.810366 601 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: None given I1010 20:59:26.103327 580 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:26.103366 580 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 4 FOLLOWER]: Advancing to term 5 I1010 20:59:26.103811 580 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.638s I1010 20:59:26.103847 580 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:26.347744 579 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:26.347764 579 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 4 FOLLOWER]: Advancing to term 5 I1010 20:59:26.348036 579 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.039s I1010 20:59:26.348080 579 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:26.494025 581 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:26.494050 581 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 4 FOLLOWER]: Advancing to term 5 I1010 20:59:26.494398 581 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.921s I1010 20:59:26.494434 581 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } W1010 20:59:27.837877 580 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Time spent flushing consensus metadata: real 1.734s user 0.000s sys 0.000s I1010 20:59:27.838096 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 5 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:27.838157 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 5 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa W1010 20:59:27.838502 579 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Time spent flushing consensus metadata: real 1.490s user 0.000s sys 0.000s I1010 20:59:27.838642 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 5 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:27.838724 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 5 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:27.838738 262 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 5: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:27.838851 432 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 5 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 5: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:27.838920 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 5: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:27.839018 197 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 5 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 5: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. W1010 20:59:27.871829 581 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Time spent flushing consensus metadata: real 1.377s user 0.000s sys 0.000s I1010 20:59:27.871992 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 5 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:27.872046 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 5 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:27.872061 380 raft_consensus.cc:1654] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e for term 5 because replica is already servicing an update from a current leader or another vote. I1010 20:59:27.872104 379 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 5: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:27.872184 262 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 5: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:27.872184 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 5: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:27.872195 195 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 5 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Service unavailable: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e for term 5 because replica is already servicing an update from a current leader or another vote. I1010 20:59:27.872203 195 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. I1010 20:59:27.872232 430 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 5 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 5: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:27.872262 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 5 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 5: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:27.872264 430 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. I1010 20:59:27.872279 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 5 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 5: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:27.872283 315 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. I1010 20:59:27.872346 604 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.343s I1010 20:59:27.872395 604 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Leader election lost for term 5. Reason: None given I1010 20:59:27.872393 602 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.356s I1010 20:59:27.872402 602 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: None given I1010 20:59:27.872491 603 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.130s I1010 20:59:27.872503 603 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: None given I1010 20:59:31.889010 580 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:31.889140 580 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 5 FOLLOWER]: Advancing to term 6 I1010 20:59:31.889613 580 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.442s I1010 20:59:31.889690 580 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:32.057066 581 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:32.057090 581 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 5 FOLLOWER]: Advancing to term 6 I1010 20:59:32.057368 581 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.143s I1010 20:59:32.057415 581 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:32.444707 579 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:32.444726 579 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 5 FOLLOWER]: Advancing to term 6 I1010 20:59:32.444977 579 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.230s I1010 20:59:32.445008 579 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } W1010 20:59:33.475692 580 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Time spent flushing consensus metadata: real 1.586s user 0.000s sys 0.000s I1010 20:59:33.475885 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 6 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:33.475922 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 6 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa W1010 20:59:33.476461 581 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa: Time spent flushing consensus metadata: real 1.419s user 0.000s sys 0.000s I1010 20:59:33.476624 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 6 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:33.476655 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 6 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:33.476655 379 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 6: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:33.476775 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 6: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:33.476797 430 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 6 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 6: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:33.476881 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 6 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 6: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. W1010 20:59:33.477737 579 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e: Time spent flushing consensus metadata: real 1.033s user 0.000s sys 0.000s I1010 20:59:33.477830 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 6 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:33.477867 262 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 6: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:33.477891 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 6 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:33.477954 261 raft_consensus.cc:1654] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa for term 6 because replica is already servicing an update from a current leader or another vote. I1010 20:59:33.478044 432 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 6 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 6: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:33.478052 379 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 6: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:33.478090 432 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. I1010 20:59:33.478096 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 6 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Service unavailable: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa for term 6 because replica is already servicing an update from a current leader or another vote. I1010 20:59:33.478091 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 6: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:33.478104 315 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. I1010 20:59:33.478160 195 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 6 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 6: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:33.478217 197 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 6 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 6: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:33.478225 197 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. I1010 20:59:33.478320 605 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.566s I1010 20:59:33.478328 606 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.442s I1010 20:59:33.478334 605 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Leader election lost for term 6. Reason: None given I1010 20:59:33.478337 606 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Leader election lost for term 6. Reason: None given I1010 20:59:33.478451 607 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.760s I1010 20:59:33.478488 607 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: None given I1010 20:59:36.996772 580 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:36.996794 580 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 6 FOLLOWER]: Advancing to term 7 I1010 20:59:36.997136 580 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 7 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.491s I1010 20:59:36.997172 580 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 7 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:37.610867 579 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:37.610896 579 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 6 FOLLOWER]: Advancing to term 7 I1010 20:59:37.611325 579 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 7 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.966s I1010 20:59:37.611369 579 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 7 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } I1010 20:59:37.733633 581 raft_consensus.cc:375] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: No leader contacted us within the election timeout. Triggering leader election I1010 20:59:37.733649 581 raft_consensus.cc:2031] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 6 FOLLOWER]: Advancing to term 7 I1010 20:59:37.733963 581 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 7 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.771s I1010 20:59:37.734028 581 raft_consensus.cc:391] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 7 FOLLOWER]: Starting election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b0326d6a607048b08ec7e3bb3e79f82e" member_type: VOTER last_known_addr { host: "127.0.128.0" port: 59041 } } peers { permanent_uuid: "3dd229c6b31f46078f6912755db424aa" member_type: VOTER last_known_addr { host: "127.0.128.1" port: 56847 } } peers { permanent_uuid: "f7c5a4998d4643b895c467337426b93a" member_type: VOTER last_known_addr { host: "127.0.128.2" port: 55652 } } W1010 20:59:37.860455 580 consensus_meta.cc:188] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a: Time spent flushing consensus metadata: real 0.863s user 0.000s sys 0.004s I1010 20:59:37.860620 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 7 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:37.860680 580 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 7 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:37.861733 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 7 election: Requesting vote from peer 3dd229c6b31f46078f6912755db424aa I1010 20:59:37.861758 261 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 7: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:37.861789 579 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 7 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:37.861963 432 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 7 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 7: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:37.861999 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 7: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:37.862221 197 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 7 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e in current term 7: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:37.862743 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 7 election: Requesting vote from peer b0326d6a607048b08ec7e3bb3e79f82e I1010 20:59:37.862787 581 leader_election.cc:223] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 7 election: Requesting vote from peer f7c5a4998d4643b895c467337426b93a I1010 20:59:37.862794 379 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 7: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:37.862874 380 raft_consensus.cc:1654] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e for term 7 because replica is already servicing an update from a current leader or another vote. I1010 20:59:37.862875 261 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 7: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:37.862876 497 raft_consensus.cc:1609] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 7: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:37.862938 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 7 election: Vote denied by peer b0326d6a607048b08ec7e3bb3e79f82e. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 7: Already voted for candidate b0326d6a607048b08ec7e3bb3e79f82e in this term. I1010 20:59:37.862957 315 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 7 election: Vote denied by peer f7c5a4998d4643b895c467337426b93a. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 3dd229c6b31f46078f6912755db424aa in current term 7: Already voted for candidate f7c5a4998d4643b895c467337426b93a in this term. I1010 20:59:37.862959 315 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. I1010 20:59:37.862957 195 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 7 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Service unavailable: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b0326d6a607048b08ec7e3bb3e79f82e for term 7 because replica is already servicing an update from a current leader or another vote. I1010 20:59:37.862952 430 leader_election.cc:361] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 7 election: Vote denied by peer 3dd229c6b31f46078f6912755db424aa. Message: Invalid argument: T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f7c5a4998d4643b895c467337426b93a in current term 7: Already voted for candidate 3dd229c6b31f46078f6912755db424aa in this term. I1010 20:59:37.862965 195 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. I1010 20:59:37.862969 430 leader_election.cc:248] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. I1010 20:59:37.863070 609 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 7 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.273s I1010 20:59:37.863085 609 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P b0326d6a607048b08ec7e3bb3e79f82e [term 7 FOLLOWER]: Leader election lost for term 7. Reason: None given I1010 20:59:37.863106 608 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 7 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 1.537s I1010 20:59:37.863116 608 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P 3dd229c6b31f46078f6912755db424aa [term 7 FOLLOWER]: Leader election lost for term 7. Reason: None given I1010 20:59:37.863118 610 raft_consensus.cc:1981] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 7 FOLLOWER]: Snoozing failure detection for election timeout plus an additional 2.515s I1010 20:59:37.863128 610 raft_consensus.cc:1823] T 1232c6af4b4449588e47fe45b6eb2743 P f7c5a4998d4643b895c467337426b93a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: None given F1010 20:59:39.344202 128 test_workload.cc:207] Check failed: _s.ok() Bad status: Timed out: Timed out waiting for Table Creation *** Check failure stack trace: *** @ 0x5fe5dd google::LogMessage::Fail() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/glog-0.3.4/src/logging.cc:1478 @ 0x6004dd google::LogMessage::SendToLog() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/glog-0.3.4/src/logging.cc:1432 @ 0x5fe119 google::LogMessage::Flush() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/glog-0.3.4/src/logging.cc:1302 @ 0x600f7f google::LogMessageFatal::~LogMessageFatal() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/glog-0.3.4/src/logging.cc:2014 @ 0x5f8df3 kudu::TestWorkload::Setup() at /opt/rh/devtoolset-3/root/usr/include/c++/4.9.2/ext/atomicity.h:67 @ 0x5ae1fc kudu::DeleteTableTest_TestAtomicDeleteTablet_Test::TestBody() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/src/kudu/integration-tests/delete_table-test.cc:332 (discriminator 4) @ 0x889988 testing::internal::HandleExceptionsInMethodIfSupported<>() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2136 @ 0x87ea72 testing::Test::Run() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2151 @ 0x87ebb8 testing::TestInfo::Run() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2326 @ 0x87ec95 testing::TestCase::Run() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2443 @ 0x87ef78 testing::internal::UnitTestImpl::RunAllTests() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:4313 @ 0x889e98 testing::internal::HandleExceptionsInMethodIfSupported<>() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:2136 @ 0x87f25d testing::UnitTest::Run() at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/thirdparty/gmock-1.7.0/gtest/src/gtest.cc:3929 (discriminator 5) @ 0x5a38fd main at /data/10/dinesh/1.0.1/apache-kudu-1.0.1/src/kudu/util/test_main.cc:70 @ 0x7f9931755ec5 __libc_start_main at ??:0 @ 0x5aa411 (unknown) at ??:?