[==========] Running 5 tests from 1 test case. [----------] Global test environment set-up. [----------] 5 tests from TabletCopyClientSessionITest [ RUN ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping I0710 23:26:26.304666 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:40099 --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:26.370754 18610 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:26.371003 18610 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:26.372426 18610 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:26.372472 18610 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:26.372483 18610 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:26.372498 18610 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:26.374766 18610 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:40099 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/info.pb --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:26.379379 18610 master_main.cc:80] Initializing master server... I0710 23:26:26.380089 18610 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 187516us I0710 23:26:26.381155 18610 fs_manager.cc:261] Metadata directory not provided I0710 23:26:26.381214 18610 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:26.381467 18610 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:26.381496 18610 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:26.385457 18610 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/instance: uuid: "3905e211f9f24b0989f67f1c862aaad0" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.385939 18610 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal/instance: uuid: "3905e211f9f24b0989f67f1c862aaad0" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.393126 18610 fs_manager.cc:501] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s I0710 23:26:26.393852 18610 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:26.394121 18610 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:26.397308 18610 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0710 23:26:26.397425 18610 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal uuid: "3905e211f9f24b0989f67f1c862aaad0" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.397505 18610 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:26.449523 18610 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:26.450037 18610 master_main.cc:83] Starting Master server... I0710 23:26:26.453469 18610 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:40099 I0710 23:26:26.453801 18610 webserver.cc:175] Starting webserver on 127.18.43.62:0 I0710 23:26:26.453821 18610 webserver.cc:186] Document root disabled I0710 23:26:26.454195 18610 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:46643/ I0710 23:26:26.454768 18610 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/info.pb I0710 23:26:26.457252 18669 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:26.460499 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 18610 I0710 23:26:26.461010 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:0 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:26.462440 18669 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Bootstrap starting. I0710 23:26:26.464838 18669 tablet_bootstrap.cc:578] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: No blocks or log segments found. Creating new log. I0710 23:26:26.465543 18669 log.cc:525] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Log is configured to *not* fsync() on all Append() calls I0710 23:26:26.466601 18669 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: No bootstrap required, opened a new log I0710 23:26:26.469234 18669 raft_consensus.cc:325] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } I0710 23:26:26.469310 18669 raft_consensus.cc:351] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:26.469332 18669 raft_consensus.cc:630] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3905e211f9f24b0989f67f1c862aaad0, State: Initialized, Role: FOLLOWER I0710 23:26:26.469674 18669 consensus_queue.cc:227] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } I0710 23:26:26.469714 18669 raft_consensus.cc:365] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:26.469748 18669 raft_consensus.cc:457] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:26.469797 18669 raft_consensus.cc:2732] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Snoozing failure detection for 1.808s (starting election) I0710 23:26:26.469817 18669 raft_consensus.cc:2784] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:26.470645 18669 raft_consensus.cc:479] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } I0710 23:26:26.470911 18669 leader_election.cc:278] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:26.471433 18669 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } } I0710 23:26:26.471464 18669 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: This master's current role is: FOLLOWER I0710 23:26:26.471716 18672 raft_consensus.cc:2732] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Snoozing failure detection for 1.598s (election complete) I0710 23:26:26.471745 18672 raft_consensus.cc:2539] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:26.471843 18672 raft_consensus.cc:595] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 1 LEADER]: Becoming Leader. State: Replica: 3905e211f9f24b0989f67f1c862aaad0, State: Running, Role: LEADER I0710 23:26:26.472054 18672 consensus_queue.cc:204] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } I0710 23:26:26.472920 18672 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3905e211f9f24b0989f67f1c862aaad0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } } I0710 23:26:26.472949 18672 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: This master's current role is: LEADER I0710 23:26:26.473057 18672 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3905e211f9f24b0989f67f1c862aaad0. Latest consensus state: current_term: 1 leader_uuid: "3905e211f9f24b0989f67f1c862aaad0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } } I0710 23:26:26.473071 18672 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: This master's current role is: LEADER I0710 23:26:26.473681 18669 sys_catalog.cc:424] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:26.474010 18610 master_main.cc:86] Master server successfully started. W0710 23:26:26.480024 18677 catalog_manager.cc:1075] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0710 23:26:26.480079 18677 catalog_manager.cc:574] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0710 23:26:26.480151 18676 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:26.481197 18676 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:26.504961 18670 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:26.505162 18670 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:26.506397 18670 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:26.506474 18670 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:26.507982 18670 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:26.509881 18676 catalog_manager.cc:915] Generated new certificate authority record I0710 23:26:26.510788 18676 catalog_manager.cc:1037] Loading token signing keys... I0710 23:26:26.511570 18670 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:26.512401 18670 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 187516us I0710 23:26:26.512960 18670 fs_manager.cc:261] Metadata directory not provided I0710 23:26:26.513010 18670 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:26.513248 18670 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:26.513267 18670 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:26.516129 18670 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/instance: uuid: "9c528fbbfce246539f8bcbc2dbe1a353" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.516464 18670 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal/instance: uuid: "9c528fbbfce246539f8bcbc2dbe1a353" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.519944 18676 catalog_manager.cc:4131] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Generated new TSK 0 I0710 23:26:26.522718 18670 fs_manager.cc:501] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s I0710 23:26:26.523421 18670 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:26.523699 18670 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:26.526757 18670 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:26.526893 18670 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "9c528fbbfce246539f8bcbc2dbe1a353" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.527016 18670 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:26.541122 18670 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:26.541949 18670 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:26.542058 18670 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:26.547883 18670 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:35889 I0710 23:26:26.548286 18670 webserver.cc:175] Starting webserver on 127.18.43.1:0 I0710 23:26:26.548316 18670 webserver.cc:186] Document root disabled I0710 23:26:26.548732 18670 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:45729/ I0710 23:26:26.549295 18670 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:26.549679 18670 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:26.556704 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 18670 I0710 23:26:26.557174 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:0 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:26.565148 18799 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:26.565286 18799 heartbeater.cc:426] Registering TS with master... I0710 23:26:26.565682 18799 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... I0710 23:26:26.567358 18636 ts_manager.cc:98] Registered new tserver with Master: 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:26.569007 18636 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:39319 WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:26.596701 18803 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:26.596889 18803 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:26.597664 18803 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:26.597707 18803 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:26.599030 18803 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:26.602440 18803 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:26.603214 18803 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 187516us I0710 23:26:26.603780 18803 fs_manager.cc:261] Metadata directory not provided I0710 23:26:26.603811 18803 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:26.603984 18803 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:26.604001 18803 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:26.606684 18803 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/instance: uuid: "319a0ce5d3df4b83a7c6efed0459c572" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.607009 18803 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal/instance: uuid: "319a0ce5d3df4b83a7c6efed0459c572" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.612211 18803 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s I0710 23:26:26.612954 18803 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:26.613260 18803 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:26.616209 18803 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:26.616327 18803 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "319a0ce5d3df4b83a7c6efed0459c572" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.616410 18803 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:26.634742 18803 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:26.635584 18803 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:26.635769 18803 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:26.641211 18803 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:41321 I0710 23:26:26.641530 18803 webserver.cc:175] Starting webserver on 127.18.43.2:0 I0710 23:26:26.641546 18803 webserver.cc:186] Document root disabled I0710 23:26:26.641901 18803 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:35457/ I0710 23:26:26.642405 18803 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:26.642944 18803 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:26.650861 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 18803 I0710 23:26:26.652334 18922 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:26.652554 18922 heartbeater.cc:426] Registering TS with master... I0710 23:26:26.652942 18922 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... I0710 23:26:26.653947 18636 ts_manager.cc:98] Registered new tserver with Master: 319a0ce5d3df4b83a7c6efed0459c572 (127.18.43.2:41321) I0710 23:26:26.654680 18636 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:35663 I0710 23:26:26.663406 18604 external_mini_cluster.cc:505] 2 TS(s) registered with all masters I0710 23:26:26.675432 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 18803 W0710 23:26:26.678987 18617 connection.cc:512] server connection from 127.18.43.2:35663 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:35663): Connection reset by peer (error 104) I0710 23:26:26.679067 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 18610 W0710 23:26:26.683224 18609 connection.cc:512] client connection to 127.18.43.62:40099 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:40099): Connection reset by peer (error 104) W0710 23:26:26.683266 18690 connection.cc:512] client connection to 127.18.43.62:40099 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:40099): Connection reset by peer (error 104) W0710 23:26:26.683224 18929 connection.cc:512] client connection to 127.18.43.62:40099 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:40099): Connection reset by peer (error 104) I0710 23:26:26.684162 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:40099 --webserver_interface=127.18.43.62 --webserver_port=46643 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:26.730870 18931 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:26.731060 18931 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:26.732005 18931 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:26.732022 18931 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:26.732028 18931 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:26.732034 18931 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:26.734503 18931 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:40099 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/info.pb --webserver_interface=127.18.43.62 --webserver_port=46643 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:26.737782 18931 master_main.cc:80] Initializing master server... I0710 23:26:26.738239 18931 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 187516us I0710 23:26:26.739102 18931 fs_manager.cc:261] Metadata directory not provided I0710 23:26:26.739152 18931 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:26.743134 18931 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s I0710 23:26:26.743705 18931 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:26.743978 18931 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:26.746961 18931 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:26.747526 18931 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal uuid: "3905e211f9f24b0989f67f1c862aaad0" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:26.747650 18931 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:26.776495 18931 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:26.777019 18931 master_main.cc:83] Starting Master server... I0710 23:26:26.780529 18931 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:40099 I0710 23:26:26.780835 18931 webserver.cc:175] Starting webserver on 127.18.43.62:46643 I0710 23:26:26.780853 18931 webserver.cc:186] Document root disabled I0710 23:26:26.781201 18931 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:46643/ I0710 23:26:26.781770 18931 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/master-0/data/info.pb I0710 23:26:26.786631 18990 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Bootstrap starting. I0710 23:26:26.788144 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 18931 I0710 23:26:26.800997 18990 log.cc:525] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Log is configured to *not* fsync() on all Append() calls I0710 23:26:26.806671 18990 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=1} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:26.807090 18990 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Bootstrap complete. I0710 23:26:26.810454 18990 raft_consensus.cc:325] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } I0710 23:26:26.810534 18990 raft_consensus.cc:630] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3905e211f9f24b0989f67f1c862aaad0, State: Initialized, Role: FOLLOWER I0710 23:26:26.810856 18990 consensus_queue.cc:227] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } I0710 23:26:26.810909 18990 raft_consensus.cc:365] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:26.810943 18990 raft_consensus.cc:457] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:26.811000 18990 raft_consensus.cc:2732] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Snoozing failure detection for 2.085s (starting election) I0710 23:26:26.811029 18990 raft_consensus.cc:2784] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:26.812808 18990 raft_consensus.cc:479] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } I0710 23:26:26.813093 18990 leader_election.cc:278] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:26.813474 18993 raft_consensus.cc:2732] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Snoozing failure detection for 1.997s (election complete) I0710 23:26:26.813514 18993 raft_consensus.cc:2539] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:26.813628 18993 raft_consensus.cc:595] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [term 2 LEADER]: Becoming Leader. State: Replica: 3905e211f9f24b0989f67f1c862aaad0, State: Running, Role: LEADER I0710 23:26:26.813854 18993 consensus_queue.cc:204] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } I0710 23:26:26.814618 18993 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3905e211f9f24b0989f67f1c862aaad0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } } I0710 23:26:26.814652 18993 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: This master's current role is: LEADER I0710 23:26:26.814775 18993 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3905e211f9f24b0989f67f1c862aaad0. Latest consensus state: current_term: 2 leader_uuid: "3905e211f9f24b0989f67f1c862aaad0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } } I0710 23:26:26.814792 18993 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: This master's current role is: LEADER I0710 23:26:26.814868 18990 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "3905e211f9f24b0989f67f1c862aaad0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3905e211f9f24b0989f67f1c862aaad0" member_type: VOTER } } I0710 23:26:26.814893 18990 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: This master's current role is: LEADER I0710 23:26:26.815479 18990 sys_catalog.cc:424] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0 [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:26.815861 18997 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:26.815932 18931 master_main.cc:86] Master server successfully started. I0710 23:26:26.818459 18997 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... I0710 23:26:26.820194 18997 catalog_manager.cc:1037] Loading token signing keys... I0710 23:26:26.820794 18997 catalog_manager.cc:4142] T 00000000000000000000000000000000 P 3905e211f9f24b0989f67f1c862aaad0: Loaded TSK: 0 I0710 23:26:27.571688 18799 heartbeater.cc:467] Master 127.18.43.62:40099 was elected leader, sending a full tablet report... I0710 23:26:27.576586 18957 master_service.cc:205] Got heartbeat from unknown tserver (permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" instance_seqno: 1531265186546665) as {username='slave'} at 127.18.43.1:40349; Asking this server to re-register. I0710 23:26:27.577100 18799 heartbeater.cc:426] Registering TS with master... I0710 23:26:27.577225 18799 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... I0710 23:26:27.578027 18957 ts_manager.cc:98] Registered new tserver with Master: 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:27.578601 18604 external_mini_cluster.cc:505] 1 TS(s) registered with all masters I0710 23:26:27.578701 18604 test_util.cc:208] Using random seed: 1972372298 I0710 23:26:27.589504 18957 catalog_manager.cc:1350] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49118: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0710 23:26:27.604456 18723 tablet_service.cc:759] Processing CreateTablet for tablet db0b5751c95748c49ca3272e013e7ee3 (table=test-workload [id=213710b3ff844be79684f232487c1ff9]), partition=RANGE (key) PARTITION UNBOUNDED I0710 23:26:27.604921 18723 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet db0b5751c95748c49ca3272e013e7ee3. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:27.609158 18723 ts_tablet_manager.cc:1173] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:27.610045 19014 ts_tablet_manager.cc:1028] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrapping tablet I0710 23:26:27.610249 19014 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap starting. I0710 23:26:27.611968 19014 tablet_bootstrap.cc:578] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: No blocks or log segments found. Creating new log. I0710 23:26:27.612865 19014 log.cc:525] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Log is configured to *not* fsync() on all Append() calls I0710 23:26:27.613965 19014 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: No bootstrap required, opened a new log I0710 23:26:27.614166 19014 ts_tablet_manager.cc:1045] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0710 23:26:27.616771 19014 raft_consensus.cc:325] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:27.616868 19014 raft_consensus.cc:351] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:27.616911 19014 raft_consensus.cc:630] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c528fbbfce246539f8bcbc2dbe1a353, State: Initialized, Role: FOLLOWER I0710 23:26:27.617324 19014 consensus_queue.cc:227] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:27.617377 19014 raft_consensus.cc:365] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:27.617406 19014 raft_consensus.cc:457] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:27.617457 19014 raft_consensus.cc:2732] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Snoozing failure detection for 2.159s (starting election) I0710 23:26:27.617477 19014 raft_consensus.cc:2784] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:27.618429 19014 raft_consensus.cc:479] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:27.618836 19014 leader_election.cc:278] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:27.619357 19016 raft_consensus.cc:2732] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Snoozing failure detection for 2.188s (election complete) I0710 23:26:27.619396 19016 raft_consensus.cc:2539] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:27.619515 19016 raft_consensus.cc:595] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 1 LEADER]: Becoming Leader. State: Replica: 9c528fbbfce246539f8bcbc2dbe1a353, State: Running, Role: LEADER I0710 23:26:27.619818 19014 ts_tablet_manager.cc:1073] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s I0710 23:26:27.619964 19016 consensus_queue.cc:204] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:27.622830 18957 catalog_manager.cc:3827] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 reported cstate change: term changed from 0 to 1, leader changed from to 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } health_report { overall_health: HEALTHY } } } I0710 23:26:27.936923 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:41321 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_port=35457 --webserver_interface=127.18.43.2 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:27.975944 19031 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:27.976128 19031 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:27.976943 19031 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:27.977011 19031 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:27.978430 19031 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:41321 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=35457 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:27.982048 19031 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:27.982857 19031 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 188016us I0710 23:26:27.983394 19031 fs_manager.cc:261] Metadata directory not provided I0710 23:26:27.983444 19031 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:27.987304 19031 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s I0710 23:26:27.987677 19031 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:27.987915 19031 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:27.990788 19031 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0710 23:26:27.991319 19031 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "319a0ce5d3df4b83a7c6efed0459c572" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:27.991415 19031 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:28.012555 19031 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:28.013358 19031 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:28.013460 19031 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:28.018834 19031 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:41321 I0710 23:26:28.019148 19031 webserver.cc:175] Starting webserver on 127.18.43.2:35457 I0710 23:26:28.019165 19031 webserver.cc:186] Document root disabled I0710 23:26:28.019567 19031 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:35457/ I0710 23:26:28.020364 19031 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:28.020803 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 19031 I0710 23:26:28.020833 19031 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:28.023617 18604 tablet_copy_client_session-itest.cc:143] Starting loop 0 I0710 23:26:28.023670 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 18670 W0710 23:26:28.027580 18609 connection.cc:512] client connection to 127.18.43.1:35889 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:35889): Connection reset by peer (error 104) W0710 23:26:28.027585 18940 connection.cc:512] client connection to 127.18.43.1:35889 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:35889): Connection reset by peer (error 104) W0710 23:26:28.027895 18940 connection.cc:512] server connection from 127.18.43.1:40349 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:40349): Connection reset by peer (error 104) I0710 23:26:28.028255 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:35889 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_port=45729 --webserver_interface=127.18.43.1 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:28.029256 19150 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:28.029376 19150 heartbeater.cc:426] Registering TS with master... I0710 23:26:28.029743 19150 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... I0710 23:26:28.030632 18957 ts_manager.cc:98] Registered new tserver with Master: 319a0ce5d3df4b83a7c6efed0459c572 (127.18.43.2:41321) I0710 23:26:28.031646 18957 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:55791 I0710 23:26:28.034745 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.034960 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.066758 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.066866 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.069452 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.069551 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:28.069483 19158 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:28.069640 19158 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:28.070497 19158 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:28.070559 19158 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:28.071689 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.071790 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.071919 19158 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:35889 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=45729 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:28.075412 19158 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:28.076381 19158 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 188516us I0710 23:26:28.076937 19158 fs_manager.cc:261] Metadata directory not provided I0710 23:26:28.077002 19158 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:28.079229 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.079329 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.080766 19158 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s I0710 23:26:28.081324 19158 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:28.081683 19158 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:28.085099 19158 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:28.085623 19158 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "9c528fbbfce246539f8bcbc2dbe1a353" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:28.085706 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.085758 19158 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:28.085806 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.088526 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.088629 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.094172 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.094311 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.110065 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.110177 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.111793 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.111877 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.126056 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.126161 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.127099 19158 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:28.127936 19158 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0710 23:26:28.127965 19158 ts_tablet_manager.cc:1005] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Loading tablet metadata I0710 23:26:28.130391 19158 ts_tablet_manager.cc:356] Loaded tablet metadata (1 live tablets) I0710 23:26:28.131760 19158 ts_tablet_manager.cc:1173] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:28.132055 19158 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:28.132110 19177 ts_tablet_manager.cc:1028] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrapping tablet I0710 23:26:28.132375 19177 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap starting. I0710 23:26:28.137378 19158 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:35889 I0710 23:26:28.137689 19158 webserver.cc:175] Starting webserver on 127.18.43.1:45729 I0710 23:26:28.137706 19158 webserver.cc:186] Document root disabled I0710 23:26:28.138072 19158 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:45729/ I0710 23:26:28.138582 19158 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:28.138967 19158 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:28.141779 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 19158 I0710 23:26:28.146783 19282 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:28.146926 19282 heartbeater.cc:426] Registering TS with master... I0710 23:26:28.147294 19282 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... I0710 23:26:28.148636 18957 ts_manager.cc:104] Re-registered known tserver with Master: 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.149384 18957 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:50623 I0710 23:26:28.157583 19177 log.cc:525] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Log is configured to *not* fsync() on all Append() calls I0710 23:26:28.160879 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.160982 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.166030 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.166116 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.166330 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.168678 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.168771 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.169201 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.169245 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.169292 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.175091 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.175222 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.175745 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.175796 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.175868 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.197655 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.197753 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.198251 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.198298 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.198354 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.199136 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.199219 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.199636 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.199682 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.199731 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.209015 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.209117 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.209635 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.209722 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.209776 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.233059 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.233172 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.233757 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.233811 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.233871 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.248885 19159 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.249016 19159 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.249765 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.249814 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.249868 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.250488 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.250573 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.250972 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.251035 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.251082 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.257150 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.257254 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.257802 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.257851 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.257905 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.270211 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.270316 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.270895 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.270958 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.271021 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.275146 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.275245 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.275825 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.275884 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.275954 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.286342 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.286444 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.286990 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.287046 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.287117 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.292152 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.292268 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.292889 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.292948 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.293006 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.293721 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.293818 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.294252 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.294297 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.294351 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.309231 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.309346 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.309927 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.309978 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.310047 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.317728 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.317836 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.318408 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.318459 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.318514 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.320147 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.320236 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.320631 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.320677 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.320729 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.333654 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.333760 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.334328 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.334391 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.334457 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.337321 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.337421 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.337908 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.337958 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.338013 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.350236 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.350347 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.350889 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.350944 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.351018 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.356076 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.356184 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.356986 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.357045 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.357096 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.358937 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.359030 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.359524 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.359578 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.359665 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.363569 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.363729 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.364322 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.364373 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.364428 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.368479 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.368579 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.369176 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.369230 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.369309 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.378772 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.378873 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.379348 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.379397 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.379451 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.389611 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.389711 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.390360 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.390410 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.390467 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.400632 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.400732 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.401326 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.401381 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.401443 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.405897 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.406010 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.406608 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.406656 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.406733 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.413031 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.413152 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.413755 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.413810 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.413864 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.425650 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.425765 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.426456 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.426517 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.426579 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.427470 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.427567 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.428004 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.428055 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.428107 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.430583 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.430683 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.431171 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.431221 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.431273 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.439180 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.439283 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.439894 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.439945 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.440001 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.442276 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.442373 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.442826 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.442878 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.442937 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.445778 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.445876 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.446429 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.446478 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.446537 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.465486 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.465591 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.466244 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.466296 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.466351 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.475364 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.475479 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.476090 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.476145 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.476214 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.477147 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.477264 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.477754 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.477799 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.477849 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.490152 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.490255 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.490895 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.490955 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.491011 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.491729 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.491806 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.492408 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.492486 19177 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap replayed 1/1 log segments. Stats: ops{read=214 overwritten=0 applied=214 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:28.492496 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.492564 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.492877 19177 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap complete. I0710 23:26:28.493773 19177 ts_tablet_manager.cc:1045] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Time spent bootstrapping tablet: real 0.362s user 0.351s sys 0.008s I0710 23:26:28.494592 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.494709 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.495196 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.495249 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:28.495302 19259 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:51141: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:28.496309 19177 raft_consensus.cc:325] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:28.496381 19177 raft_consensus.cc:630] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c528fbbfce246539f8bcbc2dbe1a353, State: Initialized, Role: FOLLOWER I0710 23:26:28.496726 19177 consensus_queue.cc:227] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 214, Last appended: 1.214, Last appended by leader: 214, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:28.496771 19177 raft_consensus.cc:365] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:28.496800 19177 raft_consensus.cc:457] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:28.496850 19177 raft_consensus.cc:2732] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Snoozing failure detection for 1.843s (starting election) I0710 23:26:28.496872 19177 raft_consensus.cc:2784] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:28.498116 19177 raft_consensus.cc:479] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:28.498450 19177 leader_election.cc:278] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:28.498844 19287 raft_consensus.cc:2732] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Snoozing failure detection for 1.724s (election complete) I0710 23:26:28.498886 19287 raft_consensus.cc:2539] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:28.499011 19287 raft_consensus.cc:595] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 2 LEADER]: Becoming Leader. State: Replica: 9c528fbbfce246539f8bcbc2dbe1a353, State: Running, Role: LEADER I0710 23:26:28.499037 19282 heartbeater.cc:467] Master 127.18.43.62:40099 was elected leader, sending a full tablet report... I0710 23:26:28.499194 19177 ts_tablet_manager.cc:1073] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Time spent starting tablet: real 0.005s user 0.007s sys 0.000s I0710 23:26:28.499286 19287 consensus_queue.cc:204] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 214, Committed index: 214, Last appended: 1.214, Last appended by leader: 214, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:28.501411 18957 catalog_manager.cc:3827] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } health_report { overall_health: HEALTHY } } } I0710 23:26:28.502600 19161 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:28.502703 19161 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:28.503314 19259 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:51141) I0710 23:26:28.503367 19259 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:51141: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:28.504181 19259 tablet_copy_source_session.cc:202] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:28.506686 19161 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet db0b5751c95748c49ca3272e013e7ee3. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:28.511117 19161 ts_tablet_manager.cc:1173] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:28.511301 19161 tablet_copy_client.cc:566] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Starting download of 0 data blocks... I0710 23:26:28.511412 19161 tablet_copy_client.cc:529] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Starting download of 1 WAL segments... I0710 23:26:28.514549 19161 tablet_copy_client.cc:405] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:28.516121 19161 ts_tablet_manager.cc:1028] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrapping tablet I0710 23:26:28.516386 19161 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap starting. I0710 23:26:28.533159 19161 log.cc:525] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Log is configured to *not* fsync() on all Append() calls I0710 23:26:28.869140 19161 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap replayed 1/1 log segments. Stats: ops{read=215 overwritten=0 applied=215 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:28.869489 19161 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap complete. I0710 23:26:28.869817 19161 ts_tablet_manager.cc:1045] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Time spent bootstrapping tablet: real 0.354s user 0.334s sys 0.017s I0710 23:26:28.871860 19161 raft_consensus.cc:325] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:28.871933 19161 raft_consensus.cc:630] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 319a0ce5d3df4b83a7c6efed0459c572, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:28.872154 19161 consensus_queue.cc:227] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 215, Last appended: 2.215, Last appended by leader: 215, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:28.872591 19150 heartbeater.cc:467] Master 127.18.43.62:40099 was elected leader, sending a full tablet report... I0710 23:26:28.872683 19161 ts_tablet_manager.cc:1073] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Time spent starting tablet: real 0.003s user 0.005s sys 0.000s I0710 23:26:28.873617 19259 tablet_copy_service.cc:325] P 9c528fbbfce246539f8bcbc2dbe1a353: Request end of tablet copy session 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 received from {username='slave'} at 127.18.43.2:51141 I0710 23:26:28.873661 19259 tablet_copy_service.cc:413] P 9c528fbbfce246539f8bcbc2dbe1a353: ending tablet copy session 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 on tablet db0b5751c95748c49ca3272e013e7ee3 with peer 319a0ce5d3df4b83a7c6efed0459c572 W0710 23:26:28.876781 19161 ts_tablet_manager.cc:468] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Tablet Copy: Invalid argument: Leader has replica of tablet db0b5751c95748c49ca3272e013e7ee3 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request W0710 23:26:28.893545 19161 ts_tablet_manager.cc:468] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Tablet Copy: Invalid argument: Leader has replica of tablet db0b5751c95748c49ca3272e013e7ee3 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request W0710 23:26:28.913589 19161 ts_tablet_manager.cc:468] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Tablet Copy: Invalid argument: Leader has replica of tablet db0b5751c95748c49ca3272e013e7ee3 with term 0, which is lower than last-logged term 2 on local replica. Rejecting tablet copy request I0710 23:26:28.915649 19086 tablet_service.cc:800] Processing DeleteTablet for tablet db0b5751c95748c49ca3272e013e7ee3 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:35336 I0710 23:26:28.915961 19296 tablet_replica.cc:261] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: stopping tablet replica I0710 23:26:28.916047 19296 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op CompactRowSetsOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:28.916067 19296 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op MinorDeltaCompactionOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:28.916074 19296 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op MajorDeltaCompactionOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:28.916080 19296 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op UndoDeltaBlockGCOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:28.916113 19296 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op FlushMRSOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:28.916121 19296 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op FlushDeltaMemStoresOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:28.916131 19296 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op LogGCOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:28.916179 19296 raft_consensus.cc:2042] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 2 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:28.916357 19296 raft_consensus.cc:2069] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 2 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:28.917876 19296 ts_tablet_manager.cc:1369] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting tablet data with delete state TABLET_DATA_DELETED I0710 23:26:28.919883 19296 ts_tablet_manager.cc:1382] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.215 I0710 23:26:28.919945 19296 log.cc:986] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting WAL directory at /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal/wals/db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:28.920266 19296 ts_tablet_manager.cc:1403] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting consensus metadata I0710 23:26:28.921842 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 19031 W0710 23:26:28.925251 18938 connection.cc:512] server connection from 127.18.43.2:55791 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:55791): Connection reset by peer (error 104) W0710 23:26:28.925271 19169 connection.cc:512] server connection from 127.18.43.2:51141 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:51141): Connection reset by peer (error 104) W0710 23:26:28.925248 18609 connection.cc:512] client connection to 127.18.43.2:41321 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:41321): Connection reset by peer (error 104) I0710 23:26:28.925614 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:41321 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_port=35457 --webserver_interface=127.18.43.2 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:28.963814 19297 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:28.963989 19297 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:28.964763 19297 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:28.964807 19297 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:28.966171 19297 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:41321 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=35457 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:28.969573 19297 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:28.970409 19297 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 188516us I0710 23:26:28.970944 19297 fs_manager.cc:261] Metadata directory not provided I0710 23:26:28.970978 19297 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:28.974773 19297 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s I0710 23:26:28.975167 19297 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:28.975427 19297 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:28.978487 19297 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:28.979035 19297 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "319a0ce5d3df4b83a7c6efed0459c572" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:28.979133 19297 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:29.002285 19297 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:29.003113 19297 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:29.003209 19297 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:29.008354 19297 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:41321 I0710 23:26:29.008680 19297 webserver.cc:175] Starting webserver on 127.18.43.2:35457 I0710 23:26:29.008697 19297 webserver.cc:186] Document root disabled I0710 23:26:29.009068 19297 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:35457/ I0710 23:26:29.009601 19297 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:29.010035 19297 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:29.017632 19416 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:29.017761 19416 heartbeater.cc:426] Registering TS with master... I0710 23:26:29.018111 19416 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... I0710 23:26:29.018987 18957 ts_manager.cc:104] Re-registered known tserver with Master: 319a0ce5d3df4b83a7c6efed0459c572 (127.18.43.2:41321) I0710 23:26:29.019498 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 19297 I0710 23:26:29.019582 18604 tablet_copy_client_session-itest.cc:143] Starting loop 1 I0710 23:26:29.019623 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 19158 I0710 23:26:29.019683 18957 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:58869 W0710 23:26:29.023330 18941 connection.cc:512] server connection from 127.18.43.1:50623 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:50623): Connection reset by peer (error 104) I0710 23:26:29.023887 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:35889 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_port=45729 --webserver_interface=127.18.43.1 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:29.030467 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.030664 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.035235 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.035331 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.038126 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.038226 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:29.062943 19425 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:29.063129 19425 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0710 23:26:29.063252 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.063366 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 W0710 23:26:29.063920 19425 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:29.063967 19425 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:29.065310 19425 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:35889 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=45729 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:29.068661 19425 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:29.069429 19425 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 189016us I0710 23:26:29.069922 19425 fs_manager.cc:261] Metadata directory not provided I0710 23:26:29.069952 19425 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:29.073603 19425 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:29.074102 19425 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:29.074362 19425 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:29.074525 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.074622 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.077143 19425 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0710 23:26:29.077695 19425 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "9c528fbbfce246539f8bcbc2dbe1a353" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:29.077791 19425 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:29.078536 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.078627 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.083007 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.083111 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.085618 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.085716 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.097404 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.097517 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.105074 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.105181 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.110777 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.110878 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.111536 19425 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:29.112433 19425 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0710 23:26:29.112465 19425 ts_tablet_manager.cc:1005] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Loading tablet metadata I0710 23:26:29.112924 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.112999 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.114876 19425 ts_tablet_manager.cc:356] Loaded tablet metadata (1 live tablets) I0710 23:26:29.116173 19425 ts_tablet_manager.cc:1173] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:29.116466 19425 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:29.116525 19445 ts_tablet_manager.cc:1028] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrapping tablet I0710 23:26:29.116768 19445 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap starting. I0710 23:26:29.121922 19425 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:35889 I0710 23:26:29.122239 19425 webserver.cc:175] Starting webserver on 127.18.43.1:45729 I0710 23:26:29.122256 19425 webserver.cc:186] Document root disabled I0710 23:26:29.122624 19425 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:45729/ I0710 23:26:29.123144 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.123157 19425 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:29.123236 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.123507 19425 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:29.127660 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 19425 I0710 23:26:29.131085 19550 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:29.131201 19550 heartbeater.cc:426] Registering TS with master... I0710 23:26:29.131242 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.131357 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:29.131547 19550 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... W0710 23:26:29.131556 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.133548 18957 ts_manager.cc:104] Re-registered known tserver with Master: 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.134320 18957 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:47563 I0710 23:26:29.135066 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.135169 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.135682 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.135735 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.135798 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.141325 19445 log.cc:525] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Log is configured to *not* fsync() on all Append() calls I0710 23:26:29.155017 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.155117 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.155681 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.155730 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.155786 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.158744 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.158838 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.159333 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.159399 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.159454 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.160660 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.160742 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.161134 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.161175 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.161221 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.165082 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.165174 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.165704 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.165757 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.165807 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.191787 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.191891 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.192457 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.192512 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.192564 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.199035 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.199132 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.199687 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.199735 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.199787 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.201836 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.201922 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.202358 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.202410 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.202462 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.204164 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.204241 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.204710 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.204754 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.204799 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.210947 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.211041 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.211627 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.211680 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.211733 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.213109 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.213199 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.213618 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.213661 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.213707 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.230954 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.231071 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.231672 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.231722 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.231778 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.249269 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.249367 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.249881 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.249933 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.249985 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.251720 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.251809 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.252246 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.252297 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.252351 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.258078 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.258188 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.258751 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.258802 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.258862 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.262025 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.262135 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.262699 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.262751 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.262807 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.275179 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.275291 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.275950 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.276006 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.276067 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.284178 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.284277 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.284807 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.284859 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.284915 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.293304 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.293404 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.293922 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.293975 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.294034 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.301448 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.301575 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.302103 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.302153 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.302212 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.313333 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.313438 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.313990 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.314035 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.314092 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.318264 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.318363 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.318933 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.318984 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.319047 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.326231 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.326323 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.326843 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.326896 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.326951 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.333562 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.333663 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.334183 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.334234 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.334290 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.347225 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.347371 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.347908 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.347960 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.348011 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.359076 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.359174 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.359750 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.359805 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.359942 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.366756 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.366883 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.367557 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.367631 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.367691 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.374089 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.374191 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.374843 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.374897 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.374956 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.377851 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.377946 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.378420 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.378471 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.378530 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.382637 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.382740 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.383208 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.383260 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.383312 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.397377 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.397491 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.398083 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.398135 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.398187 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.409036 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.409142 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.409720 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.409771 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.409839 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.415721 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.415827 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.416385 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.416441 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.416498 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.417258 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.417330 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.417713 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.417752 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.417796 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.418375 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.418444 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.418799 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.418848 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.418895 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.434878 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.434983 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.435534 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.435621 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.435685 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.438637 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.438733 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.439301 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.439352 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.439404 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.444046 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.444146 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.444727 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.444774 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.444825 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.445515 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.445595 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.445928 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.445974 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.446019 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.457690 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.457788 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.458297 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.458348 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.458415 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.462157 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.462270 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.462792 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.462837 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.462888 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.464116 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.464203 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.464666 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.464715 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.464766 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.473076 19445 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap replayed 1/1 log segments. Stats: ops{read=215 overwritten=0 applied=215 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:29.473476 19445 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap complete. I0710 23:26:29.474382 19445 ts_tablet_manager.cc:1045] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Time spent bootstrapping tablet: real 0.358s user 0.338s sys 0.016s I0710 23:26:29.475008 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.475114 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.475805 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.475864 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.475919 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.477280 19445 raft_consensus.cc:325] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:29.477373 19445 raft_consensus.cc:630] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c528fbbfce246539f8bcbc2dbe1a353, State: Initialized, Role: FOLLOWER I0710 23:26:29.477638 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.477793 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.477854 19445 consensus_queue.cc:227] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 215, Last appended: 2.215, Last appended by leader: 215, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:29.477912 19445 raft_consensus.cc:365] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:29.477946 19445 raft_consensus.cc:457] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:29.478001 19445 raft_consensus.cc:2732] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Snoozing failure detection for 1.631s (starting election) I0710 23:26:29.478025 19445 raft_consensus.cc:2784] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 2 FOLLOWER]: Advancing to term 3 I0710 23:26:29.478240 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.478302 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:29.478355 19527 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:46749: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:29.479310 19445 raft_consensus.cc:479] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:29.479662 19445 leader_election.cc:278] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. I0710 23:26:29.480072 19555 raft_consensus.cc:2732] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Snoozing failure detection for 2.009s (election complete) I0710 23:26:29.480111 19555 raft_consensus.cc:2539] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 3 FOLLOWER]: Leader election won for term 3 I0710 23:26:29.480232 19555 raft_consensus.cc:595] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 3 LEADER]: Becoming Leader. State: Replica: 9c528fbbfce246539f8bcbc2dbe1a353, State: Running, Role: LEADER I0710 23:26:29.480255 19550 heartbeater.cc:467] Master 127.18.43.62:40099 was elected leader, sending a full tablet report... I0710 23:26:29.480417 19445 ts_tablet_manager.cc:1073] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Time spent starting tablet: real 0.006s user 0.009s sys 0.000s I0710 23:26:29.480490 19555 consensus_queue.cc:204] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 215, Committed index: 215, Last appended: 2.215, Last appended by leader: 215, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:29.482671 18957 catalog_manager.cc:3827] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 reported cstate change: term changed from 2 to 3. New cstate: current_term: 3 leader_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } health_report { overall_health: HEALTHY } } } I0710 23:26:29.484485 19427 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:29.484593 19427 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:29.485143 19527 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:46749) I0710 23:26:29.485194 19527 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:46749: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:29.486013 19527 tablet_copy_source_session.cc:202] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:29.488615 19427 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet db0b5751c95748c49ca3272e013e7ee3. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:29.492986 19427 ts_tablet_manager.cc:1173] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:29.493152 19427 tablet_copy_client.cc:566] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Starting download of 0 data blocks... I0710 23:26:29.493273 19427 tablet_copy_client.cc:529] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Starting download of 1 WAL segments... I0710 23:26:29.496548 19427 tablet_copy_client.cc:405] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:29.498092 19427 ts_tablet_manager.cc:1028] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrapping tablet I0710 23:26:29.498351 19427 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap starting. I0710 23:26:29.515151 19427 log.cc:525] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Log is configured to *not* fsync() on all Append() calls I0710 23:26:29.882344 19427 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=216 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:29.882724 19427 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap complete. I0710 23:26:29.883085 19427 ts_tablet_manager.cc:1045] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Time spent bootstrapping tablet: real 0.385s user 0.370s sys 0.013s I0710 23:26:29.885337 19427 raft_consensus.cc:325] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 3 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:29.885432 19427 raft_consensus.cc:630] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 3 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 319a0ce5d3df4b83a7c6efed0459c572, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:29.885768 19427 consensus_queue.cc:227] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 216, Last appended: 3.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:29.886178 19416 heartbeater.cc:467] Master 127.18.43.62:40099 was elected leader, sending a full tablet report... I0710 23:26:29.886381 19427 ts_tablet_manager.cc:1073] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s I0710 23:26:29.887024 19527 tablet_copy_service.cc:325] P 9c528fbbfce246539f8bcbc2dbe1a353: Request end of tablet copy session 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 received from {username='slave'} at 127.18.43.2:46749 I0710 23:26:29.887066 19527 tablet_copy_service.cc:413] P 9c528fbbfce246539f8bcbc2dbe1a353: ending tablet copy session 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 on tablet db0b5751c95748c49ca3272e013e7ee3 with peer 319a0ce5d3df4b83a7c6efed0459c572 W0710 23:26:29.895387 19427 ts_tablet_manager.cc:468] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Tablet Copy: Invalid argument: Leader has replica of tablet db0b5751c95748c49ca3272e013e7ee3 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request W0710 23:26:29.908776 19427 ts_tablet_manager.cc:468] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Tablet Copy: Invalid argument: Leader has replica of tablet db0b5751c95748c49ca3272e013e7ee3 with term 0, which is lower than last-logged term 3 on local replica. Rejecting tablet copy request I0710 23:26:29.910931 19353 tablet_service.cc:800] Processing DeleteTablet for tablet db0b5751c95748c49ca3272e013e7ee3 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:35338 I0710 23:26:29.911252 19564 tablet_replica.cc:261] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: stopping tablet replica I0710 23:26:29.911352 19564 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op CompactRowSetsOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:29.911375 19564 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op MinorDeltaCompactionOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:29.911388 19564 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op MajorDeltaCompactionOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:29.911401 19564 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op UndoDeltaBlockGCOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:29.911448 19564 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op FlushMRSOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:29.911459 19564 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op FlushDeltaMemStoresOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:29.911466 19564 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op LogGCOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:29.911525 19564 raft_consensus.cc:2042] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 3 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:29.911737 19564 raft_consensus.cc:2069] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 3 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:29.913297 19564 ts_tablet_manager.cc:1369] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting tablet data with delete state TABLET_DATA_DELETED I0710 23:26:29.915109 19564 ts_tablet_manager.cc:1382] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 3.216 I0710 23:26:29.915169 19564 log.cc:986] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting WAL directory at /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal/wals/db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:29.915518 19564 ts_tablet_manager.cc:1403] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting consensus metadata I0710 23:26:29.917155 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 19297 W0710 23:26:29.922010 18609 connection.cc:512] client connection to 127.18.43.2:41321 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:41321): Connection reset by peer (error 104) W0710 23:26:29.922014 19438 connection.cc:512] server connection from 127.18.43.2:46749 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:46749): Connection reset by peer (error 104) W0710 23:26:29.922024 18938 connection.cc:512] server connection from 127.18.43.2:58869 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:58869): Connection reset by peer (error 104) I0710 23:26:29.922469 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:41321 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_port=35457 --webserver_interface=127.18.43.2 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:29.962110 19565 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:29.962308 19565 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:29.963112 19565 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:29.963176 19565 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:29.964658 19565 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:41321 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=35457 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:29.968261 19565 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:29.969048 19565 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 189016us I0710 23:26:29.969594 19565 fs_manager.cc:261] Metadata directory not provided I0710 23:26:29.969629 19565 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:29.973394 19565 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:29.973824 19565 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:29.974087 19565 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:29.976991 19565 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:29.977548 19565 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "319a0ce5d3df4b83a7c6efed0459c572" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:29.977669 19565 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:29.999251 19565 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:30.000344 19565 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:30.000468 19565 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:30.005918 19565 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:41321 I0710 23:26:30.006266 19565 webserver.cc:175] Starting webserver on 127.18.43.2:35457 I0710 23:26:30.006286 19565 webserver.cc:186] Document root disabled I0710 23:26:30.006711 19565 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:35457/ I0710 23:26:30.007304 19565 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:30.007788 19565 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:30.015413 19684 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:30.015544 19684 heartbeater.cc:426] Registering TS with master... I0710 23:26:30.015955 19684 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... I0710 23:26:30.016345 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 19565 I0710 23:26:30.016448 18604 tablet_copy_client_session-itest.cc:143] Starting loop 2 I0710 23:26:30.016477 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 19425 I0710 23:26:30.016919 18957 ts_manager.cc:104] Re-registered known tserver with Master: 319a0ce5d3df4b83a7c6efed0459c572 (127.18.43.2:41321) I0710 23:26:30.017771 18957 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:53319 W0710 23:26:30.021437 18939 connection.cc:512] server connection from 127.18.43.1:47563 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:47563): Connection reset by peer (error 104) I0710 23:26:30.022014 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:35889 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_port=45729 --webserver_interface=127.18.43.1 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:30.029853 19695 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.030107 19695 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.031761 19695 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.031947 19695 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.061410 19695 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.061544 19695 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.062789 19695 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.062888 19695 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.063889 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) WARNING: Logging before InitGoogleLogging() is written to STDERR I0710 23:26:30.064033 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 W0710 23:26:30.063894 19693 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:30.064098 19693 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:30.065240 19693 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:30.065316 19693 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:30.066390 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.066484 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.066951 19693 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:35889 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=45729 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:30.070611 19693 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:30.071403 19693 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 189516us I0710 23:26:30.071969 19693 fs_manager.cc:261] Metadata directory not provided I0710 23:26:30.072013 19693 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:30.075984 19693 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s I0710 23:26:30.076464 19693 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:30.076733 19693 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:30.079959 19693 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:30.080545 19693 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "9c528fbbfce246539f8bcbc2dbe1a353" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:30.080659 19693 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:30.081776 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.081879 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.097143 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.097295 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.105785 19693 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:30.106717 19693 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0710 23:26:30.106751 19693 ts_tablet_manager.cc:1005] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Loading tablet metadata I0710 23:26:30.107028 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.107125 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.109377 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.109477 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.110121 19693 ts_tablet_manager.cc:356] Loaded tablet metadata (1 live tablets) I0710 23:26:30.111702 19693 ts_tablet_manager.cc:1173] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:30.111994 19693 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:30.115504 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.115654 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.115746 19713 ts_tablet_manager.cc:1028] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrapping tablet I0710 23:26:30.116047 19713 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap starting. I0710 23:26:30.122156 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.122189 19693 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:35889 I0710 23:26:30.122279 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.122535 19693 webserver.cc:175] Starting webserver on 127.18.43.1:45729 I0710 23:26:30.122557 19693 webserver.cc:186] Document root disabled I0710 23:26:30.122987 19693 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:45729/ I0710 23:26:30.126230 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 19693 I0710 23:26:30.128386 19693 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:30.128959 19693 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:30.140445 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.140441 19818 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:30.140558 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:30.140625 19818 heartbeater.cc:426] Registering TS with master... W0710 23:26:30.140785 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.141055 19818 heartbeater.cc:475] Master 127.18.43.62:40099 requested a full tablet report, sending... I0710 23:26:30.142351 18957 ts_manager.cc:104] Re-registered known tserver with Master: 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.143283 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.143435 18957 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:53997 I0710 23:26:30.143471 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.144170 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.144232 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.144302 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.151861 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.151978 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.152613 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.152678 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.152751 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.153450 19713 log.cc:525] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Log is configured to *not* fsync() on all Append() calls I0710 23:26:30.174949 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.175065 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.175693 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.175750 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.175820 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.183959 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.184064 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.184612 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.184660 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.184720 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.192585 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.192705 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.193315 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.193382 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.193451 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.194330 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.194424 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.194808 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.194864 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.194926 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.195565 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.195672 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.196064 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.196111 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.196167 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.207547 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.207681 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.208266 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.208312 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.208374 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.211838 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.211944 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.212512 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.212558 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.212618 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.217011 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.217133 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.217681 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.217741 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.217838 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.225131 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.225235 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.225822 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.225872 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.225930 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.233502 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.233611 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.234248 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.234304 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.234365 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.241163 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.241272 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.241798 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.241871 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.241930 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.245553 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.245657 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.246176 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.246228 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.246296 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.268193 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.268299 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.268918 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.268967 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.269026 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.271651 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.271766 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.272222 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.272306 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.272357 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.278589 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.278697 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.279261 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.279311 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.279368 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.285583 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.285692 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.286298 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.286358 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.286432 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.289451 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.289557 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.290112 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.290171 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.290282 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.298535 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.298636 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.299230 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.299293 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.299379 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.306859 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.306984 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.307636 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.307695 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.307765 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.316525 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.316711 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.317275 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.317328 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.317394 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.322839 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.322952 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.323534 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.323585 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.323674 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.325851 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.325953 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.326453 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.326501 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.326562 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.335480 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.335587 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.336212 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.336263 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.336323 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.340435 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.340544 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.341141 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.341204 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.341269 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.353752 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.353863 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.354419 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.354477 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.354538 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.364576 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.364689 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.365248 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.365305 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.365391 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.373869 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.373981 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.374567 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.374624 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.374686 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.382026 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.382139 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.382733 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.382794 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.382863 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.388942 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.389050 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.389633 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.389680 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.389741 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.414036 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.414163 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.414877 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.414943 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.415015 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.420042 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.420163 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.420831 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.420895 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.420967 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.431211 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.431340 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.431987 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.432044 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.432109 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.440270 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.440387 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.440965 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.441023 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.441092 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.456598 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.456715 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.457254 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.457319 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.457412 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.465613 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.465726 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.466344 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.466426 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.466496 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.480101 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.480226 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.480865 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.480926 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.480988 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.483285 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.483415 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.483939 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.483999 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.484084 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.485275 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.485375 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.485875 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.485921 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.485973 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.492645 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.492765 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.493322 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.493381 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.493459 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.498230 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.498355 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.498930 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.498987 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.499053 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.504602 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.504722 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.505273 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.505328 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.505393 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.508363 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.508478 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.508981 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.509034 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.509099 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.528661 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.528784 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.529441 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.529495 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.529566 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.531312 19713 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap replayed 1/1 log segments. Stats: ops{read=216 overwritten=0 applied=216 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:30.531615 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.531718 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.531836 19713 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Bootstrap complete. I0710 23:26:30.532243 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.532299 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 W0710 23:26:30.532377 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.532877 19713 ts_tablet_manager.cc:1045] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Time spent bootstrapping tablet: real 0.417s user 0.375s sys 0.032s I0710 23:26:30.535820 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.535843 19713 raft_consensus.cc:325] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:30.535930 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.535964 19713 raft_consensus.cc:630] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9c528fbbfce246539f8bcbc2dbe1a353, State: Initialized, Role: FOLLOWER I0710 23:26:30.536432 19713 consensus_queue.cc:227] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 216, Last appended: 3.216, Last appended by leader: 216, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:30.536447 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.536499 19713 raft_consensus.cc:365] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 3 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:30.536504 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:30.536543 19713 raft_consensus.cc:457] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 3 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) W0710 23:26:30.536586 19795 tablet_copy_service.cc:458] P 9c528fbbfce246539f8bcbc2dbe1a353: Error handling TabletCopyService RPC request from {username='slave'} at 127.18.43.2:37805: Error beginning tablet copy session for tablet db0b5751c95748c49ca3272e013e7ee3: Illegal state: The tablet is not in a running state: BOOTSTRAPPING I0710 23:26:30.536617 19713 raft_consensus.cc:2732] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Snoozing failure detection for 2.102s (starting election) I0710 23:26:30.536648 19713 raft_consensus.cc:2784] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 3 FOLLOWER]: Advancing to term 4 I0710 23:26:30.538215 19713 raft_consensus.cc:479] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:30.538568 19713 leader_election.cc:278] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. I0710 23:26:30.539036 19823 raft_consensus.cc:2732] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Snoozing failure detection for 2.054s (election complete) I0710 23:26:30.539079 19823 raft_consensus.cc:2539] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 4 FOLLOWER]: Leader election won for term 4 I0710 23:26:30.539217 19823 raft_consensus.cc:595] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [term 4 LEADER]: Becoming Leader. State: Replica: 9c528fbbfce246539f8bcbc2dbe1a353, State: Running, Role: LEADER I0710 23:26:30.539270 19818 heartbeater.cc:467] Master 127.18.43.62:40099 was elected leader, sending a full tablet report... I0710 23:26:30.539480 19713 ts_tablet_manager.cc:1073] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s I0710 23:26:30.539541 19823 consensus_queue.cc:204] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 216, Committed index: 216, Last appended: 3.216, Last appended by leader: 216, Current term: 4, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:30.541986 18957 catalog_manager.cc:3827] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353 reported cstate change: term changed from 3 to 4. New cstate: current_term: 4 leader_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } health_report { overall_health: HEALTHY } } } I0710 23:26:30.555258 19696 ts_tablet_manager.cc:669] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Initiating tablet copy from peer 9c528fbbfce246539f8bcbc2dbe1a353 (127.18.43.1:35889) I0710 23:26:30.555382 19696 tablet_copy_client.cc:239] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:35889 I0710 23:26:30.556119 19795 tablet_copy_service.cc:135] P 9c528fbbfce246539f8bcbc2dbe1a353: Received BeginTabletCopySession request for tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 ({username='slave'} at 127.18.43.2:37805) I0710 23:26:30.556193 19795 tablet_copy_service.cc:156] P 9c528fbbfce246539f8bcbc2dbe1a353: Beginning new tablet copy session on tablet db0b5751c95748c49ca3272e013e7ee3 from peer 319a0ce5d3df4b83a7c6efed0459c572 at {username='slave'} at 127.18.43.2:37805: session id = 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:30.557286 19795 tablet_copy_source_session.cc:202] T db0b5751c95748c49ca3272e013e7ee3 P 9c528fbbfce246539f8bcbc2dbe1a353: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:30.560367 19696 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet db0b5751c95748c49ca3272e013e7ee3. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:30.565876 19696 ts_tablet_manager.cc:1173] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:30.566015 19696 tablet_copy_client.cc:566] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Starting download of 0 data blocks... I0710 23:26:30.566144 19696 tablet_copy_client.cc:529] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Starting download of 1 WAL segments... I0710 23:26:30.569389 19696 tablet_copy_client.cc:405] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:30.570950 19696 ts_tablet_manager.cc:1028] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrapping tablet I0710 23:26:30.571202 19696 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap starting. I0710 23:26:30.591279 19696 log.cc:525] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Log is configured to *not* fsync() on all Append() calls I0710 23:26:30.971717 19696 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap replayed 1/1 log segments. Stats: ops{read=217 overwritten=0 applied=217 ignored=0} inserts{seen=10650 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:30.972033 19696 tablet_bootstrap.cc:427] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Bootstrap complete. I0710 23:26:30.972367 19696 ts_tablet_manager.cc:1045] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Time spent bootstrapping tablet: real 0.401s user 0.390s sys 0.012s I0710 23:26:30.974499 19696 raft_consensus.cc:325] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 4 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:30.974571 19696 raft_consensus.cc:630] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 4 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 319a0ce5d3df4b83a7c6efed0459c572, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:30.974828 19696 consensus_queue.cc:227] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 217, Last appended: 4.217, Last appended by leader: 217, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9c528fbbfce246539f8bcbc2dbe1a353" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 35889 } } I0710 23:26:30.975250 19684 heartbeater.cc:467] Master 127.18.43.62:40099 was elected leader, sending a full tablet report... I0710 23:26:30.975405 19696 ts_tablet_manager.cc:1073] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s I0710 23:26:30.976858 19795 tablet_copy_service.cc:325] P 9c528fbbfce246539f8bcbc2dbe1a353: Request end of tablet copy session 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 received from {username='slave'} at 127.18.43.2:37805 I0710 23:26:30.976902 19795 tablet_copy_service.cc:413] P 9c528fbbfce246539f8bcbc2dbe1a353: ending tablet copy session 319a0ce5d3df4b83a7c6efed0459c572-db0b5751c95748c49ca3272e013e7ee3 on tablet db0b5751c95748c49ca3272e013e7ee3 with peer 319a0ce5d3df4b83a7c6efed0459c572 W0710 23:26:30.984235 19696 ts_tablet_manager.cc:468] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Tablet Copy: Invalid argument: Leader has replica of tablet db0b5751c95748c49ca3272e013e7ee3 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request W0710 23:26:30.997529 19696 ts_tablet_manager.cc:468] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Tablet Copy: Invalid argument: Leader has replica of tablet db0b5751c95748c49ca3272e013e7ee3 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request W0710 23:26:31.018543 19696 ts_tablet_manager.cc:468] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Tablet Copy: Invalid argument: Leader has replica of tablet db0b5751c95748c49ca3272e013e7ee3 with term 0, which is lower than last-logged term 4 on local replica. Rejecting tablet copy request I0710 23:26:31.020838 19621 tablet_service.cc:800] Processing DeleteTablet for tablet db0b5751c95748c49ca3272e013e7ee3 with delete_type TABLET_DATA_DELETED from {username='slave'} at 127.0.0.1:35340 I0710 23:26:31.021153 19834 tablet_replica.cc:261] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: stopping tablet replica I0710 23:26:31.021241 19834 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op CompactRowSetsOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:31.021263 19834 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op MinorDeltaCompactionOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:31.021276 19834 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op MajorDeltaCompactionOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:31.021288 19834 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op UndoDeltaBlockGCOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:31.021337 19834 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op FlushMRSOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:31.021348 19834 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op FlushDeltaMemStoresOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:31.021355 19834 maintenance_manager.cc:237] P 319a0ce5d3df4b83a7c6efed0459c572: Unregistered op LogGCOp(db0b5751c95748c49ca3272e013e7ee3) I0710 23:26:31.021416 19834 raft_consensus.cc:2042] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 4 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:31.021577 19834 raft_consensus.cc:2069] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572 [term 4 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:31.023043 19834 ts_tablet_manager.cc:1369] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting tablet data with delete state TABLET_DATA_DELETED I0710 23:26:31.024950 19834 ts_tablet_manager.cc:1382] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 4.217 I0710 23:26:31.025004 19834 log.cc:986] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting WAL directory at /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal/wals/db0b5751c95748c49ca3272e013e7ee3 I0710 23:26:31.025379 19834 ts_tablet_manager.cc:1403] T db0b5751c95748c49ca3272e013e7ee3 P 319a0ce5d3df4b83a7c6efed0459c572: Deleting consensus metadata I0710 23:26:31.026998 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 19565 W0710 23:26:31.031225 18940 connection.cc:512] server connection from 127.18.43.2:53319 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:53319): Connection reset by peer (error 104) W0710 23:26:31.031225 18609 connection.cc:512] client connection to 127.18.43.2:41321 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:41321): Connection reset by peer (error 104) W0710 23:26:31.031241 19708 connection.cc:512] server connection from 127.18.43.2:37805 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:37805): Connection reset by peer (error 104) I0710 23:26:31.031730 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:41321 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_port=35457 --webserver_interface=127.18.43.2 --tserver_master_addrs=127.18.43.62:40099 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:31.070812 19835 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:31.070996 19835 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:31.071846 19835 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:31.071903 19835 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:31.073326 19835 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:41321 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=35457 --tserver_master_addrs=127.18.43.62:40099 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:31.076936 19835 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:31.077771 19835 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 190016us I0710 23:26:31.078336 19835 fs_manager.cc:261] Metadata directory not provided I0710 23:26:31.078372 19835 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:31.082190 19835 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:31.082610 19835 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:31.082885 19835 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:31.085831 19835 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:31.086405 19835 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "319a0ce5d3df4b83a7c6efed0459c572" format_stamp: "Formatted at 2018-07-10 23:26:26 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.086524 19835 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:31.100396 19835 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:31.101269 19835 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:31.101392 19835 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:31.107295 19835 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:41321 I0710 23:26:31.107674 19835 webserver.cc:175] Starting webserver on 127.18.43.2:35457 I0710 23:26:31.107693 19835 webserver.cc:186] Document root disabled I0710 23:26:31.108124 19835 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:35457/ I0710 23:26:31.108836 19835 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:31.109330 19835 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:31.115475 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 19835 I0710 23:26:31.115681 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 19693 W0710 23:26:31.120846 18941 connection.cc:512] server connection from 127.18.43.1:53997 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:53997): Connection reset by peer (error 104) I0710 23:26:31.121104 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 19835 I0710 23:26:31.121181 19954 heartbeater.cc:346] Connected to a master server at 127.18.43.62:40099 I0710 23:26:31.121351 19954 heartbeater.cc:426] Registering TS with master... W0710 23:26:31.125901 18939 connection.cc:512] server connection from 127.18.43.2:37311 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:37311): Connection reset by peer (error 104) I0710 23:26:31.126054 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 18931 W0710 23:26:31.130234 18609 connection.cc:512] client connection to 127.18.43.62:40099 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:40099): Connection reset by peer (error 104) [ OK ] TabletCopyClientSessionITest.TestStartTabletCopyWhileSourceBootstrapping (4838 ms) [ RUN ] TabletCopyClientSessionITest.TestStartTabletCopy I0710 23:26:31.136099 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:37213 --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:31.182381 19959 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:31.182565 19959 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:31.183462 19959 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:31.183485 19959 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:31.183490 19959 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:31.183497 19959 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:31.184988 19959 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:37213 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/info.pb --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:31.188277 19959 master_main.cc:80] Initializing master server... I0710 23:26:31.188726 19959 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 190016us I0710 23:26:31.189510 19959 fs_manager.cc:261] Metadata directory not provided I0710 23:26:31.189548 19959 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:31.189721 19959 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:31.189736 19959 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:31.192361 19959 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/instance: uuid: "f1580978ad884ae5ae5e855c7b484dff" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.192641 19959 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal/instance: uuid: "f1580978ad884ae5ae5e855c7b484dff" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.197609 19959 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s I0710 23:26:31.198292 19959 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:31.198539 19959 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:31.201408 19959 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0710 23:26:31.201521 19959 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal uuid: "f1580978ad884ae5ae5e855c7b484dff" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.201601 19959 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:31.219735 19959 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:31.220268 19959 master_main.cc:83] Starting Master server... I0710 23:26:31.223472 19959 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:37213 I0710 23:26:31.223789 19959 webserver.cc:175] Starting webserver on 127.18.43.62:0 I0710 23:26:31.223807 19959 webserver.cc:186] Document root disabled I0710 23:26:31.224167 19959 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:44015/ I0710 23:26:31.224678 19959 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/info.pb I0710 23:26:31.227027 20018 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:31.229789 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 19959 I0710 23:26:31.230207 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:0 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:37213 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:31.232107 20018 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Bootstrap starting. I0710 23:26:31.234371 20018 tablet_bootstrap.cc:578] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: No blocks or log segments found. Creating new log. I0710 23:26:31.235267 20018 log.cc:525] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Log is configured to *not* fsync() on all Append() calls I0710 23:26:31.236678 20018 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: No bootstrap required, opened a new log I0710 23:26:31.239375 20018 raft_consensus.cc:325] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } I0710 23:26:31.239440 20018 raft_consensus.cc:351] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:31.239465 20018 raft_consensus.cc:630] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1580978ad884ae5ae5e855c7b484dff, State: Initialized, Role: FOLLOWER I0710 23:26:31.239900 20018 consensus_queue.cc:227] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } I0710 23:26:31.239959 20018 raft_consensus.cc:365] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:31.239997 20018 raft_consensus.cc:457] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:31.240058 20018 raft_consensus.cc:2732] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Snoozing failure detection for 1.930s (starting election) I0710 23:26:31.240131 20018 raft_consensus.cc:2784] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:31.241271 20018 raft_consensus.cc:479] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } I0710 23:26:31.241585 20018 leader_election.cc:278] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:31.241991 20021 raft_consensus.cc:2732] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Snoozing failure detection for 1.908s (election complete) I0710 23:26:31.242033 20021 raft_consensus.cc:2539] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:31.242313 20021 raft_consensus.cc:595] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 1 LEADER]: Becoming Leader. State: Replica: f1580978ad884ae5ae5e855c7b484dff, State: Running, Role: LEADER I0710 23:26:31.242573 20021 consensus_queue.cc:204] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } I0710 23:26:31.244030 20023 sys_catalog.cc:337] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1580978ad884ae5ae5e855c7b484dff. Latest consensus state: current_term: 1 leader_uuid: "f1580978ad884ae5ae5e855c7b484dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } } I0710 23:26:31.244108 20023 sys_catalog.cc:340] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: This master's current role is: LEADER I0710 23:26:31.244035 20022 sys_catalog.cc:337] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f1580978ad884ae5ae5e855c7b484dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } } I0710 23:26:31.244271 20022 sys_catalog.cc:340] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: This master's current role is: LEADER I0710 23:26:31.244781 20018 sys_catalog.cc:337] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "f1580978ad884ae5ae5e855c7b484dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } } I0710 23:26:31.244899 20018 sys_catalog.cc:340] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: This master's current role is: LEADER I0710 23:26:31.245542 20018 sys_catalog.cc:424] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:31.245925 19959 master_main.cc:86] Master server successfully started. W0710 23:26:31.251822 20026 catalog_manager.cc:1075] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0710 23:26:31.251878 20026 catalog_manager.cc:574] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0710 23:26:31.252053 20025 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:31.252944 20025 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:31.270524 20019 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:31.270714 20019 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:31.271553 20019 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:31.271632 20019 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:31.273061 20019 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:37213 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:31.276500 20019 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:31.277292 20019 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 190016us I0710 23:26:31.277842 20019 fs_manager.cc:261] Metadata directory not provided I0710 23:26:31.277878 20019 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:31.278067 20019 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:31.278085 20019 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:31.280684 20019 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/data/instance: uuid: "534cd984a68d45c980a51f45f14e6a7d" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.281013 20019 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/wal/instance: uuid: "534cd984a68d45c980a51f45f14e6a7d" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.286078 20019 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s I0710 23:26:31.286963 20019 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:31.287309 20019 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:31.290797 20019 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0710 23:26:31.290927 20019 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "534cd984a68d45c980a51f45f14e6a7d" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.291023 20019 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:31.311507 20025 catalog_manager.cc:915] Generated new certificate authority record I0710 23:26:31.312626 20025 catalog_manager.cc:1037] Loading token signing keys... I0710 23:26:31.317677 20025 catalog_manager.cc:4131] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Generated new TSK 0 I0710 23:26:31.350162 20019 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:31.351121 20019 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:31.351249 20019 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:31.358312 20019 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:33457 I0710 23:26:31.358713 20019 webserver.cc:175] Starting webserver on 127.18.43.1:0 I0710 23:26:31.358742 20019 webserver.cc:186] Document root disabled I0710 23:26:31.359208 20019 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:46491/ I0710 23:26:31.359768 20019 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:31.360220 20019 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:31.364572 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 20019 I0710 23:26:31.365104 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:0 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:37213 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:31.372486 20148 heartbeater.cc:346] Connected to a master server at 127.18.43.62:37213 I0710 23:26:31.372627 20148 heartbeater.cc:426] Registering TS with master... I0710 23:26:31.373019 20148 heartbeater.cc:475] Master 127.18.43.62:37213 requested a full tablet report, sending... I0710 23:26:31.374202 19985 ts_manager.cc:98] Registered new tserver with Master: 534cd984a68d45c980a51f45f14e6a7d (127.18.43.1:33457) I0710 23:26:31.375314 19985 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:34921 WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:31.417866 20152 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:31.418083 20152 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:31.419136 20152 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:31.419216 20152 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:31.421068 20152 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:37213 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:31.424818 20152 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:31.425591 20152 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 190016us I0710 23:26:31.426115 20152 fs_manager.cc:261] Metadata directory not provided I0710 23:26:31.426147 20152 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:31.426332 20152 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:31.426347 20152 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:31.428942 20152 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/instance: uuid: "905bad85b9214a2491f627412487c31d" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.429229 20152 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal/instance: uuid: "905bad85b9214a2491f627412487c31d" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.434010 20152 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.004s sys 0.002s I0710 23:26:31.434625 20152 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:31.434854 20152 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:31.437611 20152 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0710 23:26:31.437721 20152 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "905bad85b9214a2491f627412487c31d" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.437793 20152 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:31.455741 20152 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:31.456580 20152 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:31.456682 20152 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:31.462128 20152 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:35713 I0710 23:26:31.462479 20152 webserver.cc:175] Starting webserver on 127.18.43.2:0 I0710 23:26:31.462498 20152 webserver.cc:186] Document root disabled I0710 23:26:31.462898 20152 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:35989/ I0710 23:26:31.463435 20152 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:31.463915 20152 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:31.469499 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 20152 I0710 23:26:31.472352 20271 heartbeater.cc:346] Connected to a master server at 127.18.43.62:37213 I0710 23:26:31.472517 20271 heartbeater.cc:426] Registering TS with master... I0710 23:26:31.472911 20271 heartbeater.cc:475] Master 127.18.43.62:37213 requested a full tablet report, sending... I0710 23:26:31.473912 19985 ts_manager.cc:98] Registered new tserver with Master: 905bad85b9214a2491f627412487c31d (127.18.43.2:35713) I0710 23:26:31.474575 19985 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:40605 I0710 23:26:31.474623 18604 external_mini_cluster.cc:505] 2 TS(s) registered with all masters I0710 23:26:31.481912 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 20152 W0710 23:26:31.485929 19969 connection.cc:512] server connection from 127.18.43.2:40605 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:40605): Connection reset by peer (error 104) I0710 23:26:31.486059 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 19959 W0710 23:26:31.490213 19958 connection.cc:512] client connection to 127.18.43.62:37213 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:37213): Connection reset by peer (error 104) W0710 23:26:31.490272 20036 connection.cc:512] client connection to 127.18.43.62:37213 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:37213): Connection reset by peer (error 104) W0710 23:26:31.490213 20278 connection.cc:512] client connection to 127.18.43.62:37213 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:37213): Connection reset by peer (error 104) I0710 23:26:31.490721 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:37213 --webserver_interface=127.18.43.62 --webserver_port=44015 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:31.537693 20281 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:31.537884 20281 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:31.538828 20281 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:31.538851 20281 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:31.538859 20281 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:31.538869 20281 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:31.540489 20281 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:37213 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/info.pb --webserver_interface=127.18.43.62 --webserver_port=44015 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:31.543961 20281 master_main.cc:80] Initializing master server... I0710 23:26:31.544476 20281 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 190016us I0710 23:26:31.545323 20281 fs_manager.cc:261] Metadata directory not provided I0710 23:26:31.545390 20281 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:31.549535 20281 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:31.550078 20281 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:31.550366 20281 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:31.553480 20281 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:31.554059 20281 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal uuid: "f1580978ad884ae5ae5e855c7b484dff" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:31.554177 20281 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:31.592092 20281 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:31.592653 20281 master_main.cc:83] Starting Master server... I0710 23:26:31.596763 20281 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:37213 I0710 23:26:31.597093 20281 webserver.cc:175] Starting webserver on 127.18.43.62:44015 I0710 23:26:31.597111 20281 webserver.cc:186] Document root disabled I0710 23:26:31.597525 20281 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:44015/ I0710 23:26:31.598114 20281 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/master-0/data/info.pb I0710 23:26:31.602915 20340 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Bootstrap starting. I0710 23:26:31.604887 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 20281 I0710 23:26:31.618157 20340 log.cc:525] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Log is configured to *not* fsync() on all Append() calls I0710 23:26:31.624030 20340 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=1} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:31.624438 20340 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Bootstrap complete. I0710 23:26:31.628084 20340 raft_consensus.cc:325] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } I0710 23:26:31.628161 20340 raft_consensus.cc:630] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1580978ad884ae5ae5e855c7b484dff, State: Initialized, Role: FOLLOWER I0710 23:26:31.628496 20340 consensus_queue.cc:227] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } I0710 23:26:31.628546 20340 raft_consensus.cc:365] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:31.628579 20340 raft_consensus.cc:457] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:31.628641 20340 raft_consensus.cc:2732] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Snoozing failure detection for 1.620s (starting election) I0710 23:26:31.628670 20340 raft_consensus.cc:2784] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:31.630703 20340 raft_consensus.cc:479] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } I0710 23:26:31.631057 20340 leader_election.cc:278] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:31.631978 20343 raft_consensus.cc:2732] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Snoozing failure detection for 1.958s (election complete) I0710 23:26:31.632026 20343 raft_consensus.cc:2539] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:31.631978 20340 sys_catalog.cc:337] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } } I0710 23:26:31.632277 20340 sys_catalog.cc:340] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: This master's current role is: FOLLOWER I0710 23:26:31.632195 20343 raft_consensus.cc:595] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [term 2 LEADER]: Becoming Leader. State: Replica: f1580978ad884ae5ae5e855c7b484dff, State: Running, Role: LEADER I0710 23:26:31.632773 20343 consensus_queue.cc:204] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } I0710 23:26:31.634011 20344 sys_catalog.cc:337] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "f1580978ad884ae5ae5e855c7b484dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } } I0710 23:26:31.634202 20344 sys_catalog.cc:340] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: This master's current role is: LEADER I0710 23:26:31.634178 20345 sys_catalog.cc:337] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: SysCatalogTable state changed. Reason: New leader f1580978ad884ae5ae5e855c7b484dff. Latest consensus state: current_term: 2 leader_uuid: "f1580978ad884ae5ae5e855c7b484dff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f1580978ad884ae5ae5e855c7b484dff" member_type: VOTER } } I0710 23:26:31.634465 20345 sys_catalog.cc:340] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: This master's current role is: LEADER I0710 23:26:31.634805 20340 sys_catalog.cc:424] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:31.634874 20347 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:31.635200 20281 master_main.cc:86] Master server successfully started. I0710 23:26:31.638453 20347 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... I0710 23:26:31.645483 20347 catalog_manager.cc:1037] Loading token signing keys... I0710 23:26:31.646317 20347 catalog_manager.cc:4142] T 00000000000000000000000000000000 P f1580978ad884ae5ae5e855c7b484dff: Loaded TSK: 0 I0710 23:26:32.377147 20148 heartbeater.cc:467] Master 127.18.43.62:37213 was elected leader, sending a full tablet report... I0710 23:26:32.382397 20307 master_service.cc:205] Got heartbeat from unknown tserver (permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" instance_seqno: 1531265191357051) as {username='slave'} at 127.18.43.1:60761; Asking this server to re-register. I0710 23:26:32.382917 20148 heartbeater.cc:426] Registering TS with master... I0710 23:26:32.383049 20148 heartbeater.cc:475] Master 127.18.43.62:37213 requested a full tablet report, sending... I0710 23:26:32.383826 20307 ts_manager.cc:98] Registered new tserver with Master: 534cd984a68d45c980a51f45f14e6a7d (127.18.43.1:33457) I0710 23:26:32.385099 18604 external_mini_cluster.cc:505] 1 TS(s) registered with all masters I0710 23:26:32.385155 18604 test_util.cc:208] Using random seed: 1977178755 I0710 23:26:32.394301 20307 catalog_manager.cc:1350] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36930: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0710 23:26:32.408869 20085 tablet_service.cc:759] Processing CreateTablet for tablet 1ad2575807194cbc814f203f1e3208f7 (table=test-workload [id=9040cc7dd5b5416a8a220d5338145626]), partition=RANGE (key) PARTITION UNBOUNDED I0710 23:26:32.409328 20085 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 1ad2575807194cbc814f203f1e3208f7. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:32.413584 20085 ts_tablet_manager.cc:1173] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:32.414006 20364 ts_tablet_manager.cc:1028] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Bootstrapping tablet I0710 23:26:32.414235 20364 tablet_bootstrap.cc:427] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Bootstrap starting. I0710 23:26:32.415973 20364 tablet_bootstrap.cc:578] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: No blocks or log segments found. Creating new log. I0710 23:26:32.416770 20364 log.cc:525] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Log is configured to *not* fsync() on all Append() calls I0710 23:26:32.417760 20364 tablet_bootstrap.cc:427] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: No bootstrap required, opened a new log I0710 23:26:32.417951 20364 ts_tablet_manager.cc:1045] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0710 23:26:32.420420 20364 raft_consensus.cc:325] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } } I0710 23:26:32.420498 20364 raft_consensus.cc:351] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:32.420534 20364 raft_consensus.cc:630] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 534cd984a68d45c980a51f45f14e6a7d, State: Initialized, Role: FOLLOWER I0710 23:26:32.420958 20364 consensus_queue.cc:227] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } } I0710 23:26:32.421031 20364 raft_consensus.cc:365] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:32.421067 20364 raft_consensus.cc:457] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:32.421134 20364 raft_consensus.cc:2732] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Snoozing failure detection for 2.089s (starting election) I0710 23:26:32.421164 20364 raft_consensus.cc:2784] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:32.422121 20364 raft_consensus.cc:479] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } } I0710 23:26:32.422479 20364 leader_election.cc:278] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:32.422920 20366 raft_consensus.cc:2732] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Snoozing failure detection for 2.108s (election complete) I0710 23:26:32.422960 20366 raft_consensus.cc:2539] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:32.423097 20366 raft_consensus.cc:595] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [term 1 LEADER]: Becoming Leader. State: Replica: 534cd984a68d45c980a51f45f14e6a7d, State: Running, Role: LEADER I0710 23:26:32.423331 20364 ts_tablet_manager.cc:1073] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s I0710 23:26:32.423399 20366 consensus_queue.cc:204] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } } I0710 23:26:32.426360 20307 catalog_manager.cc:3827] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d reported cstate change: term changed from 0 to 1, leader changed from to 534cd984a68d45c980a51f45f14e6a7d (127.18.43.1). New cstate: current_term: 1 leader_uuid: "534cd984a68d45c980a51f45f14e6a7d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } health_report { overall_health: HEALTHY } } } I0710 23:26:32.808090 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:35713 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_port=35989 --webserver_interface=127.18.43.2 --tserver_master_addrs=127.18.43.62:37213 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:32.846024 20381 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:32.846199 20381 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:32.846971 20381 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:32.847017 20381 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:32.848459 20381 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:35713 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=35989 --tserver_master_addrs=127.18.43.62:37213 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:32.851938 20381 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:32.852710 20381 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 190516us I0710 23:26:32.853233 20381 fs_manager.cc:261] Metadata directory not provided I0710 23:26:32.853287 20381 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:32.856978 20381 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.003s sys 0.001s I0710 23:26:32.857398 20381 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:32.857666 20381 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:32.860620 20381 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:32.861205 20381 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "905bad85b9214a2491f627412487c31d" format_stamp: "Formatted at 2018-07-10 23:26:31 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:32.861327 20381 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:32.918947 20381 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:32.919952 20381 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:32.920074 20381 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:32.925437 20381 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:35713 I0710 23:26:32.925774 20381 webserver.cc:175] Starting webserver on 127.18.43.2:35989 I0710 23:26:32.925792 20381 webserver.cc:186] Document root disabled I0710 23:26:32.926175 20381 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:35989/ I0710 23:26:32.926741 20381 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:32.927220 20381 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:32.932637 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 20381 I0710 23:26:32.936553 20500 heartbeater.cc:346] Connected to a master server at 127.18.43.62:37213 I0710 23:26:32.936709 20500 heartbeater.cc:426] Registering TS with master... I0710 23:26:32.937099 20500 heartbeater.cc:475] Master 127.18.43.62:37213 requested a full tablet report, sending... I0710 23:26:32.938112 20307 ts_manager.cc:98] Registered new tserver with Master: 905bad85b9214a2491f627412487c31d (127.18.43.2:35713) I0710 23:26:32.939345 20307 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:52235 I0710 23:26:32.941210 20505 ts_tablet_manager.cc:669] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Initiating tablet copy from peer 534cd984a68d45c980a51f45f14e6a7d (127.18.43.1:33457) I0710 23:26:32.941617 20505 tablet_copy_client.cc:239] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:33457 I0710 23:26:32.946480 20125 tablet_copy_service.cc:135] P 534cd984a68d45c980a51f45f14e6a7d: Received BeginTabletCopySession request for tablet 1ad2575807194cbc814f203f1e3208f7 from peer 905bad85b9214a2491f627412487c31d ({username='slave'} at 127.18.43.2:54503) I0710 23:26:32.946564 20125 tablet_copy_service.cc:156] P 534cd984a68d45c980a51f45f14e6a7d: Beginning new tablet copy session on tablet 1ad2575807194cbc814f203f1e3208f7 from peer 905bad85b9214a2491f627412487c31d at {username='slave'} at 127.18.43.2:54503: session id = 905bad85b9214a2491f627412487c31d-1ad2575807194cbc814f203f1e3208f7 I0710 23:26:32.947638 20125 tablet_copy_source_session.cc:202] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:32.950228 20505 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 1ad2575807194cbc814f203f1e3208f7. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:32.954991 20505 ts_tablet_manager.cc:1173] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:32.955493 20505 tablet_copy_client.cc:566] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet copy: Starting download of 0 data blocks... I0710 23:26:32.955687 20505 tablet_copy_client.cc:529] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet copy: Starting download of 1 WAL segments... I0710 23:26:32.959040 20505 tablet_copy_client.cc:405] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:32.960744 20505 ts_tablet_manager.cc:1028] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Bootstrapping tablet I0710 23:26:32.961016 20505 tablet_bootstrap.cc:427] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Bootstrap starting. I0710 23:26:32.978152 20505 log.cc:525] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Log is configured to *not* fsync() on all Append() calls I0710 23:26:33.326663 20505 tablet_bootstrap.cc:427] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Bootstrap replayed 1/1 log segments. Stats: ops{read=213 overwritten=0 applied=213 ignored=0} inserts{seen=10600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:33.327023 20505 tablet_bootstrap.cc:427] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Bootstrap complete. I0710 23:26:33.327365 20505 ts_tablet_manager.cc:1045] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Time spent bootstrapping tablet: real 0.367s user 0.351s sys 0.012s I0710 23:26:33.329602 20505 raft_consensus.cc:325] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } } I0710 23:26:33.329676 20505 raft_consensus.cc:630] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 905bad85b9214a2491f627412487c31d, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:33.329943 20505 consensus_queue.cc:227] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 213, Last appended: 1.213, Last appended by leader: 213, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } } I0710 23:26:33.330377 20500 heartbeater.cc:467] Master 127.18.43.62:37213 was elected leader, sending a full tablet report... I0710 23:26:33.330520 20505 ts_tablet_manager.cc:1073] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Time spent starting tablet: real 0.003s user 0.006s sys 0.000s I0710 23:26:33.331205 20125 tablet_copy_service.cc:325] P 534cd984a68d45c980a51f45f14e6a7d: Request end of tablet copy session 905bad85b9214a2491f627412487c31d-1ad2575807194cbc814f203f1e3208f7 received from {username='slave'} at 127.18.43.2:54503 I0710 23:26:33.331243 20125 tablet_copy_service.cc:413] P 534cd984a68d45c980a51f45f14e6a7d: ending tablet copy session 905bad85b9214a2491f627412487c31d-1ad2575807194cbc814f203f1e3208f7 on tablet 1ad2575807194cbc814f203f1e3208f7 with peer 905bad85b9214a2491f627412487c31d I0710 23:26:33.336215 20431 tablet_service.cc:800] Processing DeleteTablet for tablet 1ad2575807194cbc814f203f1e3208f7 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 127.0.0.1:39892 I0710 23:26:33.336632 20508 tablet_replica.cc:261] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: stopping tablet replica I0710 23:26:33.336748 20508 maintenance_manager.cc:237] P 905bad85b9214a2491f627412487c31d: Unregistered op CompactRowSetsOp(1ad2575807194cbc814f203f1e3208f7) I0710 23:26:33.336772 20508 maintenance_manager.cc:237] P 905bad85b9214a2491f627412487c31d: Unregistered op MinorDeltaCompactionOp(1ad2575807194cbc814f203f1e3208f7) I0710 23:26:33.336782 20508 maintenance_manager.cc:237] P 905bad85b9214a2491f627412487c31d: Unregistered op MajorDeltaCompactionOp(1ad2575807194cbc814f203f1e3208f7) I0710 23:26:33.336793 20508 maintenance_manager.cc:237] P 905bad85b9214a2491f627412487c31d: Unregistered op UndoDeltaBlockGCOp(1ad2575807194cbc814f203f1e3208f7) I0710 23:26:33.336843 20508 maintenance_manager.cc:237] P 905bad85b9214a2491f627412487c31d: Unregistered op FlushMRSOp(1ad2575807194cbc814f203f1e3208f7) I0710 23:26:33.336853 20508 maintenance_manager.cc:237] P 905bad85b9214a2491f627412487c31d: Unregistered op FlushDeltaMemStoresOp(1ad2575807194cbc814f203f1e3208f7) I0710 23:26:33.336860 20508 maintenance_manager.cc:237] P 905bad85b9214a2491f627412487c31d: Unregistered op LogGCOp(1ad2575807194cbc814f203f1e3208f7) I0710 23:26:33.336922 20508 raft_consensus.cc:2042] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d [term 1 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:33.337110 20508 raft_consensus.cc:2069] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d [term 1 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:33.338691 20508 ts_tablet_manager.cc:1369] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0710 23:26:33.340728 20508 ts_tablet_manager.cc:1382] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.213 I0710 23:26:33.340785 20508 log.cc:986] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Deleting WAL directory at /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStartTabletCopy.1531265186290008-18604/minicluster-data/ts-1/wal/wals/1ad2575807194cbc814f203f1e3208f7 I0710 23:26:33.342427 20505 ts_tablet_manager.cc:669] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Initiating tablet copy from peer 534cd984a68d45c980a51f45f14e6a7d (127.18.43.1:33457) I0710 23:26:33.342573 20505 tablet_copy_client.cc:239] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:33457 I0710 23:26:33.344471 20125 tablet_copy_service.cc:135] P 534cd984a68d45c980a51f45f14e6a7d: Received BeginTabletCopySession request for tablet 1ad2575807194cbc814f203f1e3208f7 from peer 905bad85b9214a2491f627412487c31d ({username='slave'} at 127.18.43.2:54503) I0710 23:26:33.344549 20125 tablet_copy_service.cc:156] P 534cd984a68d45c980a51f45f14e6a7d: Beginning new tablet copy session on tablet 1ad2575807194cbc814f203f1e3208f7 from peer 905bad85b9214a2491f627412487c31d at {username='slave'} at 127.18.43.2:54503: session id = 905bad85b9214a2491f627412487c31d-1ad2575807194cbc814f203f1e3208f7 I0710 23:26:33.345196 20125 tablet_copy_source_session.cc:202] T 1ad2575807194cbc814f203f1e3208f7 P 534cd984a68d45c980a51f45f14e6a7d: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:33.345917 20505 ts_tablet_manager.cc:1369] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Deleting tablet data with delete state TABLET_DATA_COPYING I0710 23:26:33.347759 20505 ts_tablet_manager.cc:1382] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.213 I0710 23:26:33.347893 20505 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 1ad2575807194cbc814f203f1e3208f7. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:33.348744 20505 ts_tablet_manager.cc:1173] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:33.348879 20505 tablet_copy_client.cc:566] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet copy: Starting download of 0 data blocks... I0710 23:26:33.348970 20505 tablet_copy_client.cc:529] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet copy: Starting download of 1 WAL segments... I0710 23:26:33.351933 20505 tablet_copy_client.cc:405] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:33.353031 20505 ts_tablet_manager.cc:1028] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Bootstrapping tablet I0710 23:26:33.353150 20505 tablet_bootstrap.cc:427] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Bootstrap starting. I0710 23:26:33.693694 20505 tablet_bootstrap.cc:427] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Bootstrap replayed 1/1 log segments. Stats: ops{read=213 overwritten=0 applied=213 ignored=0} inserts{seen=10600 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:33.694005 20505 tablet_bootstrap.cc:427] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Bootstrap complete. I0710 23:26:33.694226 20505 ts_tablet_manager.cc:1045] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Time spent bootstrapping tablet: real 0.341s user 0.327s sys 0.012s I0710 23:26:33.694711 20505 raft_consensus.cc:325] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d [term 1 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } } I0710 23:26:33.694744 20505 raft_consensus.cc:630] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d [term 1 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 905bad85b9214a2491f627412487c31d, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:33.694823 20505 consensus_queue.cc:227] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 213, Last appended: 1.213, Last appended by leader: 213, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "534cd984a68d45c980a51f45f14e6a7d" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 33457 } } I0710 23:26:33.695024 20505 ts_tablet_manager.cc:1073] T 1ad2575807194cbc814f203f1e3208f7 P 905bad85b9214a2491f627412487c31d: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0710 23:26:33.695704 20125 tablet_copy_service.cc:325] P 534cd984a68d45c980a51f45f14e6a7d: Request end of tablet copy session 905bad85b9214a2491f627412487c31d-1ad2575807194cbc814f203f1e3208f7 received from {username='slave'} at 127.18.43.2:54503 I0710 23:26:33.695744 20125 tablet_copy_service.cc:413] P 534cd984a68d45c980a51f45f14e6a7d: ending tablet copy session 905bad85b9214a2491f627412487c31d-1ad2575807194cbc814f203f1e3208f7 on tablet 1ad2575807194cbc814f203f1e3208f7 with peer 905bad85b9214a2491f627412487c31d I0710 23:26:33.705222 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 20019 W0710 23:26:33.709542 19958 connection.cc:512] client connection to 127.18.43.1:33457 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:33457): Connection reset by peer (error 104) W0710 23:26:33.709552 20288 connection.cc:512] server connection from 127.18.43.1:60761 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:60761): Connection reset by peer (error 104) W0710 23:26:33.709555 20391 connection.cc:512] client connection to 127.18.43.1:33457 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:33457): Connection reset by peer (error 104) W0710 23:26:33.709762 20291 connection.cc:512] client connection to 127.18.43.1:33457 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:33457): Connection reset by peer (error 104) I0710 23:26:33.710129 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 20381 W0710 23:26:33.714345 20290 connection.cc:512] server connection from 127.18.43.2:52235 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:52235): Connection reset by peer (error 104) W0710 23:26:33.714357 19958 connection.cc:512] client connection to 127.18.43.2:35713 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:35713): Connection reset by peer (error 104) I0710 23:26:33.714529 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 20281 W0710 23:26:33.718583 19958 connection.cc:512] client connection to 127.18.43.62:37213 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:37213): Connection reset by peer (error 104) [ OK ] TabletCopyClientSessionITest.TestStartTabletCopy (2588 ms) [ RUN ] TabletCopyClientSessionITest.TestCopyFromCrashedSource I0710 23:26:33.724236 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:41969 --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:33.773147 20511 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:33.773324 20511 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:33.774299 20511 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:33.774325 20511 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:33.774332 20511 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:33.774340 20511 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:33.775861 20511 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:41969 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/info.pb --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:33.779124 20511 master_main.cc:80] Initializing master server... I0710 23:26:33.779623 20511 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 191016us I0710 23:26:33.780442 20511 fs_manager.cc:261] Metadata directory not provided I0710 23:26:33.780483 20511 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:33.780683 20511 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:33.780701 20511 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:33.783381 20511 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/instance: uuid: "6375b2cb114743fdb7e4c8ca50824b52" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:33.783764 20511 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal/instance: uuid: "6375b2cb114743fdb7e4c8ca50824b52" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:33.788910 20511 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s I0710 23:26:33.789593 20511 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:33.789857 20511 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:33.792843 20511 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0710 23:26:33.792961 20511 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal uuid: "6375b2cb114743fdb7e4c8ca50824b52" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:33.793062 20511 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:33.823491 20511 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:33.824101 20511 master_main.cc:83] Starting Master server... I0710 23:26:33.827740 20511 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:41969 I0710 23:26:33.828084 20511 webserver.cc:175] Starting webserver on 127.18.43.62:0 I0710 23:26:33.828104 20511 webserver.cc:186] Document root disabled I0710 23:26:33.828507 20511 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:36049/ I0710 23:26:33.829051 20511 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/info.pb I0710 23:26:33.831552 20570 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:33.837257 20570 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Bootstrap starting. I0710 23:26:33.838932 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 20511 I0710 23:26:33.839174 20570 tablet_bootstrap.cc:578] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: No blocks or log segments found. Creating new log. I0710 23:26:33.839380 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:0 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:41969 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:33.839974 20570 log.cc:525] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Log is configured to *not* fsync() on all Append() calls I0710 23:26:33.841123 20570 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: No bootstrap required, opened a new log I0710 23:26:33.843822 20570 raft_consensus.cc:325] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } I0710 23:26:33.843886 20570 raft_consensus.cc:351] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:33.843915 20570 raft_consensus.cc:630] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6375b2cb114743fdb7e4c8ca50824b52, State: Initialized, Role: FOLLOWER I0710 23:26:33.844316 20570 consensus_queue.cc:227] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } I0710 23:26:33.844369 20570 raft_consensus.cc:365] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:33.844403 20570 raft_consensus.cc:457] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:33.844458 20570 raft_consensus.cc:2732] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Snoozing failure detection for 2.151s (starting election) I0710 23:26:33.844483 20570 raft_consensus.cc:2784] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:33.845352 20570 raft_consensus.cc:479] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } I0710 23:26:33.845638 20570 leader_election.cc:278] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:33.846040 20573 raft_consensus.cc:2732] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Snoozing failure detection for 1.648s (election complete) I0710 23:26:33.846082 20573 raft_consensus.cc:2539] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:33.846174 20573 raft_consensus.cc:595] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 1 LEADER]: Becoming Leader. State: Replica: 6375b2cb114743fdb7e4c8ca50824b52, State: Running, Role: LEADER I0710 23:26:33.846410 20573 consensus_queue.cc:204] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } I0710 23:26:33.847422 20573 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6375b2cb114743fdb7e4c8ca50824b52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } } I0710 23:26:33.847458 20573 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: This master's current role is: LEADER I0710 23:26:33.847676 20570 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "6375b2cb114743fdb7e4c8ca50824b52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } } I0710 23:26:33.847700 20570 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: This master's current role is: LEADER I0710 23:26:33.848464 20570 sys_catalog.cc:424] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:33.848891 20511 master_main.cc:86] Master server successfully started. I0710 23:26:33.849221 20577 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:33.851724 20573 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6375b2cb114743fdb7e4c8ca50824b52. Latest consensus state: current_term: 1 leader_uuid: "6375b2cb114743fdb7e4c8ca50824b52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } } I0710 23:26:33.851768 20573 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: This master's current role is: LEADER I0710 23:26:33.851992 20577 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... I0710 23:26:33.876092 20577 catalog_manager.cc:915] Generated new certificate authority record I0710 23:26:33.877457 20577 catalog_manager.cc:1037] Loading token signing keys... WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:33.880834 20572 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:33.881038 20572 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:33.882148 20572 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:33.882217 20572 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:33.884078 20572 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:41969 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:33.888550 20572 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:33.889472 20572 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 191016us I0710 23:26:33.890094 20572 fs_manager.cc:261] Metadata directory not provided I0710 23:26:33.890131 20572 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:33.890332 20572 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:33.890352 20572 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:33.893810 20572 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/instance: uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:33.894148 20572 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal/instance: uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:33.896714 20577 catalog_manager.cc:4131] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Generated new TSK 0 I0710 23:26:33.899826 20572 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s I0710 23:26:33.900446 20572 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:33.900697 20572 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:33.903645 20572 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:33.903795 20572 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:33.903880 20572 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:33.936774 20572 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:33.937579 20572 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:33.937701 20572 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:33.942523 20572 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:43205 I0710 23:26:33.942849 20572 webserver.cc:175] Starting webserver on 127.18.43.1:0 I0710 23:26:33.942867 20572 webserver.cc:186] Document root disabled I0710 23:26:33.943243 20572 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:43777/ I0710 23:26:33.944598 20572 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:33.945013 20572 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:33.953727 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 20572 I0710 23:26:33.954243 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:0 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:41969 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0710 23:26:33.961143 20700 heartbeater.cc:346] Connected to a master server at 127.18.43.62:41969 I0710 23:26:33.961316 20700 heartbeater.cc:426] Registering TS with master... I0710 23:26:33.961818 20700 heartbeater.cc:475] Master 127.18.43.62:41969 requested a full tablet report, sending... I0710 23:26:33.963315 20537 ts_manager.cc:98] Registered new tserver with Master: 0cfc001f09ea4e7ca0d4192d5639ff4e (127.18.43.1:43205) I0710 23:26:33.964872 20537 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:53691 WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:33.994107 20704 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:33.994304 20704 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:33.995123 20704 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:33.995193 20704 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:33.996604 20704 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:41969 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:34.000208 20704 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:34.000975 20704 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 191016us I0710 23:26:34.001518 20704 fs_manager.cc:261] Metadata directory not provided I0710 23:26:34.001555 20704 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:34.001730 20704 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:34.001745 20704 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:34.004338 20704 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/instance: uuid: "499849c323044bfba0fea8a0527ead6b" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:34.004638 20704 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal/instance: uuid: "499849c323044bfba0fea8a0527ead6b" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:34.009523 20704 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s I0710 23:26:34.010188 20704 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:34.010457 20704 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:34.013190 20704 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0710 23:26:34.013317 20704 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "499849c323044bfba0fea8a0527ead6b" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:34.013420 20704 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:34.062345 20704 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:34.063144 20704 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:34.063268 20704 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:34.069417 20704 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:39849 I0710 23:26:34.069730 20704 webserver.cc:175] Starting webserver on 127.18.43.2:0 I0710 23:26:34.069748 20704 webserver.cc:186] Document root disabled I0710 23:26:34.070127 20704 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:36505/ I0710 23:26:34.070636 20704 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:34.071040 20704 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:34.078629 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 20704 I0710 23:26:34.081478 20823 heartbeater.cc:346] Connected to a master server at 127.18.43.62:41969 I0710 23:26:34.081650 20823 heartbeater.cc:426] Registering TS with master... I0710 23:26:34.082139 20823 heartbeater.cc:475] Master 127.18.43.62:41969 requested a full tablet report, sending... I0710 23:26:34.083168 20537 ts_manager.cc:98] Registered new tserver with Master: 499849c323044bfba0fea8a0527ead6b (127.18.43.2:39849) I0710 23:26:34.083848 20537 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:59361 I0710 23:26:34.086313 18604 external_mini_cluster.cc:505] 2 TS(s) registered with all masters I0710 23:26:34.096320 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 20704 W0710 23:26:34.100375 20520 connection.cc:512] server connection from 127.18.43.2:59361 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:59361): Connection reset by peer (error 104) I0710 23:26:34.100497 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 20511 W0710 23:26:34.104552 20510 connection.cc:512] client connection to 127.18.43.62:41969 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:41969): Connection reset by peer (error 104) W0710 23:26:34.104611 20588 connection.cc:512] client connection to 127.18.43.62:41969 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:41969): Connection reset by peer (error 104) W0710 23:26:34.104553 20827 connection.cc:512] client connection to 127.18.43.62:41969 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:41969): Connection reset by peer (error 104) I0710 23:26:34.105072 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:41969 --webserver_interface=127.18.43.62 --webserver_port=36049 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:34.151319 20832 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:34.151505 20832 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:34.152467 20832 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:34.152489 20832 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:34.152498 20832 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:34.152508 20832 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:34.154031 20832 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:41969 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/info.pb --webserver_interface=127.18.43.62 --webserver_port=36049 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:34.157249 20832 master_main.cc:80] Initializing master server... I0710 23:26:34.157713 20832 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 191516us I0710 23:26:34.158535 20832 fs_manager.cc:261] Metadata directory not provided I0710 23:26:34.158602 20832 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:34.162475 20832 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:34.162915 20832 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:34.163163 20832 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:34.165976 20832 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0710 23:26:34.166513 20832 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal uuid: "6375b2cb114743fdb7e4c8ca50824b52" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:34.166609 20832 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:34.200811 20832 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:34.201344 20832 master_main.cc:83] Starting Master server... I0710 23:26:34.205157 20832 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:41969 I0710 23:26:34.205487 20832 webserver.cc:175] Starting webserver on 127.18.43.62:36049 I0710 23:26:34.205504 20832 webserver.cc:186] Document root disabled I0710 23:26:34.205893 20832 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:36049/ I0710 23:26:34.206444 20832 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/master-0/data/info.pb I0710 23:26:34.208859 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 20832 I0710 23:26:34.211015 20891 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Bootstrap starting. I0710 23:26:34.225811 20891 log.cc:525] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Log is configured to *not* fsync() on all Append() calls I0710 23:26:34.231943 20891 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=1} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:34.232367 20891 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Bootstrap complete. I0710 23:26:34.236089 20891 raft_consensus.cc:325] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } I0710 23:26:34.236158 20891 raft_consensus.cc:630] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6375b2cb114743fdb7e4c8ca50824b52, State: Initialized, Role: FOLLOWER I0710 23:26:34.236492 20891 consensus_queue.cc:227] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } I0710 23:26:34.236537 20891 raft_consensus.cc:365] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:34.236570 20891 raft_consensus.cc:457] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:34.236639 20891 raft_consensus.cc:2732] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Snoozing failure detection for 1.991s (starting election) I0710 23:26:34.236668 20891 raft_consensus.cc:2784] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:34.238489 20891 raft_consensus.cc:479] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } I0710 23:26:34.238811 20891 leader_election.cc:278] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:34.239223 20894 raft_consensus.cc:2732] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Snoozing failure detection for 1.632s (election complete) I0710 23:26:34.239269 20894 raft_consensus.cc:2539] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:34.239679 20894 raft_consensus.cc:595] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [term 2 LEADER]: Becoming Leader. State: Replica: 6375b2cb114743fdb7e4c8ca50824b52, State: Running, Role: LEADER I0710 23:26:34.239933 20894 consensus_queue.cc:204] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } I0710 23:26:34.240748 20894 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6375b2cb114743fdb7e4c8ca50824b52. Latest consensus state: current_term: 2 leader_uuid: "6375b2cb114743fdb7e4c8ca50824b52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } } I0710 23:26:34.240795 20894 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: This master's current role is: LEADER I0710 23:26:34.241060 20895 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "6375b2cb114743fdb7e4c8ca50824b52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } } I0710 23:26:34.241084 20895 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: This master's current role is: LEADER I0710 23:26:34.241235 20891 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "6375b2cb114743fdb7e4c8ca50824b52" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6375b2cb114743fdb7e4c8ca50824b52" member_type: VOTER } } I0710 23:26:34.241256 20891 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: This master's current role is: LEADER I0710 23:26:34.241844 20891 sys_catalog.cc:424] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52 [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:34.241952 20898 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:34.242203 20832 master_main.cc:86] Master server successfully started. I0710 23:26:34.244647 20898 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... I0710 23:26:34.246496 20898 catalog_manager.cc:1037] Loading token signing keys... I0710 23:26:34.247217 20898 catalog_manager.cc:4142] T 00000000000000000000000000000000 P 6375b2cb114743fdb7e4c8ca50824b52: Loaded TSK: 0 I0710 23:26:34.967077 20700 heartbeater.cc:467] Master 127.18.43.62:41969 was elected leader, sending a full tablet report... I0710 23:26:34.972148 20851 master_service.cc:205] Got heartbeat from unknown tserver (permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" instance_seqno: 1531265193941648) as {username='slave'} at 127.18.43.1:52107; Asking this server to re-register. I0710 23:26:34.972625 20700 heartbeater.cc:426] Registering TS with master... I0710 23:26:34.972759 20700 heartbeater.cc:475] Master 127.18.43.62:41969 requested a full tablet report, sending... I0710 23:26:34.973564 20851 ts_manager.cc:98] Registered new tserver with Master: 0cfc001f09ea4e7ca0d4192d5639ff4e (127.18.43.1:43205) I0710 23:26:34.974691 18604 external_mini_cluster.cc:505] 1 TS(s) registered with all masters I0710 23:26:34.974752 18604 test_util.cc:208] Using random seed: 1979768352 I0710 23:26:34.983743 20851 catalog_manager.cc:1350] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34412: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0710 23:26:34.998065 20622 tablet_service.cc:759] Processing CreateTablet for tablet 915e69c344a141c1bc158939cbb55d28 (table=test-workload [id=1d4f2ec71d1f4a87a30c21238773554d]), partition=RANGE (key) PARTITION UNBOUNDED I0710 23:26:34.998515 20622 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 915e69c344a141c1bc158939cbb55d28. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:35.002812 20622 ts_tablet_manager.cc:1173] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:35.003176 20915 ts_tablet_manager.cc:1028] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Bootstrapping tablet I0710 23:26:35.003391 20915 tablet_bootstrap.cc:427] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Bootstrap starting. I0710 23:26:35.004933 20915 tablet_bootstrap.cc:578] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: No blocks or log segments found. Creating new log. I0710 23:26:35.005751 20915 log.cc:525] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Log is configured to *not* fsync() on all Append() calls I0710 23:26:35.006850 20915 tablet_bootstrap.cc:427] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: No bootstrap required, opened a new log I0710 23:26:35.007061 20915 ts_tablet_manager.cc:1045] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0710 23:26:35.009661 20915 raft_consensus.cc:325] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:35.009737 20915 raft_consensus.cc:351] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:35.009790 20915 raft_consensus.cc:630] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfc001f09ea4e7ca0d4192d5639ff4e, State: Initialized, Role: FOLLOWER I0710 23:26:35.010208 20915 consensus_queue.cc:227] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:35.010272 20915 raft_consensus.cc:365] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:35.010311 20915 raft_consensus.cc:457] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:35.010376 20915 raft_consensus.cc:2732] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Snoozing failure detection for 2.218s (starting election) I0710 23:26:35.010406 20915 raft_consensus.cc:2784] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:35.011385 20915 raft_consensus.cc:479] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:35.011790 20915 leader_election.cc:278] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:35.012241 20917 raft_consensus.cc:2732] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Snoozing failure detection for 1.990s (election complete) I0710 23:26:35.012287 20917 raft_consensus.cc:2539] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:35.012454 20917 raft_consensus.cc:595] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 1 LEADER]: Becoming Leader. State: Replica: 0cfc001f09ea4e7ca0d4192d5639ff4e, State: Running, Role: LEADER I0710 23:26:35.012648 20915 ts_tablet_manager.cc:1073] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s I0710 23:26:35.012758 20917 consensus_queue.cc:204] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:35.015633 20851 catalog_manager.cc:3827] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e reported cstate change: term changed from 0 to 1, leader changed from to 0cfc001f09ea4e7ca0d4192d5639ff4e (127.18.43.1). New cstate: current_term: 1 leader_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } health_report { overall_health: HEALTHY } } } I0710 23:26:35.390609 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:39849 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_port=36505 --webserver_interface=127.18.43.2 --tserver_master_addrs=127.18.43.62:41969 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:35.428943 20932 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:35.429116 20932 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:35.429898 20932 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:35.429941 20932 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:35.431246 20932 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:39849 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=36505 --tserver_master_addrs=127.18.43.62:41969 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:35.434741 20932 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:35.435492 20932 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 192016us I0710 23:26:35.436048 20932 fs_manager.cc:261] Metadata directory not provided I0710 23:26:35.436097 20932 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:35.439875 20932 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:35.440232 20932 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:35.440470 20932 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:35.443308 20932 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0710 23:26:35.443943 20932 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "499849c323044bfba0fea8a0527ead6b" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:35.444056 20932 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:35.494829 20932 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:35.495781 20932 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:35.495909 20932 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:35.501888 20932 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:39849 I0710 23:26:35.502209 20932 webserver.cc:175] Starting webserver on 127.18.43.2:36505 I0710 23:26:35.502225 20932 webserver.cc:186] Document root disabled I0710 23:26:35.502593 20932 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:36505/ I0710 23:26:35.503140 20932 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:35.504426 20932 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:35.504799 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 20932 W0710 23:26:35.507874 20697 generic_service.cc:126] {username='slave'} at 127.0.0.1:59090 forcing change of non-runtime-safe flag fault_crash_on_handle_tc_fetch_data I0710 23:26:35.507941 20697 generic_service.cc:146] {username='slave'} at 127.0.0.1:59090 changed flags via RPC: fault_crash_on_handle_tc_fetch_data from '0' to '1.0' I0710 23:26:35.512948 21051 heartbeater.cc:346] Connected to a master server at 127.18.43.62:41969 I0710 23:26:35.513087 21051 heartbeater.cc:426] Registering TS with master... I0710 23:26:35.513590 21051 heartbeater.cc:475] Master 127.18.43.62:41969 requested a full tablet report, sending... I0710 23:26:35.514389 21056 ts_tablet_manager.cc:669] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Initiating tablet copy from peer 0cfc001f09ea4e7ca0d4192d5639ff4e (127.18.43.1:43205) I0710 23:26:35.514485 20857 ts_manager.cc:98] Registered new tserver with Master: 499849c323044bfba0fea8a0527ead6b (127.18.43.2:39849) I0710 23:26:35.514590 21056 tablet_copy_client.cc:239] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:43205 I0710 23:26:35.515676 20857 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:55435 I0710 23:26:35.518640 20677 tablet_copy_service.cc:135] P 0cfc001f09ea4e7ca0d4192d5639ff4e: Received BeginTabletCopySession request for tablet 915e69c344a141c1bc158939cbb55d28 from peer 499849c323044bfba0fea8a0527ead6b ({username='slave'} at 127.18.43.2:53531) I0710 23:26:35.518716 20677 tablet_copy_service.cc:156] P 0cfc001f09ea4e7ca0d4192d5639ff4e: Beginning new tablet copy session on tablet 915e69c344a141c1bc158939cbb55d28 from peer 499849c323044bfba0fea8a0527ead6b at {username='slave'} at 127.18.43.2:53531: session id = 499849c323044bfba0fea8a0527ead6b-915e69c344a141c1bc158939cbb55d28 I0710 23:26:35.519708 20677 tablet_copy_source_session.cc:202] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:35.522469 21056 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 915e69c344a141c1bc158939cbb55d28. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:35.527328 21056 ts_tablet_manager.cc:1173] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:35.527889 21056 tablet_copy_client.cc:566] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet copy: Starting download of 0 data blocks... I0710 23:26:35.528041 21056 tablet_copy_client.cc:529] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet copy: Starting download of 1 WAL segments... W0710 23:26:35.528965 20677 fault_injection.cc:41] FAULT INJECTION ENABLED! W0710 23:26:35.528995 20677 fault_injection.cc:42] THIS SERVER MAY CRASH! E0710 23:26:35.529004 20677 fault_injection.cc:57] Injecting fault: FLAGS_fault_crash_on_handle_tc_fetch_data (process will exit) W0710 23:26:35.533288 20510 connection.cc:512] client connection to 127.18.43.1:43205 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:43205): Connection reset by peer (error 104) W0710 23:26:35.533323 20942 connection.cc:512] client connection to 127.18.43.1:43205 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:43205): Connection reset by peer (error 104) W0710 23:26:35.533326 20841 connection.cc:512] server connection from 127.18.43.1:52107 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:52107): Connection reset by peer (error 104) W0710 23:26:35.533326 20842 connection.cc:512] client connection to 127.18.43.1:43205 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:43205): Connection reset by peer (error 104) W0710 23:26:35.533769 21056 ts_tablet_manager.cc:739] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Tablet Copy: Unable to fetch data from remote peer 0cfc001f09ea4e7ca0d4192d5639ff4e (127.18.43.1:43205): Network error: Unable to download WAL segment with seq. number 1: unable to fetch data from remote: failed to read from TLS socket (remote: 127.18.43.1:43205): Connection reset by peer (error 104) W0710 23:26:35.534452 21056 tablet_copy_client.cc:173] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet copy: Unable to close tablet copy session: Network error: failure ending tablet copy session: Client connection negotiation failed: client connection to 127.18.43.1:43205: connect: Connection refused (error 111) W0710 23:26:35.535008 21056 tablet_metadata.cc:421] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 915e69c344a141c1bc158939cbb55d28 but one is already registered I0710 23:26:35.535151 21056 ts_tablet_manager.cc:1369] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0710 23:26:35.537271 21056 ts_tablet_manager.cc:1382] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0 I0710 23:26:35.537334 21056 log.cc:986] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Deleting WAL directory at /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-1/wal/wals/915e69c344a141c1bc158939cbb55d28 I0710 23:26:35.541841 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:43205 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_port=43777 --webserver_interface=127.18.43.1 --tserver_master_addrs=127.18.43.62:41969 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:35.583079 21057 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:35.583269 21057 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:35.584105 21057 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:35.584158 21057 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:35.585559 21057 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:43205 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=43777 --tserver_master_addrs=127.18.43.62:41969 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:35.589005 21057 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:35.589781 21057 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 192016us I0710 23:26:35.590304 21057 fs_manager.cc:261] Metadata directory not provided I0710 23:26:35.590350 21057 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:35.594094 21057 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:35.594642 21057 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:35.594914 21057 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:35.597851 21057 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:35.598500 21057 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" format_stamp: "Formatted at 2018-07-10 23:26:33 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:35.598616 21057 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:35.641688 21057 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:35.642544 21057 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0710 23:26:35.642581 21057 ts_tablet_manager.cc:1005] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Loading tablet metadata I0710 23:26:35.645493 21057 ts_tablet_manager.cc:356] Loaded tablet metadata (1 live tablets) I0710 23:26:35.646878 21057 ts_tablet_manager.cc:1173] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:35.647172 21057 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:35.647722 21072 ts_tablet_manager.cc:1028] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Bootstrapping tablet I0710 23:26:35.647986 21072 tablet_bootstrap.cc:427] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Bootstrap starting. I0710 23:26:35.659940 21057 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:43205 I0710 23:26:35.660305 21057 webserver.cc:175] Starting webserver on 127.18.43.1:43777 I0710 23:26:35.660323 21057 webserver.cc:186] Document root disabled I0710 23:26:35.660734 21057 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:43777/ I0710 23:26:35.661321 21057 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestCopyFromCrashedSource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:35.661743 21057 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:35.666426 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 21057 I0710 23:26:35.670518 21177 heartbeater.cc:346] Connected to a master server at 127.18.43.62:41969 I0710 23:26:35.670668 21177 heartbeater.cc:426] Registering TS with master... I0710 23:26:35.671123 21177 heartbeater.cc:475] Master 127.18.43.62:41969 requested a full tablet report, sending... I0710 23:26:35.672533 20857 ts_manager.cc:104] Re-registered known tserver with Master: 0cfc001f09ea4e7ca0d4192d5639ff4e (127.18.43.1:43205) I0710 23:26:35.673548 20857 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:54879 I0710 23:26:35.677232 21072 log.cc:525] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Log is configured to *not* fsync() on all Append() calls I0710 23:26:36.026862 21072 tablet_bootstrap.cc:427] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Bootstrap replayed 1/1 log segments. Stats: ops{read=209 overwritten=0 applied=209 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:36.027312 21072 tablet_bootstrap.cc:427] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Bootstrap complete. I0710 23:26:36.028292 21072 ts_tablet_manager.cc:1045] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Time spent bootstrapping tablet: real 0.380s user 0.338s sys 0.040s I0710 23:26:36.030876 21072 raft_consensus.cc:325] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:36.030968 21072 raft_consensus.cc:630] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0cfc001f09ea4e7ca0d4192d5639ff4e, State: Initialized, Role: FOLLOWER I0710 23:26:36.031397 21072 consensus_queue.cc:227] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:36.031461 21072 raft_consensus.cc:365] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:36.031500 21072 raft_consensus.cc:457] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:36.031575 21072 raft_consensus.cc:2732] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Snoozing failure detection for 2.193s (starting election) I0710 23:26:36.031631 21072 raft_consensus.cc:2784] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:36.033094 21072 raft_consensus.cc:479] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:36.033457 21072 leader_election.cc:278] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:36.033912 21182 raft_consensus.cc:2732] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Snoozing failure detection for 2.214s (election complete) I0710 23:26:36.033954 21182 raft_consensus.cc:2539] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:36.034090 21182 raft_consensus.cc:595] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [term 2 LEADER]: Becoming Leader. State: Replica: 0cfc001f09ea4e7ca0d4192d5639ff4e, State: Running, Role: LEADER I0710 23:26:36.034173 21177 heartbeater.cc:467] Master 127.18.43.62:41969 was elected leader, sending a full tablet report... I0710 23:26:36.034375 21072 ts_tablet_manager.cc:1073] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s I0710 23:26:36.034426 21182 consensus_queue.cc:204] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 209, Committed index: 209, Last appended: 1.209, Last appended by leader: 209, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:36.036694 20857 catalog_manager.cc:3827] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } health_report { overall_health: HEALTHY } } } I0710 23:26:36.046598 21190 tablet_replica.cc:261] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: stopping tablet replica I0710 23:26:36.046775 21190 raft_consensus.cc:2042] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b [term 1 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:36.046872 21190 raft_consensus.cc:2069] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b [term 1 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:36.047039 21190 ts_tablet_manager.cc:669] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Initiating tablet copy from peer 0cfc001f09ea4e7ca0d4192d5639ff4e (127.18.43.1:43205) I0710 23:26:36.047185 21190 tablet_copy_client.cc:239] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:43205 I0710 23:26:36.051502 21154 tablet_copy_service.cc:135] P 0cfc001f09ea4e7ca0d4192d5639ff4e: Received BeginTabletCopySession request for tablet 915e69c344a141c1bc158939cbb55d28 from peer 499849c323044bfba0fea8a0527ead6b ({username='slave'} at 127.18.43.2:59941) I0710 23:26:36.051622 21154 tablet_copy_service.cc:156] P 0cfc001f09ea4e7ca0d4192d5639ff4e: Beginning new tablet copy session on tablet 915e69c344a141c1bc158939cbb55d28 from peer 499849c323044bfba0fea8a0527ead6b at {username='slave'} at 127.18.43.2:59941: session id = 499849c323044bfba0fea8a0527ead6b-915e69c344a141c1bc158939cbb55d28 I0710 23:26:36.052561 21154 tablet_copy_source_session.cc:202] T 915e69c344a141c1bc158939cbb55d28 P 0cfc001f09ea4e7ca0d4192d5639ff4e: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:36.053568 21190 ts_tablet_manager.cc:1369] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Deleting tablet data with delete state TABLET_DATA_COPYING I0710 23:26:36.055389 21190 ts_tablet_manager.cc:1382] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 1.0 I0710 23:26:36.055555 21190 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 915e69c344a141c1bc158939cbb55d28. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:36.056530 21190 ts_tablet_manager.cc:1173] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:36.056692 21190 tablet_copy_client.cc:566] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet copy: Starting download of 0 data blocks... I0710 23:26:36.056790 21190 tablet_copy_client.cc:529] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet copy: Starting download of 1 WAL segments... I0710 23:26:36.060087 21190 tablet_copy_client.cc:405] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:36.061388 21190 ts_tablet_manager.cc:1028] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Bootstrapping tablet I0710 23:26:36.061646 21190 tablet_bootstrap.cc:427] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Bootstrap starting. I0710 23:26:36.078588 21190 log.cc:525] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Log is configured to *not* fsync() on all Append() calls I0710 23:26:36.430850 21190 tablet_bootstrap.cc:427] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=210 overwritten=0 applied=210 ignored=0} inserts{seen=10400 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:36.431221 21190 tablet_bootstrap.cc:427] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Bootstrap complete. I0710 23:26:36.431565 21190 ts_tablet_manager.cc:1045] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Time spent bootstrapping tablet: real 0.370s user 0.360s sys 0.008s I0710 23:26:36.433671 21190 raft_consensus.cc:325] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:36.433748 21190 raft_consensus.cc:630] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 499849c323044bfba0fea8a0527ead6b, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:36.433995 21190 consensus_queue.cc:227] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 210, Last appended: 2.210, Last appended by leader: 210, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0cfc001f09ea4e7ca0d4192d5639ff4e" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 43205 } } I0710 23:26:36.434444 21051 heartbeater.cc:467] Master 127.18.43.62:41969 was elected leader, sending a full tablet report... I0710 23:26:36.434597 21190 ts_tablet_manager.cc:1073] T 915e69c344a141c1bc158939cbb55d28 P 499849c323044bfba0fea8a0527ead6b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s I0710 23:26:36.435731 21154 tablet_copy_service.cc:325] P 0cfc001f09ea4e7ca0d4192d5639ff4e: Request end of tablet copy session 499849c323044bfba0fea8a0527ead6b-915e69c344a141c1bc158939cbb55d28 received from {username='slave'} at 127.18.43.2:59941 I0710 23:26:36.435770 21154 tablet_copy_service.cc:413] P 0cfc001f09ea4e7ca0d4192d5639ff4e: ending tablet copy session 499849c323044bfba0fea8a0527ead6b-915e69c344a141c1bc158939cbb55d28 on tablet 915e69c344a141c1bc158939cbb55d28 with peer 499849c323044bfba0fea8a0527ead6b I0710 23:26:36.438441 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 21057 W0710 23:26:36.442709 20942 connection.cc:512] client connection to 127.18.43.1:43205 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:43205): Connection reset by peer (error 104) W0710 23:26:36.442709 20510 connection.cc:512] client connection to 127.18.43.1:43205 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:43205): Connection reset by peer (error 104) W0710 23:26:36.442714 20839 connection.cc:512] server connection from 127.18.43.1:54879 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:54879): Connection reset by peer (error 104) I0710 23:26:36.442910 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 20932 W0710 23:26:36.447093 20841 connection.cc:512] server connection from 127.18.43.2:55435 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:55435): Connection reset by peer (error 104) W0710 23:26:36.447093 20510 connection.cc:512] client connection to 127.18.43.2:39849 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:39849): Connection reset by peer (error 104) I0710 23:26:36.447227 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 20832 W0710 23:26:36.451380 20510 connection.cc:512] client connection to 127.18.43.62:41969 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:41969): Connection reset by peer (error 104) [ OK ] TabletCopyClientSessionITest.TestCopyFromCrashedSource (2733 ms) [ RUN ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource I0710 23:26:36.457000 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:33645 --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:36.504580 21195 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:36.504765 21195 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:36.505758 21195 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:36.505784 21195 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:36.505790 21195 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:36.505797 21195 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:36.507340 21195 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:33645 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/info.pb --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:36.510700 21195 master_main.cc:80] Initializing master server... I0710 23:26:36.511199 21195 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 192516us I0710 23:26:36.512079 21195 fs_manager.cc:261] Metadata directory not provided I0710 23:26:36.512120 21195 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:36.512329 21195 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:36.512347 21195 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:36.514961 21195 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/instance: uuid: "d9dba925898d4538b19101b62cb8bb22" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.515297 21195 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal/instance: uuid: "d9dba925898d4538b19101b62cb8bb22" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.520493 21195 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s I0710 23:26:36.521231 21195 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:36.521533 21195 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:36.524534 21195 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:36.524658 21195 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal uuid: "d9dba925898d4538b19101b62cb8bb22" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.524760 21195 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:36.611114 21195 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:36.611920 21195 master_main.cc:83] Starting Master server... I0710 23:26:36.616005 21195 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:33645 I0710 23:26:36.616345 21195 webserver.cc:175] Starting webserver on 127.18.43.62:0 I0710 23:26:36.616364 21195 webserver.cc:186] Document root disabled I0710 23:26:36.616778 21195 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:42027/ I0710 23:26:36.617321 21195 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/info.pb I0710 23:26:36.619760 21254 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:36.621992 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 21195 I0710 23:26:36.622516 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:0 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:33645 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --num_tablets_to_copy_simultaneously=20 with env {} I0710 23:26:36.625152 21254 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Bootstrap starting. I0710 23:26:36.626953 21254 tablet_bootstrap.cc:578] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: No blocks or log segments found. Creating new log. I0710 23:26:36.627708 21254 log.cc:525] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Log is configured to *not* fsync() on all Append() calls I0710 23:26:36.629006 21254 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: No bootstrap required, opened a new log I0710 23:26:36.632661 21254 raft_consensus.cc:325] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } I0710 23:26:36.632741 21254 raft_consensus.cc:351] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:36.632772 21254 raft_consensus.cc:630] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9dba925898d4538b19101b62cb8bb22, State: Initialized, Role: FOLLOWER I0710 23:26:36.633198 21254 consensus_queue.cc:227] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } I0710 23:26:36.633253 21254 raft_consensus.cc:365] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:36.633288 21254 raft_consensus.cc:457] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:36.633348 21254 raft_consensus.cc:2732] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Snoozing failure detection for 1.614s (starting election) I0710 23:26:36.633399 21254 raft_consensus.cc:2784] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:36.634516 21254 raft_consensus.cc:479] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } I0710 23:26:36.634863 21254 leader_election.cc:278] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:36.635485 21254 sys_catalog.cc:337] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } } I0710 23:26:36.635527 21254 sys_catalog.cc:340] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: This master's current role is: FOLLOWER I0710 23:26:36.635745 21257 raft_consensus.cc:2732] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Snoozing failure detection for 2.179s (election complete) I0710 23:26:36.635784 21257 raft_consensus.cc:2539] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:36.635910 21257 raft_consensus.cc:595] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 1 LEADER]: Becoming Leader. State: Replica: d9dba925898d4538b19101b62cb8bb22, State: Running, Role: LEADER I0710 23:26:36.636162 21257 consensus_queue.cc:204] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } I0710 23:26:36.637073 21254 sys_catalog.cc:424] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:36.637141 21257 sys_catalog.cc:337] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d9dba925898d4538b19101b62cb8bb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } } I0710 23:26:36.637163 21257 sys_catalog.cc:340] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: This master's current role is: LEADER I0710 23:26:36.637282 21257 sys_catalog.cc:337] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9dba925898d4538b19101b62cb8bb22. Latest consensus state: current_term: 1 leader_uuid: "d9dba925898d4538b19101b62cb8bb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } } I0710 23:26:36.637460 21195 master_main.cc:86] Master server successfully started. I0710 23:26:36.637500 21257 sys_catalog.cc:340] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: This master's current role is: LEADER W0710 23:26:36.639523 21261 catalog_manager.cc:1075] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0710 23:26:36.639573 21261 catalog_manager.cc:574] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0710 23:26:36.649370 21262 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:36.650436 21262 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... I0710 23:26:36.683239 21262 catalog_manager.cc:915] Generated new certificate authority record I0710 23:26:36.684527 21262 catalog_manager.cc:1037] Loading token signing keys... WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:36.692133 21255 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:36.692348 21255 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0710 23:26:36.692785 21262 catalog_manager.cc:4131] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Generated new TSK 0 W0710 23:26:36.693322 21255 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:36.693398 21255 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:36.695039 21255 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:33645 --num_tablets_to_copy_simultaneously=20 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:36.698624 21255 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:36.699419 21255 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 192516us I0710 23:26:36.699993 21255 fs_manager.cc:261] Metadata directory not provided I0710 23:26:36.700033 21255 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:36.700230 21255 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:36.700247 21255 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:36.702838 21255 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/instance: uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.703160 21255 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal/instance: uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.709046 21255 fs_manager.cc:501] Time spent creating directory manager: real 0.006s user 0.002s sys 0.004s I0710 23:26:36.709743 21255 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:36.710011 21255 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:36.713021 21255 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:36.713167 21255 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.713263 21255 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:36.738687 21255 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:36.739511 21255 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:36.739819 21255 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:36.746258 21255 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:46659 I0710 23:26:36.746675 21255 webserver.cc:175] Starting webserver on 127.18.43.1:0 I0710 23:26:36.746706 21255 webserver.cc:186] Document root disabled I0710 23:26:36.747248 21255 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:45475/ I0710 23:26:36.747941 21255 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:36.748428 21255 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:36.757455 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 21255 I0710 23:26:36.757959 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:0 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:33645 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --num_tablets_to_copy_simultaneously=20 with env {} I0710 23:26:36.762854 21384 heartbeater.cc:346] Connected to a master server at 127.18.43.62:33645 I0710 23:26:36.762992 21384 heartbeater.cc:426] Registering TS with master... I0710 23:26:36.763363 21384 heartbeater.cc:475] Master 127.18.43.62:33645 requested a full tablet report, sending... I0710 23:26:36.764748 21221 ts_manager.cc:98] Registered new tserver with Master: 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:36.767292 21221 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:33753 WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:36.818604 21388 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:36.818783 21388 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:36.819655 21388 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:36.819720 21388 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:36.821069 21388 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:33645 --num_tablets_to_copy_simultaneously=20 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:36.824611 21388 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:36.825412 21388 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 192516us I0710 23:26:36.825953 21388 fs_manager.cc:261] Metadata directory not provided I0710 23:26:36.825989 21388 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:36.826200 21388 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:36.826216 21388 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:36.828809 21388 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/instance: uuid: "5cb08d1962334a93b8e230c76a0b6099" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.829119 21388 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal/instance: uuid: "5cb08d1962334a93b8e230c76a0b6099" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.834162 21388 fs_manager.cc:501] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s I0710 23:26:36.834844 21388 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:36.835098 21388 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:36.837895 21388 fs_manager.cc:417] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0710 23:26:36.838013 21388 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "5cb08d1962334a93b8e230c76a0b6099" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.838111 21388 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:36.890413 21388 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:36.891330 21388 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:36.891458 21388 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:36.896683 21388 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:38483 I0710 23:26:36.897020 21388 webserver.cc:175] Starting webserver on 127.18.43.2:0 I0710 23:26:36.897040 21388 webserver.cc:186] Document root disabled I0710 23:26:36.897469 21388 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:44369/ I0710 23:26:36.898006 21388 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:36.898471 21388 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:36.903514 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 21388 I0710 23:26:36.906895 21507 heartbeater.cc:346] Connected to a master server at 127.18.43.62:33645 I0710 23:26:36.907048 21507 heartbeater.cc:426] Registering TS with master... I0710 23:26:36.907523 21507 heartbeater.cc:475] Master 127.18.43.62:33645 requested a full tablet report, sending... I0710 23:26:36.908455 21220 ts_manager.cc:98] Registered new tserver with Master: 5cb08d1962334a93b8e230c76a0b6099 (127.18.43.2:38483) I0710 23:26:36.909107 21220 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:39949 I0710 23:26:36.909941 18604 external_mini_cluster.cc:505] 2 TS(s) registered with all masters I0710 23:26:36.917170 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 21388 W0710 23:26:36.921090 21203 connection.cc:512] server connection from 127.18.43.2:39949 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:39949): Connection reset by peer (error 104) I0710 23:26:36.921188 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 21195 W0710 23:26:36.925091 21515 connection.cc:512] client connection to 127.18.43.62:33645 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:33645): Connection reset by peer (error 104) W0710 23:26:36.925091 21194 connection.cc:512] client connection to 127.18.43.62:33645 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:33645): Connection reset by peer (error 104) W0710 23:26:36.925159 21275 connection.cc:512] client connection to 127.18.43.62:33645 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:33645): Connection reset by peer (error 104) I0710 23:26:36.926190 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:33645 --webserver_interface=127.18.43.62 --webserver_port=42027 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:36.978672 21517 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:36.978852 21517 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:36.979835 21517 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:36.979861 21517 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:36.979866 21517 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:36.979873 21517 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:36.981406 21517 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:33645 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/info.pb --webserver_interface=127.18.43.62 --webserver_port=42027 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:36.984663 21517 master_main.cc:80] Initializing master server... I0710 23:26:36.985152 21517 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 192516us I0710 23:26:36.985975 21517 fs_manager.cc:261] Metadata directory not provided I0710 23:26:36.986037 21517 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:36.989933 21517 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:36.990434 21517 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:36.990726 21517 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:36.994068 21517 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:36.994653 21517 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal uuid: "d9dba925898d4538b19101b62cb8bb22" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:36.994776 21517 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:37.009960 21517 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:37.010517 21517 master_main.cc:83] Starting Master server... I0710 23:26:37.014766 21517 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:33645 I0710 23:26:37.015100 21517 webserver.cc:175] Starting webserver on 127.18.43.62:42027 I0710 23:26:37.015120 21517 webserver.cc:186] Document root disabled I0710 23:26:37.015509 21517 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:42027/ I0710 23:26:37.016152 21517 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/master-0/data/info.pb I0710 23:26:37.021049 21576 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Bootstrap starting. I0710 23:26:37.024171 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 21517 I0710 23:26:37.036307 21576 log.cc:525] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Log is configured to *not* fsync() on all Append() calls I0710 23:26:37.042002 21576 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=1} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:37.042454 21576 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Bootstrap complete. I0710 23:26:37.046006 21576 raft_consensus.cc:325] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } I0710 23:26:37.046078 21576 raft_consensus.cc:630] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d9dba925898d4538b19101b62cb8bb22, State: Initialized, Role: FOLLOWER I0710 23:26:37.046408 21576 consensus_queue.cc:227] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } I0710 23:26:37.046463 21576 raft_consensus.cc:365] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.046499 21576 raft_consensus.cc:457] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.046561 21576 raft_consensus.cc:2732] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Snoozing failure detection for 1.852s (starting election) I0710 23:26:37.046591 21576 raft_consensus.cc:2784] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:37.048435 21576 raft_consensus.cc:479] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } I0710 23:26:37.048738 21576 leader_election.cc:278] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:37.049129 21579 raft_consensus.cc:2732] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Snoozing failure detection for 1.996s (election complete) I0710 23:26:37.049175 21579 raft_consensus.cc:2539] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:37.049301 21579 raft_consensus.cc:595] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [term 2 LEADER]: Becoming Leader. State: Replica: d9dba925898d4538b19101b62cb8bb22, State: Running, Role: LEADER I0710 23:26:37.049543 21579 consensus_queue.cc:204] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } I0710 23:26:37.050328 21579 sys_catalog.cc:337] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "d9dba925898d4538b19101b62cb8bb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } } I0710 23:26:37.050364 21579 sys_catalog.cc:340] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: This master's current role is: LEADER I0710 23:26:37.050520 21579 sys_catalog.cc:337] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d9dba925898d4538b19101b62cb8bb22. Latest consensus state: current_term: 2 leader_uuid: "d9dba925898d4538b19101b62cb8bb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } } I0710 23:26:37.050542 21579 sys_catalog.cc:340] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: This master's current role is: LEADER I0710 23:26:37.050581 21576 sys_catalog.cc:337] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "d9dba925898d4538b19101b62cb8bb22" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d9dba925898d4538b19101b62cb8bb22" member_type: VOTER } } I0710 23:26:37.050629 21576 sys_catalog.cc:340] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: This master's current role is: LEADER I0710 23:26:37.051270 21576 sys_catalog.cc:424] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22 [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:37.051635 21517 master_main.cc:86] Master server successfully started. I0710 23:26:37.055392 21584 catalog_manager.cc:1073] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: acquiring CA information for follower catalog manager: success I0710 23:26:37.060823 21584 catalog_manager.cc:1101] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0710 23:26:37.060928 21583 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:37.062060 21583 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... I0710 23:26:37.062634 21583 catalog_manager.cc:1037] Loading token signing keys... I0710 23:26:37.063038 21583 catalog_manager.cc:4142] T 00000000000000000000000000000000 P d9dba925898d4538b19101b62cb8bb22: Loaded TSK: 0 I0710 23:26:37.769424 21384 heartbeater.cc:467] Master 127.18.43.62:33645 was elected leader, sending a full tablet report... I0710 23:26:37.774413 21538 master_service.cc:205] Got heartbeat from unknown tserver (permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" instance_seqno: 1531265196745005) as {username='slave'} at 127.18.43.1:38549; Asking this server to re-register. I0710 23:26:37.774983 21384 heartbeater.cc:426] Registering TS with master... I0710 23:26:37.775117 21384 heartbeater.cc:475] Master 127.18.43.62:33645 requested a full tablet report, sending... I0710 23:26:37.775923 21538 ts_manager.cc:98] Registered new tserver with Master: 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:37.777148 18604 external_mini_cluster.cc:505] 1 TS(s) registered with all masters I0710 23:26:37.777220 18604 test_util.cc:208] Using random seed: 1982570819 I0710 23:26:37.786968 21538 catalog_manager.cc:1350] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43096: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { rows: "\004\001\000fff\006\004\001\000\314\314\314\014\004\001\000233\023\004\001\000\230\231\231\031\004\001\000\376\377\377\037\004\001\000dff&\004\001\000\312\314\314,\004\001\0000333\004\001\000\226\231\2319\004\001\000\374\377\377?\004\001\000bffF\004\001\000\310\314\314L\004\001\000.33S\004\001\000\224\231\231Y\004\001\000\372\377\377_\004\001\000`fff\004\001\000\306\314\314l\004\001\000,33s\004\001\000\222\231\231y" } partition_schema { range_schema { columns { name: "key" } } } I0710 23:26:37.805956 21319 tablet_service.cc:759] Processing CreateTablet for tablet 0617cd1d64ed4dfab4679b69255e839e (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 322122546 I0710 23:26:37.805951 21318 tablet_service.cc:759] Processing CreateTablet for tablet e55b3ed036a24cb1ac30f337d5386072 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 322122546 <= VALUES < 429496728 I0710 23:26:37.805953 21317 tablet_service.cc:759] Processing CreateTablet for tablet 16e52b82ff124e2093345d5204b7d086 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 536870910 I0710 23:26:37.806159 21316 tablet_service.cc:759] Processing CreateTablet for tablet 224d94b52b9e4f859d90edb71b9dc822 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 536870910 <= VALUES < 644245092 I0710 23:26:37.805953 21321 tablet_service.cc:759] Processing CreateTablet for tablet e425aeacae634ba695a97557c5ebb75a (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION VALUES < 107374182 I0710 23:26:37.806360 21315 tablet_service.cc:759] Processing CreateTablet for tablet 8a5f88d22d2b482d9691c52031cafd6e (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 751619274 I0710 23:26:37.806485 21319 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 0617cd1d64ed4dfab4679b69255e839e. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.806620 21314 tablet_service.cc:759] Processing CreateTablet for tablet 6be9b59101ec4ae6bec4f3111efb82b3 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 751619274 <= VALUES < 858993456 I0710 23:26:37.806823 21313 tablet_service.cc:759] Processing CreateTablet for tablet 9dded2401cb943f0a2bea0337291992a (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 966367638 I0710 23:26:37.807005 21312 tablet_service.cc:759] Processing CreateTablet for tablet 3382fcc7728248248fce1bb6b6e10422 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 966367638 <= VALUES < 1073741820 I0710 23:26:37.807181 21311 tablet_service.cc:759] Processing CreateTablet for tablet 39212fb42d874c3cad5a34357eae1a51 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1181116002 I0710 23:26:37.807355 21310 tablet_service.cc:759] Processing CreateTablet for tablet 58a8d45cf5284f579b89c73d87015736 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1181116002 <= VALUES < 1288490184 I0710 23:26:37.807480 21305 tablet_service.cc:759] Processing CreateTablet for tablet 420e91af2ba54520ac1b422b22a543eb (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1825361094 I0710 23:26:37.807576 21309 tablet_service.cc:759] Processing CreateTablet for tablet 5a0de49957f84b51b2c03d3e432ee897 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1395864366 I0710 23:26:37.807698 21307 tablet_service.cc:759] Processing CreateTablet for tablet ec16d86dcdb34a5b9f6dc60e9a5d3866 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1610612730 I0710 23:26:37.807713 21320 tablet_service.cc:759] Processing CreateTablet for tablet f49626b5d56d4f828e36578b5101e8e0 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 107374182 <= VALUES < 214748364 I0710 23:26:37.807770 21306 tablet_service.cc:759] Processing CreateTablet for tablet 05ab889d520c4b5db0cab1b6d7e8ae86 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1610612730 <= VALUES < 1717986912 I0710 23:26:37.807776 21304 tablet_service.cc:759] Processing CreateTablet for tablet d9d53b3911f045fda410a0ae098496f4 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1825361094 <= VALUES < 1932735276 I0710 23:26:37.807808 21308 tablet_service.cc:759] Processing CreateTablet for tablet fbe2894430174092986bffc0d8021206 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1395864366 <= VALUES < 1503238548 I0710 23:26:37.807920 21321 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet e425aeacae634ba695a97557c5ebb75a. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.808018 21303 tablet_service.cc:759] Processing CreateTablet for tablet bfe7d79a3ac644dc8598fc864fbe659e (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION 1932735276 <= VALUES < 2040109458 I0710 23:26:37.808038 21314 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 6be9b59101ec4ae6bec4f3111efb82b3. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.808159 21312 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 3382fcc7728248248fce1bb6b6e10422. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.808256 21302 tablet_service.cc:759] Processing CreateTablet for tablet 188113a621d14966945feb51e41ea4a5 (table=test-workload [id=21b8bec674704010bdd98218a99d2e05]), partition=RANGE (key) PARTITION VALUES >= 2040109458 I0710 23:26:37.808261 21316 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 224d94b52b9e4f859d90edb71b9dc822. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.808497 21313 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 9dded2401cb943f0a2bea0337291992a. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.808713 21311 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 39212fb42d874c3cad5a34357eae1a51. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.808953 21317 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 16e52b82ff124e2093345d5204b7d086. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.809222 21315 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 8a5f88d22d2b482d9691c52031cafd6e. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.810039 21310 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 58a8d45cf5284f579b89c73d87015736. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.810307 21305 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 420e91af2ba54520ac1b422b22a543eb. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.810591 21302 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 188113a621d14966945feb51e41ea4a5. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.810830 21309 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 5a0de49957f84b51b2c03d3e432ee897. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.811043 21306 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 05ab889d520c4b5db0cab1b6d7e8ae86. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.811251 21318 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet e55b3ed036a24cb1ac30f337d5386072. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.813068 21308 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet fbe2894430174092986bffc0d8021206. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.813374 21307 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet ec16d86dcdb34a5b9f6dc60e9a5d3866. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.813601 21320 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f49626b5d56d4f828e36578b5101e8e0. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.813894 21304 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet d9d53b3911f045fda410a0ae098496f4. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.814155 21318 ts_tablet_manager.cc:1173] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.814275 21311 ts_tablet_manager.cc:1173] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.814404 21303 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet bfe7d79a3ac644dc8598fc864fbe659e. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:37.815539 21304 ts_tablet_manager.cc:1173] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.815668 21314 ts_tablet_manager.cc:1173] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.815834 21313 ts_tablet_manager.cc:1173] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.816040 21600 ts_tablet_manager.cc:1028] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.816253 21600 tablet_bootstrap.cc:427] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.816735 21310 ts_tablet_manager.cc:1173] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.817658 21600 tablet_bootstrap.cc:578] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.817880 21305 ts_tablet_manager.cc:1173] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.818298 21600 log.cc:525] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Log is configured to *not* fsync() on all Append() calls I0710 23:26:37.819195 21302 ts_tablet_manager.cc:1173] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.819327 21600 tablet_bootstrap.cc:427] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.819533 21600 ts_tablet_manager.cc:1045] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0710 23:26:37.819983 21303 ts_tablet_manager.cc:1173] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.820713 21312 ts_tablet_manager.cc:1173] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.822223 21309 ts_tablet_manager.cc:1173] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.822479 21315 ts_tablet_manager.cc:1173] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.822664 21306 ts_tablet_manager.cc:1173] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.822723 21600 raft_consensus.cc:325] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.822778 21600 raft_consensus.cc:351] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.822816 21600 raft_consensus.cc:630] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.823221 21600 consensus_queue.cc:227] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.823278 21600 raft_consensus.cc:365] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.823308 21600 raft_consensus.cc:457] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.823360 21600 raft_consensus.cc:2732] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.753s (starting election) I0710 23:26:37.823384 21600 raft_consensus.cc:2784] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.823679 21316 ts_tablet_manager.cc:1173] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.824223 21600 raft_consensus.cc:479] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.824435 21319 ts_tablet_manager.cc:1173] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.824584 21600 leader_election.cc:278] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.825431 21321 ts_tablet_manager.cc:1173] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.825623 21317 ts_tablet_manager.cc:1173] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.826017 21308 ts_tablet_manager.cc:1173] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.826726 21600 ts_tablet_manager.cc:1073] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s I0710 23:26:37.826807 21307 ts_tablet_manager.cc:1173] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.826947 21600 ts_tablet_manager.cc:1028] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.827016 21600 tablet_bootstrap.cc:427] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.827935 21600 tablet_bootstrap.cc:578] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.828156 21320 ts_tablet_manager.cc:1173] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:37.828609 21602 raft_consensus.cc:2732] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.696s (election complete) I0710 23:26:37.828989 21602 raft_consensus.cc:2539] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.829051 21602 raft_consensus.cc:595] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.829213 21600 tablet_bootstrap.cc:427] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.829291 21600 ts_tablet_manager.cc:1045] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.829402 21602 consensus_queue.cc:204] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.829764 21600 raft_consensus.cc:325] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.829792 21600 raft_consensus.cc:351] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.829802 21600 raft_consensus.cc:630] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.829910 21600 consensus_queue.cc:227] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.829934 21600 raft_consensus.cc:365] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.829946 21600 raft_consensus.cc:457] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.829967 21600 raft_consensus.cc:2732] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.979s (starting election) I0710 23:26:37.829979 21600 raft_consensus.cc:2784] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.830785 21600 raft_consensus.cc:479] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.830915 21600 leader_election.cc:278] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.831188 21600 ts_tablet_manager.cc:1073] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.831384 21600 ts_tablet_manager.cc:1028] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.831521 21600 tablet_bootstrap.cc:427] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.831280 21603 raft_consensus.cc:2732] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.774s (election complete) I0710 23:26:37.831677 21603 raft_consensus.cc:2539] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.831851 21603 raft_consensus.cc:595] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.832018 21603 consensus_queue.cc:204] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.832242 21534 catalog_manager.cc:3827] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.833216 21600 tablet_bootstrap.cc:578] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.834136 21600 tablet_bootstrap.cc:427] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.834216 21600 ts_tablet_manager.cc:1045] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s I0710 23:26:37.834709 21600 raft_consensus.cc:325] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.834739 21600 raft_consensus.cc:351] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.834753 21600 raft_consensus.cc:630] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.834866 21600 consensus_queue.cc:227] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.834897 21600 raft_consensus.cc:365] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.834940 21600 raft_consensus.cc:457] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.834961 21600 raft_consensus.cc:2732] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.205s (starting election) I0710 23:26:37.834975 21600 raft_consensus.cc:2784] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.835695 21534 catalog_manager.cc:3827] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.835927 21600 raft_consensus.cc:479] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.836016 21600 leader_election.cc:278] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.836167 21603 raft_consensus.cc:2732] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.611s (election complete) I0710 23:26:37.836231 21603 raft_consensus.cc:2539] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.836282 21600 ts_tablet_manager.cc:1073] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.836372 21600 ts_tablet_manager.cc:1028] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.836454 21600 tablet_bootstrap.cc:427] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.837244 21600 tablet_bootstrap.cc:578] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.836290 21603 raft_consensus.cc:595] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.837837 21603 consensus_queue.cc:204] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.838330 21600 tablet_bootstrap.cc:427] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.838408 21600 ts_tablet_manager.cc:1045] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.838851 21600 raft_consensus.cc:325] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.838856 21538 catalog_manager.cc:3827] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.838884 21600 raft_consensus.cc:351] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.838898 21600 raft_consensus.cc:630] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.839498 21600 consensus_queue.cc:227] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.839578 21600 raft_consensus.cc:365] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.839639 21600 raft_consensus.cc:457] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.839689 21600 raft_consensus.cc:2732] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.843s (starting election) I0710 23:26:37.839717 21600 raft_consensus.cc:2784] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.840585 21600 raft_consensus.cc:479] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.840664 21600 leader_election.cc:278] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.840852 21603 raft_consensus.cc:2732] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.781s (election complete) I0710 23:26:37.840903 21603 raft_consensus.cc:2539] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.840968 21603 raft_consensus.cc:595] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.840992 21600 ts_tablet_manager.cc:1073] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0710 23:26:37.841158 21603 consensus_queue.cc:204] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.841163 21600 ts_tablet_manager.cc:1028] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.841241 21600 tablet_bootstrap.cc:427] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.842182 21600 tablet_bootstrap.cc:578] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.842332 21538 catalog_manager.cc:3827] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.843140 21600 tablet_bootstrap.cc:427] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.843215 21600 ts_tablet_manager.cc:1045] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.843786 21600 raft_consensus.cc:325] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.843813 21600 raft_consensus.cc:351] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.843824 21600 raft_consensus.cc:630] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.843997 21600 consensus_queue.cc:227] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.844027 21600 raft_consensus.cc:365] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.844038 21600 raft_consensus.cc:457] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.844061 21600 raft_consensus.cc:2732] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.210s (starting election) I0710 23:26:37.844076 21600 raft_consensus.cc:2784] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.844991 21600 raft_consensus.cc:479] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.845072 21600 leader_election.cc:278] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.845216 21603 raft_consensus.cc:2732] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.916s (election complete) I0710 23:26:37.845284 21603 raft_consensus.cc:2539] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.845337 21600 ts_tablet_manager.cc:1073] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.845365 21603 raft_consensus.cc:595] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.845412 21600 ts_tablet_manager.cc:1028] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.845510 21603 consensus_queue.cc:204] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.845513 21600 tablet_bootstrap.cc:427] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.846663 21600 tablet_bootstrap.cc:578] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.846845 21538 catalog_manager.cc:3827] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.847784 21600 tablet_bootstrap.cc:427] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.847867 21600 ts_tablet_manager.cc:1045] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.848307 21600 raft_consensus.cc:325] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.848335 21600 raft_consensus.cc:351] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.848350 21600 raft_consensus.cc:630] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.848505 21600 consensus_queue.cc:227] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.848533 21600 raft_consensus.cc:365] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.848543 21600 raft_consensus.cc:457] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.848568 21600 raft_consensus.cc:2732] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.176s (starting election) I0710 23:26:37.848583 21600 raft_consensus.cc:2784] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.849413 21600 raft_consensus.cc:479] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.849498 21600 leader_election.cc:278] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.849663 21603 raft_consensus.cc:2732] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.002s (election complete) I0710 23:26:37.849736 21603 raft_consensus.cc:2539] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.849788 21603 raft_consensus.cc:595] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.849792 21600 ts_tablet_manager.cc:1073] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.849858 21600 ts_tablet_manager.cc:1028] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.849916 21603 consensus_queue.cc:204] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.849922 21600 tablet_bootstrap.cc:427] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.850834 21600 tablet_bootstrap.cc:578] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.851095 21538 catalog_manager.cc:3827] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.851680 21600 tablet_bootstrap.cc:427] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.851752 21600 ts_tablet_manager.cc:1045] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.852159 21600 raft_consensus.cc:325] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.852190 21600 raft_consensus.cc:351] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.852203 21600 raft_consensus.cc:630] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.852310 21600 consensus_queue.cc:227] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.852354 21600 raft_consensus.cc:365] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.852373 21600 raft_consensus.cc:457] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.852391 21600 raft_consensus.cc:2732] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.751s (starting election) I0710 23:26:37.852409 21600 raft_consensus.cc:2784] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.853294 21600 raft_consensus.cc:479] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.853379 21600 leader_election.cc:278] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.853516 21606 raft_consensus.cc:2732] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.864s (election complete) I0710 23:26:37.853580 21606 raft_consensus.cc:2539] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.853632 21600 ts_tablet_manager.cc:1073] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.853703 21600 ts_tablet_manager.cc:1028] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.853770 21600 tablet_bootstrap.cc:427] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.854638 21600 tablet_bootstrap.cc:578] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.853638 21606 raft_consensus.cc:595] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.855293 21606 consensus_queue.cc:204] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.856531 21538 catalog_manager.cc:3827] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.856588 21600 tablet_bootstrap.cc:427] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.856673 21600 ts_tablet_manager.cc:1045] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s I0710 23:26:37.857125 21600 raft_consensus.cc:325] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.857161 21600 raft_consensus.cc:351] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.857174 21600 raft_consensus.cc:630] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.857317 21600 consensus_queue.cc:227] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.857345 21600 raft_consensus.cc:365] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.857358 21600 raft_consensus.cc:457] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.857389 21600 raft_consensus.cc:2732] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.588s (starting election) I0710 23:26:37.857409 21600 raft_consensus.cc:2784] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.858336 21600 raft_consensus.cc:479] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.858418 21600 leader_election.cc:278] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.858562 21606 raft_consensus.cc:2732] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.543s (election complete) I0710 23:26:37.858623 21606 raft_consensus.cc:2539] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.858671 21606 raft_consensus.cc:595] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.858681 21600 ts_tablet_manager.cc:1073] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.858770 21600 ts_tablet_manager.cc:1028] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.858786 21606 consensus_queue.cc:204] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.858841 21600 tablet_bootstrap.cc:427] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.859768 21600 tablet_bootstrap.cc:578] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.859997 21538 catalog_manager.cc:3827] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.860646 21600 tablet_bootstrap.cc:427] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.860723 21600 ts_tablet_manager.cc:1045] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.861191 21600 raft_consensus.cc:325] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.861218 21600 raft_consensus.cc:351] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.861232 21600 raft_consensus.cc:630] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.861348 21600 consensus_queue.cc:227] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.861376 21600 raft_consensus.cc:365] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.861387 21600 raft_consensus.cc:457] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.861407 21600 raft_consensus.cc:2732] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.689s (starting election) I0710 23:26:37.861454 21600 raft_consensus.cc:2784] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.862354 21600 raft_consensus.cc:479] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.862427 21600 leader_election.cc:278] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.862553 21603 raft_consensus.cc:2732] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.190s (election complete) I0710 23:26:37.862627 21603 raft_consensus.cc:2539] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.862677 21600 ts_tablet_manager.cc:1073] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.862771 21600 ts_tablet_manager.cc:1028] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.862843 21600 tablet_bootstrap.cc:427] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.862685 21603 raft_consensus.cc:595] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.863771 21603 consensus_queue.cc:204] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.864246 21600 tablet_bootstrap.cc:578] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.864972 21538 catalog_manager.cc:3827] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.865809 21600 tablet_bootstrap.cc:427] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.865892 21600 ts_tablet_manager.cc:1045] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.001s I0710 23:26:37.866312 21600 raft_consensus.cc:325] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.866341 21600 raft_consensus.cc:351] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.866356 21600 raft_consensus.cc:630] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.866502 21600 consensus_queue.cc:227] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.866528 21600 raft_consensus.cc:365] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.866539 21600 raft_consensus.cc:457] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.866562 21600 raft_consensus.cc:2732] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.138s (starting election) I0710 23:26:37.866581 21600 raft_consensus.cc:2784] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.867419 21600 raft_consensus.cc:479] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.867503 21600 leader_election.cc:278] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.867655 21603 raft_consensus.cc:2732] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.804s (election complete) I0710 23:26:37.867736 21603 raft_consensus.cc:2539] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.867786 21603 raft_consensus.cc:595] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.867805 21600 ts_tablet_manager.cc:1073] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s I0710 23:26:37.867902 21600 ts_tablet_manager.cc:1028] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.867908 21603 consensus_queue.cc:204] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.867987 21600 tablet_bootstrap.cc:427] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.868863 21600 tablet_bootstrap.cc:578] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.869127 21538 catalog_manager.cc:3827] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.869709 21600 tablet_bootstrap.cc:427] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.869781 21600 ts_tablet_manager.cc:1045] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.870216 21600 raft_consensus.cc:325] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.870261 21600 raft_consensus.cc:351] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.870276 21600 raft_consensus.cc:630] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.870419 21600 consensus_queue.cc:227] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.870455 21600 raft_consensus.cc:365] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.870467 21600 raft_consensus.cc:457] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.870508 21600 raft_consensus.cc:2732] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.602s (starting election) I0710 23:26:37.870532 21600 raft_consensus.cc:2784] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.871346 21600 raft_consensus.cc:479] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.871421 21600 leader_election.cc:278] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.871551 21603 raft_consensus.cc:2732] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.115s (election complete) I0710 23:26:37.871642 21603 raft_consensus.cc:2539] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.871697 21600 ts_tablet_manager.cc:1073] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.871717 21603 raft_consensus.cc:595] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.871773 21600 ts_tablet_manager.cc:1028] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.871836 21603 consensus_queue.cc:204] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.871857 21600 tablet_bootstrap.cc:427] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.872752 21600 tablet_bootstrap.cc:578] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.873265 21538 catalog_manager.cc:3827] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.873657 21600 tablet_bootstrap.cc:427] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.873730 21600 ts_tablet_manager.cc:1045] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.874101 21600 raft_consensus.cc:325] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.874131 21600 raft_consensus.cc:351] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.874145 21600 raft_consensus.cc:630] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.874253 21600 consensus_queue.cc:227] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.874277 21600 raft_consensus.cc:365] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.874290 21600 raft_consensus.cc:457] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.874313 21600 raft_consensus.cc:2732] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.573s (starting election) I0710 23:26:37.874330 21600 raft_consensus.cc:2784] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.875180 21600 raft_consensus.cc:479] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.875258 21600 leader_election.cc:278] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.875372 21603 raft_consensus.cc:2732] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.868s (election complete) I0710 23:26:37.875404 21603 raft_consensus.cc:2539] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.875442 21603 raft_consensus.cc:595] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.875551 21603 consensus_queue.cc:204] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.875716 21600 ts_tablet_manager.cc:1073] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.875789 21600 ts_tablet_manager.cc:1028] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.875852 21600 tablet_bootstrap.cc:427] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.876619 21600 tablet_bootstrap.cc:578] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.876739 21538 catalog_manager.cc:3827] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.877835 21600 tablet_bootstrap.cc:427] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.877913 21600 ts_tablet_manager.cc:1045] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.878301 21600 raft_consensus.cc:325] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.878327 21600 raft_consensus.cc:351] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.878338 21600 raft_consensus.cc:630] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.878450 21600 consensus_queue.cc:227] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.878475 21600 raft_consensus.cc:365] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.878494 21600 raft_consensus.cc:457] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.878516 21600 raft_consensus.cc:2732] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.090s (starting election) I0710 23:26:37.878536 21600 raft_consensus.cc:2784] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.879341 21600 raft_consensus.cc:479] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.879416 21600 leader_election.cc:278] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.879676 21603 raft_consensus.cc:2732] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.610s (election complete) I0710 23:26:37.879712 21603 raft_consensus.cc:2539] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.879745 21600 ts_tablet_manager.cc:1073] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.879781 21603 raft_consensus.cc:595] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.879820 21600 ts_tablet_manager.cc:1028] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.879881 21600 tablet_bootstrap.cc:427] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.879914 21603 consensus_queue.cc:204] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.880705 21600 tablet_bootstrap.cc:578] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.880982 21538 catalog_manager.cc:3827] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.903934 21600 tablet_bootstrap.cc:427] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.904064 21600 ts_tablet_manager.cc:1045] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.024s user 0.001s sys 0.000s I0710 23:26:37.904608 21600 raft_consensus.cc:325] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.904640 21600 raft_consensus.cc:351] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.904654 21600 raft_consensus.cc:630] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.904824 21600 consensus_queue.cc:227] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.904865 21600 raft_consensus.cc:365] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.904875 21600 raft_consensus.cc:457] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.904898 21600 raft_consensus.cc:2732] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.600s (starting election) I0710 23:26:37.904917 21600 raft_consensus.cc:2784] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.905923 21600 raft_consensus.cc:479] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.906023 21600 leader_election.cc:278] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.906208 21606 raft_consensus.cc:2732] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.662s (election complete) I0710 23:26:37.906273 21606 raft_consensus.cc:2539] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.906332 21606 raft_consensus.cc:595] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.906354 21600 ts_tablet_manager.cc:1073] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0710 23:26:37.906451 21600 ts_tablet_manager.cc:1028] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.906466 21606 consensus_queue.cc:204] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.906559 21600 tablet_bootstrap.cc:427] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.907618 21600 tablet_bootstrap.cc:578] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.907943 21538 catalog_manager.cc:3827] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.908458 21600 tablet_bootstrap.cc:427] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.908560 21600 ts_tablet_manager.cc:1045] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.908941 21600 raft_consensus.cc:325] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.908974 21600 raft_consensus.cc:351] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.908989 21600 raft_consensus.cc:630] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.909121 21600 consensus_queue.cc:227] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.909148 21600 raft_consensus.cc:365] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.909165 21600 raft_consensus.cc:457] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.909184 21600 raft_consensus.cc:2732] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.772s (starting election) I0710 23:26:37.909209 21600 raft_consensus.cc:2784] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.910173 21600 raft_consensus.cc:479] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.910255 21600 leader_election.cc:278] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.910374 21603 raft_consensus.cc:2732] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.096s (election complete) I0710 23:26:37.910451 21603 raft_consensus.cc:2539] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.910526 21600 ts_tablet_manager.cc:1073] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.910555 21603 raft_consensus.cc:595] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.910601 21600 ts_tablet_manager.cc:1028] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.910672 21600 tablet_bootstrap.cc:427] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.911505 21600 tablet_bootstrap.cc:578] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.910687 21603 consensus_queue.cc:204] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.912787 21538 catalog_manager.cc:3827] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.913646 21600 tablet_bootstrap.cc:427] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.913723 21600 ts_tablet_manager.cc:1045] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s I0710 23:26:37.914116 21600 raft_consensus.cc:325] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.914151 21600 raft_consensus.cc:351] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.914165 21600 raft_consensus.cc:630] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.914326 21600 consensus_queue.cc:227] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.914358 21600 raft_consensus.cc:365] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.914394 21600 raft_consensus.cc:457] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.914419 21600 raft_consensus.cc:2732] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.243s (starting election) I0710 23:26:37.914440 21600 raft_consensus.cc:2784] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.915259 21600 raft_consensus.cc:479] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.915335 21600 leader_election.cc:278] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.915454 21603 raft_consensus.cc:2732] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.890s (election complete) I0710 23:26:37.915485 21603 raft_consensus.cc:2539] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.915563 21603 raft_consensus.cc:595] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.915635 21600 ts_tablet_manager.cc:1073] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.915697 21600 ts_tablet_manager.cc:1028] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.915706 21603 consensus_queue.cc:204] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.915767 21600 tablet_bootstrap.cc:427] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.916723 21600 tablet_bootstrap.cc:578] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.916914 21538 catalog_manager.cc:3827] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.917562 21600 tablet_bootstrap.cc:427] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.917639 21600 ts_tablet_manager.cc:1045] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.917997 21600 raft_consensus.cc:325] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.918025 21600 raft_consensus.cc:351] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.918040 21600 raft_consensus.cc:630] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.918182 21600 consensus_queue.cc:227] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.918205 21600 raft_consensus.cc:365] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.918217 21600 raft_consensus.cc:457] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.918236 21600 raft_consensus.cc:2732] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.931s (starting election) I0710 23:26:37.918257 21600 raft_consensus.cc:2784] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.919111 21600 raft_consensus.cc:479] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.919203 21600 leader_election.cc:278] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.919335 21603 raft_consensus.cc:2732] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.233s (election complete) I0710 23:26:37.919405 21603 raft_consensus.cc:2539] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.919524 21600 ts_tablet_manager.cc:1073] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.919546 21603 raft_consensus.cc:595] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.919620 21600 ts_tablet_manager.cc:1028] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.919687 21603 consensus_queue.cc:204] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.919708 21600 tablet_bootstrap.cc:427] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.920521 21600 tablet_bootstrap.cc:578] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.920788 21538 catalog_manager.cc:3827] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.921325 21600 tablet_bootstrap.cc:427] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.921396 21600 ts_tablet_manager.cc:1045] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.921797 21600 raft_consensus.cc:325] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.921828 21600 raft_consensus.cc:351] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.921842 21600 raft_consensus.cc:630] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.921954 21600 consensus_queue.cc:227] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.921986 21600 raft_consensus.cc:365] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.921998 21600 raft_consensus.cc:457] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.922017 21600 raft_consensus.cc:2732] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.151s (starting election) I0710 23:26:37.922036 21600 raft_consensus.cc:2784] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.922842 21600 raft_consensus.cc:479] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.922919 21600 leader_election.cc:278] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.923046 21603 raft_consensus.cc:2732] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.745s (election complete) I0710 23:26:37.923107 21603 raft_consensus.cc:2539] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.923166 21603 raft_consensus.cc:595] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.923174 21600 ts_tablet_manager.cc:1073] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0710 23:26:37.923283 21600 ts_tablet_manager.cc:1028] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.923341 21603 consensus_queue.cc:204] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.923352 21600 tablet_bootstrap.cc:427] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.924280 21600 tablet_bootstrap.cc:578] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.924484 21538 catalog_manager.cc:3827] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.925138 21600 tablet_bootstrap.cc:427] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.925215 21600 ts_tablet_manager.cc:1045] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.925663 21600 raft_consensus.cc:325] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.925690 21600 raft_consensus.cc:351] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.925704 21600 raft_consensus.cc:630] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.925822 21600 consensus_queue.cc:227] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.925846 21600 raft_consensus.cc:365] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.925858 21600 raft_consensus.cc:457] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.925878 21600 raft_consensus.cc:2732] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.874s (starting election) I0710 23:26:37.925915 21600 raft_consensus.cc:2784] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.926738 21600 raft_consensus.cc:479] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.926820 21600 leader_election.cc:278] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.926950 21603 raft_consensus.cc:2732] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.799s (election complete) I0710 23:26:37.926988 21603 raft_consensus.cc:2539] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.927080 21603 raft_consensus.cc:595] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.927143 21600 ts_tablet_manager.cc:1073] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.927206 21603 consensus_queue.cc:204] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.927217 21600 ts_tablet_manager.cc:1028] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:37.927300 21600 tablet_bootstrap.cc:427] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:37.928267 21600 tablet_bootstrap.cc:578] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: No blocks or log segments found. Creating new log. I0710 23:26:37.928721 21538 catalog_manager.cc:3827] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:37.929654 21600 tablet_bootstrap.cc:427] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: No bootstrap required, opened a new log I0710 23:26:37.929738 21600 ts_tablet_manager.cc:1045] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:37.930207 21600 raft_consensus.cc:325] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.930243 21600 raft_consensus.cc:351] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:37.930258 21600 raft_consensus.cc:630] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:37.930393 21600 consensus_queue.cc:227] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.930423 21600 raft_consensus.cc:365] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:37.930436 21600 raft_consensus.cc:457] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:37.930495 21600 raft_consensus.cc:2732] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.697s (starting election) I0710 23:26:37.930521 21600 raft_consensus.cc:2784] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:37.931386 21600 raft_consensus.cc:479] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.931464 21600 leader_election.cc:278] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:37.931632 21603 raft_consensus.cc:2732] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.512s (election complete) I0710 23:26:37.931702 21603 raft_consensus.cc:2539] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:37.931799 21600 ts_tablet_manager.cc:1073] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:37.931815 21603 raft_consensus.cc:595] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:37.931937 21603 consensus_queue.cc:204] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:37.933135 21538 catalog_manager.cc:3827] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 0 to 1, leader changed from to 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } W0710 23:26:37.999939 21385 tablet.cc:1678] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Can't schedule compaction. Clean time has not been advanced past its initial value. I0710 23:26:40.079146 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.18.43.2:38483 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_port=44369 --webserver_interface=127.18.43.2 --tserver_master_addrs=127.18.43.62:33645 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --num_tablets_to_copy_simultaneously=20 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:40.118430 21685 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:40.118605 21685 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:40.119390 21685 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:40.119436 21685 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:40.120872 21685 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:38483 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb --webserver_interface=127.18.43.2 --webserver_port=44369 --tserver_master_addrs=127.18.43.62:33645 --num_tablets_to_copy_simultaneously=20 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:40.124382 21685 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:40.125174 21685 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 194516us I0710 23:26:40.125701 21685 fs_manager.cc:261] Metadata directory not provided I0710 23:26:40.125753 21685 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:40.129715 21685 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:40.130108 21685 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:40.130386 21685 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:40.133538 21685 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:40.134160 21685 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "5cb08d1962334a93b8e230c76a0b6099" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:40.134294 21685 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:40.164438 21685 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:40.165304 21685 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:40.165431 21685 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:40.171386 21685 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:38483 I0710 23:26:40.171747 21685 webserver.cc:175] Starting webserver on 127.18.43.2:44369 I0710 23:26:40.171766 21685 webserver.cc:186] Document root disabled I0710 23:26:40.172175 21685 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:44369/ I0710 23:26:40.172749 21685 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-1/data/info.pb I0710 23:26:40.173221 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 21685 I0710 23:26:40.173780 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 21255 I0710 23:26:40.175628 21685 tablet_server_main.cc:93] Tablet server successfully started. W0710 23:26:40.180829 21194 connection.cc:512] client connection to 127.18.43.1:46659 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:46659): Connection reset by peer (error 104) W0710 23:26:40.180847 21524 connection.cc:512] client connection to 127.18.43.1:46659 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:46659): Connection reset by peer (error 104) W0710 23:26:40.181187 21524 connection.cc:512] server connection from 127.18.43.1:38549 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:38549): Connection reset by peer (error 104) I0710 23:26:40.181381 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.18.43.1:46659 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_port=45475 --webserver_interface=127.18.43.1 --tserver_master_addrs=127.18.43.62:33645 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --num_tablets_to_copy_simultaneously=20 --rpc_service_queue_length=1 --rpc_num_service_threads=1 with env {} I0710 23:26:40.182765 21804 heartbeater.cc:346] Connected to a master server at 127.18.43.62:33645 I0710 23:26:40.182930 21804 heartbeater.cc:426] Registering TS with master... I0710 23:26:40.183540 21804 heartbeater.cc:475] Master 127.18.43.62:33645 requested a full tablet report, sending... I0710 23:26:40.184597 21538 ts_manager.cc:98] Registered new tserver with Master: 5cb08d1962334a93b8e230c76a0b6099 (127.18.43.2:38483) I0710 23:26:40.185597 21538 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:40405 WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:40.223983 21808 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:40.224174 21808 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:40.224954 21808 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:40.225004 21808 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:40.226435 21808 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:46659 --rpc_num_service_threads=1 --rpc_server_allow_ephemeral_ports=true --rpc_service_queue_length=1 --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb --webserver_interface=127.18.43.1 --webserver_port=45475 --tserver_master_addrs=127.18.43.62:33645 --num_tablets_to_copy_simultaneously=20 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:40.230012 21808 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:40.230823 21808 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 194516us I0710 23:26:40.231465 21808 fs_manager.cc:261] Metadata directory not provided I0710 23:26:40.231519 21808 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:40.235337 21808 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s I0710 23:26:40.237643 21808 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:40.237962 21808 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:40.241094 21808 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s I0710 23:26:40.241647 21808 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" format_stamp: "Formatted at 2018-07-10 23:26:36 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:40.241760 21808 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:40.290380 21808 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:40.291270 21808 ts_tablet_manager.cc:344] Loading tablet metadata (0/20 complete) I0710 23:26:40.291301 21808 ts_tablet_manager.cc:1005] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.294133 21808 ts_tablet_manager.cc:1005] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.294937 21808 ts_tablet_manager.cc:1005] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.295554 21808 ts_tablet_manager.cc:1005] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.296283 21808 ts_tablet_manager.cc:1005] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.296808 21808 ts_tablet_manager.cc:1005] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.297425 21808 ts_tablet_manager.cc:1005] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.297960 21808 ts_tablet_manager.cc:1005] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.298491 21808 ts_tablet_manager.cc:1005] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.298995 21808 ts_tablet_manager.cc:1005] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.299512 21808 ts_tablet_manager.cc:1005] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.300096 21808 ts_tablet_manager.cc:1005] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.300618 21808 ts_tablet_manager.cc:1005] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.301131 21808 ts_tablet_manager.cc:1005] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.301615 21808 ts_tablet_manager.cc:1005] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.302248 21808 ts_tablet_manager.cc:1005] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.302754 21808 ts_tablet_manager.cc:1005] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.303273 21808 ts_tablet_manager.cc:1005] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.303804 21808 ts_tablet_manager.cc:1005] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.304371 21808 ts_tablet_manager.cc:1005] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Loading tablet metadata I0710 23:26:40.304877 21808 ts_tablet_manager.cc:356] Loaded tablet metadata (20 live tablets) I0710 23:26:40.306282 21808 ts_tablet_manager.cc:1173] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.306684 21823 ts_tablet_manager.cc:1028] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:40.306962 21823 tablet_bootstrap.cc:427] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:40.307041 21808 ts_tablet_manager.cc:1173] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.307523 21808 ts_tablet_manager.cc:1173] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.307998 21808 ts_tablet_manager.cc:1173] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.308619 21808 ts_tablet_manager.cc:1173] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.309156 21808 ts_tablet_manager.cc:1173] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.309603 21808 ts_tablet_manager.cc:1173] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.310027 21808 ts_tablet_manager.cc:1173] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.310601 21808 ts_tablet_manager.cc:1173] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.311055 21808 ts_tablet_manager.cc:1173] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.311568 21808 ts_tablet_manager.cc:1173] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.312037 21808 ts_tablet_manager.cc:1173] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.312512 21808 ts_tablet_manager.cc:1173] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.312952 21808 ts_tablet_manager.cc:1173] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.313395 21808 ts_tablet_manager.cc:1173] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.313822 21808 ts_tablet_manager.cc:1173] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.314266 21808 ts_tablet_manager.cc:1173] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.314800 21808 ts_tablet_manager.cc:1173] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.315243 21808 ts_tablet_manager.cc:1173] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.315732 21808 ts_tablet_manager.cc:1173] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:40.315899 21808 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:40.319007 21808 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:46659 I0710 23:26:40.319432 21808 webserver.cc:175] Starting webserver on 127.18.43.1:45475 I0710 23:26:40.319458 21808 webserver.cc:186] Document root disabled I0710 23:26:40.320019 21808 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:45475/ I0710 23:26:40.320868 21808 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestTabletCopyWithBusySource.1531265186290008-18604/minicluster-data/ts-0/data/info.pb I0710 23:26:40.321419 21808 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:40.326097 21823 log.cc:525] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Log is configured to *not* fsync() on all Append() calls I0710 23:26:40.327679 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 21808 I0710 23:26:40.330658 21833 heartbeater.cc:346] Connected to a master server at 127.18.43.62:33645 I0710 23:26:40.330838 21833 heartbeater.cc:426] Registering TS with master... I0710 23:26:40.331270 21833 heartbeater.cc:475] Master 127.18.43.62:33645 requested a full tablet report, sending... I0710 23:26:40.333295 21538 ts_manager.cc:104] Re-registered known tserver with Master: 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:40.335641 21538 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:49927 I0710 23:26:40.419638 21823 tablet_bootstrap.cc:427] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=187 overwritten=0 applied=187 ignored=0} inserts{seen=492 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:40.420123 21823 tablet_bootstrap.cc:427] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:40.421138 21823 ts_tablet_manager.cc:1045] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.114s user 0.100s sys 0.012s I0710 23:26:40.423812 21823 raft_consensus.cc:325] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.423902 21823 raft_consensus.cc:630] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:40.424294 21823 consensus_queue.cc:227] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.424355 21823 raft_consensus.cc:365] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:40.424410 21823 raft_consensus.cc:457] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:40.424477 21823 raft_consensus.cc:2732] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.873s (starting election) I0710 23:26:40.424507 21823 raft_consensus.cc:2784] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:40.425853 21823 raft_consensus.cc:479] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.426215 21823 leader_election.cc:278] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:40.426661 21838 raft_consensus.cc:2732] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.248s (election complete) I0710 23:26:40.426704 21838 raft_consensus.cc:2539] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:40.426838 21838 raft_consensus.cc:595] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:40.426882 21833 heartbeater.cc:467] Master 127.18.43.62:33645 was elected leader, sending a full tablet report... I0710 23:26:40.427078 21823 ts_tablet_manager.cc:1073] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s I0710 23:26:40.427141 21838 consensus_queue.cc:204] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 187, Committed index: 187, Last appended: 1.187, Last appended by leader: 187, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.427211 21823 ts_tablet_manager.cc:1028] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:40.427302 21823 tablet_bootstrap.cc:427] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:40.430220 21538 catalog_manager.cc:3827] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:40.527526 21823 tablet_bootstrap.cc:427] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=520 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:40.527947 21823 tablet_bootstrap.cc:427] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:40.528748 21823 ts_tablet_manager.cc:1045] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.101s user 0.069s sys 0.031s I0710 23:26:40.529275 21823 raft_consensus.cc:325] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.529312 21823 raft_consensus.cc:630] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:40.529464 21823 consensus_queue.cc:227] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.529502 21823 raft_consensus.cc:365] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:40.529516 21823 raft_consensus.cc:457] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:40.529541 21823 raft_consensus.cc:2732] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.208s (starting election) I0710 23:26:40.529559 21823 raft_consensus.cc:2784] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:40.530485 21823 raft_consensus.cc:479] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.530591 21823 leader_election.cc:278] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:40.530841 21838 raft_consensus.cc:2732] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.877s (election complete) I0710 23:26:40.530876 21838 raft_consensus.cc:2539] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:40.530911 21838 raft_consensus.cc:595] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:40.531086 21838 consensus_queue.cc:204] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 195, Committed index: 195, Last appended: 1.195, Last appended by leader: 195, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.531203 21823 ts_tablet_manager.cc:1073] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.003s sys 0.001s I0710 23:26:40.531277 21823 ts_tablet_manager.cc:1028] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:40.531347 21823 tablet_bootstrap.cc:427] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:40.532577 21538 catalog_manager.cc:3827] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:40.631250 21823 tablet_bootstrap.cc:427] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=540 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:40.631669 21823 tablet_bootstrap.cc:427] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:40.632483 21823 ts_tablet_manager.cc:1045] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.101s user 0.077s sys 0.023s I0710 23:26:40.632946 21823 raft_consensus.cc:325] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.632978 21823 raft_consensus.cc:630] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:40.633112 21823 consensus_queue.cc:227] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.633139 21823 raft_consensus.cc:365] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:40.633152 21823 raft_consensus.cc:457] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:40.633177 21823 raft_consensus.cc:2732] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.991s (starting election) I0710 23:26:40.633196 21823 raft_consensus.cc:2784] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:40.633996 21823 raft_consensus.cc:479] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.634089 21823 leader_election.cc:278] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:40.634217 21838 raft_consensus.cc:2732] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.067s (election complete) I0710 23:26:40.634254 21838 raft_consensus.cc:2539] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:40.634322 21838 raft_consensus.cc:595] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:40.634454 21838 consensus_queue.cc:204] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.634593 21823 ts_tablet_manager.cc:1073] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s I0710 23:26:40.634663 21823 ts_tablet_manager.cc:1028] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:40.634732 21823 tablet_bootstrap.cc:427] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:40.636047 21538 catalog_manager.cc:3827] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:40.738747 21823 tablet_bootstrap.cc:427] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=513 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:40.739228 21823 tablet_bootstrap.cc:427] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:40.740123 21823 ts_tablet_manager.cc:1045] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.105s user 0.085s sys 0.019s I0710 23:26:40.740620 21823 raft_consensus.cc:325] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.740653 21823 raft_consensus.cc:630] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:40.740758 21823 consensus_queue.cc:227] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.740777 21823 raft_consensus.cc:365] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:40.740790 21823 raft_consensus.cc:457] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:40.740813 21823 raft_consensus.cc:2732] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.580s (starting election) I0710 23:26:40.740836 21823 raft_consensus.cc:2784] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:40.741631 21823 raft_consensus.cc:479] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.741719 21823 leader_election.cc:278] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:40.741932 21838 raft_consensus.cc:2732] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.062s (election complete) I0710 23:26:40.741976 21838 raft_consensus.cc:2539] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:40.742069 21838 raft_consensus.cc:595] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:40.742090 21823 ts_tablet_manager.cc:1073] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:40.742149 21823 ts_tablet_manager.cc:1028] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:40.742211 21823 tablet_bootstrap.cc:427] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:40.742219 21838 consensus_queue.cc:204] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.743826 21538 catalog_manager.cc:3827] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:40.843914 21823 tablet_bootstrap.cc:427] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=482 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:40.844275 21823 tablet_bootstrap.cc:427] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:40.845077 21823 ts_tablet_manager.cc:1045] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.103s user 0.089s sys 0.012s I0710 23:26:40.845544 21823 raft_consensus.cc:325] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.845582 21823 raft_consensus.cc:630] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:40.845715 21823 consensus_queue.cc:227] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.845741 21823 raft_consensus.cc:365] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:40.845751 21823 raft_consensus.cc:457] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:40.845774 21823 raft_consensus.cc:2732] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.838s (starting election) I0710 23:26:40.845790 21823 raft_consensus.cc:2784] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:40.846602 21823 raft_consensus.cc:479] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.846688 21823 leader_election.cc:278] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:40.846853 21838 raft_consensus.cc:2732] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.058s (election complete) I0710 23:26:40.846902 21838 raft_consensus.cc:2539] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:40.846968 21838 raft_consensus.cc:595] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:40.847014 21823 ts_tablet_manager.cc:1073] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0710 23:26:40.847092 21823 ts_tablet_manager.cc:1028] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:40.847105 21838 consensus_queue.cc:204] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.847163 21823 tablet_bootstrap.cc:427] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:40.848620 21538 catalog_manager.cc:3827] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:40.948576 21823 tablet_bootstrap.cc:427] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=509 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:40.948940 21823 tablet_bootstrap.cc:427] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:40.949781 21823 ts_tablet_manager.cc:1045] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.103s user 0.093s sys 0.007s I0710 23:26:40.950269 21823 raft_consensus.cc:325] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.950307 21823 raft_consensus.cc:630] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:40.950464 21823 consensus_queue.cc:227] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.950490 21823 raft_consensus.cc:365] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:40.950500 21823 raft_consensus.cc:457] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:40.950527 21823 raft_consensus.cc:2732] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.644s (starting election) I0710 23:26:40.950546 21823 raft_consensus.cc:2784] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:40.951520 21823 raft_consensus.cc:479] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.951644 21823 leader_election.cc:278] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:40.951822 21839 raft_consensus.cc:2732] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.150s (election complete) I0710 23:26:40.951869 21839 raft_consensus.cc:2539] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:40.951928 21839 raft_consensus.cc:595] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:40.951992 21823 ts_tablet_manager.cc:1073] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s I0710 23:26:40.952054 21823 ts_tablet_manager.cc:1028] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:40.952072 21839 consensus_queue.cc:204] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 190, Committed index: 190, Last appended: 1.190, Last appended by leader: 190, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:40.952111 21823 tablet_bootstrap.cc:427] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:40.953747 21538 catalog_manager.cc:3827] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.058845 21823 tablet_bootstrap.cc:427] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=546 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.059267 21823 tablet_bootstrap.cc:427] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.060184 21823 ts_tablet_manager.cc:1045] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.108s user 0.091s sys 0.016s I0710 23:26:41.060714 21823 raft_consensus.cc:325] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.060746 21823 raft_consensus.cc:630] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.060847 21823 consensus_queue.cc:227] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.060868 21823 raft_consensus.cc:365] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.060878 21823 raft_consensus.cc:457] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.060901 21823 raft_consensus.cc:2732] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.666s (starting election) I0710 23:26:41.060922 21823 raft_consensus.cc:2784] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.061710 21823 raft_consensus.cc:479] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.061792 21823 leader_election.cc:278] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.061955 21839 raft_consensus.cc:2732] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.014s (election complete) I0710 23:26:41.062003 21839 raft_consensus.cc:2539] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.062057 21839 raft_consensus.cc:595] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.062085 21823 ts_tablet_manager.cc:1073] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0710 23:26:41.062194 21839 consensus_queue.cc:204] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.062228 21823 ts_tablet_manager.cc:1028] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.062299 21823 tablet_bootstrap.cc:427] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.063768 21538 catalog_manager.cc:3827] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.168886 21823 tablet_bootstrap.cc:427] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=184 overwritten=0 applied=184 ignored=0} inserts{seen=493 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.169297 21823 tablet_bootstrap.cc:427] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.170110 21823 ts_tablet_manager.cc:1045] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.108s user 0.097s sys 0.008s I0710 23:26:41.170583 21823 raft_consensus.cc:325] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.170614 21823 raft_consensus.cc:630] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.170742 21823 consensus_queue.cc:227] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.170768 21823 raft_consensus.cc:365] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.170781 21823 raft_consensus.cc:457] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.170809 21823 raft_consensus.cc:2732] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.126s (starting election) I0710 23:26:41.170826 21823 raft_consensus.cc:2784] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.171669 21823 raft_consensus.cc:479] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.171756 21823 leader_election.cc:278] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.171918 21838 raft_consensus.cc:2732] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.847s (election complete) I0710 23:26:41.171965 21838 raft_consensus.cc:2539] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.172029 21838 raft_consensus.cc:595] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.172127 21823 ts_tablet_manager.cc:1073] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s I0710 23:26:41.172163 21838 consensus_queue.cc:204] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 184, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.172195 21823 ts_tablet_manager.cc:1028] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.172256 21823 tablet_bootstrap.cc:427] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.173542 21538 catalog_manager.cc:3827] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.187743 21804 heartbeater.cc:467] Master 127.18.43.62:33645 was elected leader, sending a full tablet report... I0710 23:26:41.271445 21823 tablet_bootstrap.cc:427] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=527 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.271847 21823 tablet_bootstrap.cc:427] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.272629 21823 ts_tablet_manager.cc:1045] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.100s user 0.083s sys 0.016s I0710 23:26:41.273067 21823 raft_consensus.cc:325] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.273097 21823 raft_consensus.cc:630] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.273223 21823 consensus_queue.cc:227] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.273248 21823 raft_consensus.cc:365] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.273262 21823 raft_consensus.cc:457] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.273281 21823 raft_consensus.cc:2732] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.074s (starting election) I0710 23:26:41.273299 21823 raft_consensus.cc:2784] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.274087 21823 raft_consensus.cc:479] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.274173 21823 leader_election.cc:278] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.274317 21838 raft_consensus.cc:2732] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.201s (election complete) I0710 23:26:41.274361 21838 raft_consensus.cc:2539] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.274420 21838 raft_consensus.cc:595] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.274441 21823 ts_tablet_manager.cc:1073] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0710 23:26:41.274507 21823 ts_tablet_manager.cc:1028] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.274564 21823 tablet_bootstrap.cc:427] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.274585 21838 consensus_queue.cc:204] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.276075 21538 catalog_manager.cc:3827] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.376093 21823 tablet_bootstrap.cc:427] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=517 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.376436 21823 tablet_bootstrap.cc:427] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.377214 21823 ts_tablet_manager.cc:1045] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.103s user 0.081s sys 0.019s I0710 23:26:41.377698 21823 raft_consensus.cc:325] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.377730 21823 raft_consensus.cc:630] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.377851 21823 consensus_queue.cc:227] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.377879 21823 raft_consensus.cc:365] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.377894 21823 raft_consensus.cc:457] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.377918 21823 raft_consensus.cc:2732] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.146s (starting election) I0710 23:26:41.377934 21823 raft_consensus.cc:2784] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.378716 21823 raft_consensus.cc:479] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.378800 21823 leader_election.cc:278] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.379030 21838 raft_consensus.cc:2732] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.870s (election complete) I0710 23:26:41.379082 21838 raft_consensus.cc:2539] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.379148 21838 raft_consensus.cc:595] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.379299 21838 consensus_queue.cc:204] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 194, Committed index: 194, Last appended: 1.194, Last appended by leader: 194, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.379320 21823 ts_tablet_manager.cc:1073] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.003s sys 0.001s I0710 23:26:41.379411 21823 ts_tablet_manager.cc:1028] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.379503 21823 tablet_bootstrap.cc:427] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.380635 21538 catalog_manager.cc:3827] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.478819 21823 tablet_bootstrap.cc:427] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=492 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.479207 21823 tablet_bootstrap.cc:427] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.480056 21823 ts_tablet_manager.cc:1045] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.101s user 0.089s sys 0.011s I0710 23:26:41.480540 21823 raft_consensus.cc:325] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.480574 21823 raft_consensus.cc:630] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.480751 21823 consensus_queue.cc:227] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.480779 21823 raft_consensus.cc:365] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.480792 21823 raft_consensus.cc:457] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.480818 21823 raft_consensus.cc:2732] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.705s (starting election) I0710 23:26:41.480835 21823 raft_consensus.cc:2784] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.481631 21823 raft_consensus.cc:479] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.481727 21823 leader_election.cc:278] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.481858 21839 raft_consensus.cc:2732] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.572s (election complete) I0710 23:26:41.481894 21839 raft_consensus.cc:2539] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.481981 21839 raft_consensus.cc:595] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.482110 21839 consensus_queue.cc:204] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.482254 21823 ts_tablet_manager.cc:1073] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:41.482326 21823 ts_tablet_manager.cc:1028] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.482395 21823 tablet_bootstrap.cc:427] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.483640 21538 catalog_manager.cc:3827] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.582314 21823 tablet_bootstrap.cc:427] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=528 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.582698 21823 tablet_bootstrap.cc:427] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.583499 21823 ts_tablet_manager.cc:1045] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.101s user 0.085s sys 0.012s I0710 23:26:41.584023 21823 raft_consensus.cc:325] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.584065 21823 raft_consensus.cc:630] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.584198 21823 consensus_queue.cc:227] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.584220 21823 raft_consensus.cc:365] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.584233 21823 raft_consensus.cc:457] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.584259 21823 raft_consensus.cc:2732] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.784s (starting election) I0710 23:26:41.584277 21823 raft_consensus.cc:2784] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.585105 21823 raft_consensus.cc:479] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.585202 21823 leader_election.cc:278] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.585379 21865 raft_consensus.cc:2732] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.632s (election complete) I0710 23:26:41.585448 21865 raft_consensus.cc:2539] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.585525 21865 raft_consensus.cc:595] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.585682 21865 consensus_queue.cc:204] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.585737 21823 ts_tablet_manager.cc:1073] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.004s I0710 23:26:41.585824 21823 ts_tablet_manager.cc:1028] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.585901 21823 tablet_bootstrap.cc:427] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.587044 21538 catalog_manager.cc:3827] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.689105 21823 tablet_bootstrap.cc:427] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=501 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.689499 21823 tablet_bootstrap.cc:427] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.690310 21823 ts_tablet_manager.cc:1045] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.104s user 0.101s sys 0.000s I0710 23:26:41.690788 21823 raft_consensus.cc:325] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.690821 21823 raft_consensus.cc:630] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.690955 21823 consensus_queue.cc:227] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.690980 21823 raft_consensus.cc:365] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.690999 21823 raft_consensus.cc:457] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.691025 21823 raft_consensus.cc:2732] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.949s (starting election) I0710 23:26:41.691045 21823 raft_consensus.cc:2784] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.691895 21823 raft_consensus.cc:479] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.691979 21823 leader_election.cc:278] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.692203 21839 raft_consensus.cc:2732] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.596s (election complete) I0710 23:26:41.692251 21839 raft_consensus.cc:2539] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.692318 21839 raft_consensus.cc:595] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.692334 21823 ts_tablet_manager.cc:1073] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.005s sys 0.000s I0710 23:26:41.692421 21823 ts_tablet_manager.cc:1028] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.692466 21839 consensus_queue.cc:204] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 192, Committed index: 192, Last appended: 1.192, Last appended by leader: 192, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.692495 21823 tablet_bootstrap.cc:427] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.693936 21538 catalog_manager.cc:3827] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.788645 21823 tablet_bootstrap.cc:427] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=482 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.789026 21823 tablet_bootstrap.cc:427] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.789821 21823 ts_tablet_manager.cc:1045] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.097s user 0.087s sys 0.008s I0710 23:26:41.790305 21823 raft_consensus.cc:325] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.790335 21823 raft_consensus.cc:630] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.790459 21823 consensus_queue.cc:227] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.790488 21823 raft_consensus.cc:365] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.790498 21823 raft_consensus.cc:457] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.790526 21823 raft_consensus.cc:2732] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.926s (starting election) I0710 23:26:41.790545 21823 raft_consensus.cc:2784] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.791393 21823 raft_consensus.cc:479] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.791487 21823 leader_election.cc:278] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.791667 21838 raft_consensus.cc:2732] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.243s (election complete) I0710 23:26:41.791712 21838 raft_consensus.cc:2539] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.791766 21838 raft_consensus.cc:595] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.791831 21823 ts_tablet_manager.cc:1073] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.004s sys 0.000s I0710 23:26:41.791887 21823 ts_tablet_manager.cc:1028] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.791903 21838 consensus_queue.cc:204] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 185, Committed index: 185, Last appended: 1.185, Last appended by leader: 185, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.791952 21823 tablet_bootstrap.cc:427] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.793381 21538 catalog_manager.cc:3827] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.893023 21823 tablet_bootstrap.cc:427] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=479 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.893409 21823 tablet_bootstrap.cc:427] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.894202 21823 ts_tablet_manager.cc:1045] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.102s user 0.084s sys 0.016s I0710 23:26:41.894654 21823 raft_consensus.cc:325] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.894690 21823 raft_consensus.cc:630] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.894820 21823 consensus_queue.cc:227] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.894843 21823 raft_consensus.cc:365] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.894855 21823 raft_consensus.cc:457] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.894882 21823 raft_consensus.cc:2732] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.910s (starting election) I0710 23:26:41.894901 21823 raft_consensus.cc:2784] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.895757 21823 raft_consensus.cc:479] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.895849 21823 leader_election.cc:278] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.895999 21839 raft_consensus.cc:2732] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.783s (election complete) I0710 23:26:41.896047 21839 raft_consensus.cc:2539] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.896100 21839 raft_consensus.cc:595] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.896172 21823 ts_tablet_manager.cc:1073] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.000s sys 0.004s I0710 23:26:41.896224 21839 consensus_queue.cc:204] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 189, Committed index: 189, Last appended: 1.189, Last appended by leader: 189, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.896234 21823 ts_tablet_manager.cc:1028] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.896291 21823 tablet_bootstrap.cc:427] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.897583 21538 catalog_manager.cc:3827] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:41.994485 21823 tablet_bootstrap.cc:427] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=487 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:41.994884 21823 tablet_bootstrap.cc:427] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:41.995735 21823 ts_tablet_manager.cc:1045] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.099s user 0.083s sys 0.016s I0710 23:26:41.996191 21823 raft_consensus.cc:325] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.996227 21823 raft_consensus.cc:630] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:41.996351 21823 consensus_queue.cc:227] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.996376 21823 raft_consensus.cc:365] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:41.996392 21823 raft_consensus.cc:457] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:41.996417 21823 raft_consensus.cc:2732] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.728s (starting election) I0710 23:26:41.996436 21823 raft_consensus.cc:2784] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:41.997228 21823 raft_consensus.cc:479] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.997318 21823 leader_election.cc:278] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:41.997455 21839 raft_consensus.cc:2732] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.170s (election complete) I0710 23:26:41.997488 21839 raft_consensus.cc:2539] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:41.997527 21839 raft_consensus.cc:595] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:41.997637 21823 ts_tablet_manager.cc:1073] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:41.997655 21839 consensus_queue.cc:204] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 193, Committed index: 193, Last appended: 1.193, Last appended by leader: 193, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:41.997714 21823 ts_tablet_manager.cc:1028] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:41.997771 21823 tablet_bootstrap.cc:427] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:41.999137 21538 catalog_manager.cc:3827] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:42.099848 21823 tablet_bootstrap.cc:427] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=529 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:42.100219 21823 tablet_bootstrap.cc:427] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:42.101105 21823 ts_tablet_manager.cc:1045] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.103s user 0.094s sys 0.004s I0710 23:26:42.101554 21823 raft_consensus.cc:325] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.101584 21823 raft_consensus.cc:630] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:42.101712 21823 consensus_queue.cc:227] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.101737 21823 raft_consensus.cc:365] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:42.101747 21823 raft_consensus.cc:457] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:42.101773 21823 raft_consensus.cc:2732] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.712s (starting election) I0710 23:26:42.101791 21823 raft_consensus.cc:2784] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:42.102618 21823 raft_consensus.cc:479] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.102708 21823 leader_election.cc:278] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:42.102890 21838 raft_consensus.cc:2732] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.709s (election complete) I0710 23:26:42.102943 21838 raft_consensus.cc:2539] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:42.103005 21823 ts_tablet_manager.cc:1073] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s I0710 23:26:42.103011 21838 raft_consensus.cc:595] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:42.103057 21823 ts_tablet_manager.cc:1028] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:42.103119 21823 tablet_bootstrap.cc:427] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:42.103170 21838 consensus_queue.cc:204] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.104719 21538 catalog_manager.cc:3827] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:42.202348 21823 tablet_bootstrap.cc:427] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=579 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:42.202726 21823 tablet_bootstrap.cc:427] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:42.203510 21823 ts_tablet_manager.cc:1045] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.100s user 0.093s sys 0.004s I0710 23:26:42.204025 21823 raft_consensus.cc:325] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.204062 21823 raft_consensus.cc:630] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:42.204215 21823 consensus_queue.cc:227] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.204244 21823 raft_consensus.cc:365] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:42.204257 21823 raft_consensus.cc:457] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:42.204282 21823 raft_consensus.cc:2732] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.697s (starting election) I0710 23:26:42.204299 21823 raft_consensus.cc:2784] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:42.205132 21823 raft_consensus.cc:479] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.205232 21823 leader_election.cc:278] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:42.205387 21838 raft_consensus.cc:2732] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.999s (election complete) I0710 23:26:42.205420 21838 raft_consensus.cc:2539] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:42.205492 21838 raft_consensus.cc:595] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:42.205672 21838 consensus_queue.cc:204] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 191, Committed index: 191, Last appended: 1.191, Last appended by leader: 191, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.205808 21823 ts_tablet_manager.cc:1073] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.006s sys 0.000s I0710 23:26:42.205888 21823 ts_tablet_manager.cc:1028] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:42.205962 21823 tablet_bootstrap.cc:427] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:42.207124 21538 catalog_manager.cc:3827] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:42.307088 21823 tablet_bootstrap.cc:427] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=506 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:42.307543 21823 tablet_bootstrap.cc:427] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:42.308498 21823 ts_tablet_manager.cc:1045] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.103s user 0.082s sys 0.020s I0710 23:26:42.309072 21823 raft_consensus.cc:325] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.309103 21823 raft_consensus.cc:630] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:42.309228 21823 consensus_queue.cc:227] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.309257 21823 raft_consensus.cc:365] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:42.309267 21823 raft_consensus.cc:457] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:42.309288 21823 raft_consensus.cc:2732] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.682s (starting election) I0710 23:26:42.309309 21823 raft_consensus.cc:2784] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:42.310150 21823 raft_consensus.cc:479] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.310246 21823 leader_election.cc:278] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:42.310401 21839 raft_consensus.cc:2732] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 2.026s (election complete) I0710 23:26:42.310454 21839 raft_consensus.cc:2539] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:42.310513 21839 raft_consensus.cc:595] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:42.310597 21823 ts_tablet_manager.cc:1073] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s I0710 23:26:42.310660 21823 ts_tablet_manager.cc:1028] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrapping tablet I0710 23:26:42.310665 21839 consensus_queue.cc:204] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 188, Committed index: 188, Last appended: 1.188, Last appended by leader: 188, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.310725 21823 tablet_bootstrap.cc:427] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap starting. I0710 23:26:42.312054 21538 catalog_manager.cc:3827] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:42.407938 21823 tablet_bootstrap.cc:427] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap replayed 1/1 log segments. Stats: ops{read=184 overwritten=0 applied=184 ignored=0} inserts{seen=528 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:42.408334 21823 tablet_bootstrap.cc:427] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Bootstrap complete. I0710 23:26:42.409157 21823 ts_tablet_manager.cc:1045] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent bootstrapping tablet: real 0.098s user 0.085s sys 0.012s I0710 23:26:42.409675 21823 raft_consensus.cc:325] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.409709 21823 raft_consensus.cc:630] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Initialized, Role: FOLLOWER I0710 23:26:42.409837 21823 consensus_queue.cc:227] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.409868 21823 raft_consensus.cc:365] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:42.409879 21823 raft_consensus.cc:457] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:42.409907 21823 raft_consensus.cc:2732] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.976s (starting election) I0710 23:26:42.409926 21823 raft_consensus.cc:2784] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:42.410776 21823 raft_consensus.cc:479] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.410876 21823 leader_election.cc:278] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:42.411011 21839 raft_consensus.cc:2732] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Snoozing failure detection for 1.957s (election complete) I0710 23:26:42.411046 21839 raft_consensus.cc:2539] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:42.411109 21839 raft_consensus.cc:595] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [term 2 LEADER]: Becoming Leader. State: Replica: 3eefa81a1d344cca94cb71d8fc3a7c08, State: Running, Role: LEADER I0710 23:26:42.411244 21839 consensus_queue.cc:204] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 184, Committed index: 184, Last appended: 1.184, Last appended by leader: 184, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:42.411428 21823 ts_tablet_manager.cc:1073] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Time spent starting tablet: real 0.002s user 0.003s sys 0.000s I0710 23:26:42.412744 21538 catalog_manager.cc:3827] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08 reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } health_report { overall_health: HEALTHY } } } I0710 23:26:42.424512 21907 ts_tablet_manager.cc:669] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.424926 21907 tablet_copy_client.cc:239] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.425597 21909 ts_tablet_manager.cc:669] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.425686 21909 tablet_copy_client.cc:239] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.426023 21910 ts_tablet_manager.cc:669] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.426120 21908 ts_tablet_manager.cc:669] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.426476 21912 ts_tablet_manager.cc:669] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.426502 21915 ts_tablet_manager.cc:669] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.426556 21910 tablet_copy_client.cc:239] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.426657 21908 tablet_copy_client.cc:239] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.426733 21913 ts_tablet_manager.cc:669] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.426828 21912 tablet_copy_client.cc:239] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.427045 21915 tablet_copy_client.cc:239] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.427117 21911 ts_tablet_manager.cc:669] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.427237 21913 tablet_copy_client.cc:239] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.427664 21917 ts_tablet_manager.cc:669] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.427742 21911 tablet_copy_client.cc:239] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.427912 21918 ts_tablet_manager.cc:669] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.428009 21917 tablet_copy_client.cc:239] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.428089 21920 ts_tablet_manager.cc:669] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.428150 21916 ts_tablet_manager.cc:669] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.428195 21916 tablet_copy_client.cc:239] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.428261 21921 ts_tablet_manager.cc:669] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.428303 21918 tablet_copy_client.cc:239] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.428130 21922 ts_tablet_manager.cc:669] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.428447 21920 tablet_copy_client.cc:239] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.428534 21923 ts_tablet_manager.cc:669] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.428669 21922 tablet_copy_client.cc:239] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.428777 21921 tablet_copy_client.cc:239] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.428814 21924 ts_tablet_manager.cc:669] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.428833 21923 tablet_copy_client.cc:239] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.428880 21924 tablet_copy_client.cc:239] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.428938 21927 ts_tablet_manager.cc:669] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.428974 21926 ts_tablet_manager.cc:669] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.429003 21927 tablet_copy_client.cc:239] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.429039 21926 tablet_copy_client.cc:239] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.429114 21928 ts_tablet_manager.cc:669] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.429175 21928 tablet_copy_client.cc:239] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.429227 21925 ts_tablet_manager.cc:669] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: Initiating tablet copy from peer 3eefa81a1d344cca94cb71d8fc3a7c08 (127.18.43.1:46659) I0710 23:26:42.429291 21925 tablet_copy_client.cc:239] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:46659 I0710 23:26:42.432396 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet bfe7d79a3ac644dc8598fc864fbe659e from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) W0710 23:26:42.432489 21815 service_pool.cc:129] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. I0710 23:26:42.432504 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet bfe7d79a3ac644dc8598fc864fbe659e from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-bfe7d79a3ac644dc8598fc864fbe659e I0710 23:26:42.432694 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 2) I0710 23:26:42.432982 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 2) I0710 23:26:42.433221 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 2) I0710 23:26:42.433704 21829 tablet_copy_source_session.cc:202] T bfe7d79a3ac644dc8598fc864fbe659e P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.434859 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 2) I0710 23:26:42.435086 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 2) I0710 23:26:42.435273 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 2) I0710 23:26:42.435472 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 188113a621d14966945feb51e41ea4a5 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.435535 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 188113a621d14966945feb51e41ea4a5 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-188113a621d14966945feb51e41ea4a5 I0710 23:26:42.436240 21829 tablet_copy_source_session.cc:202] T 188113a621d14966945feb51e41ea4a5 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.436467 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 0617cd1d64ed4dfab4679b69255e839e from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.436523 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 0617cd1d64ed4dfab4679b69255e839e from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-0617cd1d64ed4dfab4679b69255e839e I0710 23:26:42.436565 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: I0710 23:26:42.436951 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 11) I0710 23:26:42.437106 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 11) I0710 23:26:42.437165 21829 tablet_copy_source_session.cc:202] T 0617cd1d64ed4dfab4679b69255e839e P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.437345 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: I0710 23:26:42.437369 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 58a8d45cf5284f579b89c73d87015736 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.437417 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 58a8d45cf5284f579b89c73d87015736 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-58a8d45cf5284f579b89c73d87015736 I0710 23:26:42.437650 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 15) I0710 23:26:42.437784 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 15) I0710 23:26:42.437970 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 15) I0710 23:26:42.438014 21829 tablet_copy_source_session.cc:202] T 58a8d45cf5284f579b89c73d87015736 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.438159 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: I0710 23:26:42.438196 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 39212fb42d874c3cad5a34357eae1a51 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.438239 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 39212fb42d874c3cad5a34357eae1a51 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-39212fb42d874c3cad5a34357eae1a51 I0710 23:26:42.438465 21907 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet bfe7d79a3ac644dc8598fc864fbe659e. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.438807 21829 tablet_copy_source_session.cc:202] T 39212fb42d874c3cad5a34357eae1a51 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.439002 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet d9d53b3911f045fda410a0ae098496f4 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.439047 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet d9d53b3911f045fda410a0ae098496f4 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-d9d53b3911f045fda410a0ae098496f4 I0710 23:26:42.439111 21917 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 0617cd1d64ed4dfab4679b69255e839e. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.439348 21918 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 58a8d45cf5284f579b89c73d87015736. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.439937 21909 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 188113a621d14966945feb51e41ea4a5. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.440198 21829 tablet_copy_source_session.cc:202] T d9d53b3911f045fda410a0ae098496f4 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.440441 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 9dded2401cb943f0a2bea0337291992a from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.440490 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 9dded2401cb943f0a2bea0337291992a from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-9dded2401cb943f0a2bea0337291992a I0710 23:26:42.441078 21829 tablet_copy_source_session.cc:202] T 9dded2401cb943f0a2bea0337291992a P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.441537 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 6be9b59101ec4ae6bec4f3111efb82b3 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.441586 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 6be9b59101ec4ae6bec4f3111efb82b3 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-6be9b59101ec4ae6bec4f3111efb82b3 I0710 23:26:42.441860 21910 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 9dded2401cb943f0a2bea0337291992a. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.441967 21925 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet d9d53b3911f045fda410a0ae098496f4. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.442159 21829 tablet_copy_source_session.cc:202] T 6be9b59101ec4ae6bec4f3111efb82b3 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.442570 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 5a0de49957f84b51b2c03d3e432ee897 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.442617 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 5a0de49957f84b51b2c03d3e432ee897 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-5a0de49957f84b51b2c03d3e432ee897 I0710 23:26:42.443181 21829 tablet_copy_source_session.cc:202] T 5a0de49957f84b51b2c03d3e432ee897 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.443826 21908 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 6be9b59101ec4ae6bec4f3111efb82b3. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.443874 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet ec16d86dcdb34a5b9f6dc60e9a5d3866 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.443920 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet ec16d86dcdb34a5b9f6dc60e9a5d3866 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-ec16d86dcdb34a5b9f6dc60e9a5d3866 I0710 23:26:42.445299 21912 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 5a0de49957f84b51b2c03d3e432ee897. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.445539 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.446286 21923 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 39212fb42d874c3cad5a34357eae1a51. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.447823 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.448017 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.448658 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.448817 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.449034 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.452227 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.452383 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.452617 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 25) I0710 23:26:42.455639 21829 tablet_copy_source_session.cc:202] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.456101 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 3382fcc7728248248fce1bb6b6e10422 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.456173 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 3382fcc7728248248fce1bb6b6e10422 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-3382fcc7728248248fce1bb6b6e10422 I0710 23:26:42.456743 21913 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet ec16d86dcdb34a5b9f6dc60e9a5d3866. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.456821 21829 tablet_copy_source_session.cc:202] T 3382fcc7728248248fce1bb6b6e10422 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.457625 21915 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 3382fcc7728248248fce1bb6b6e10422. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.460165 21910 ts_tablet_manager.cc:1173] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.460760 21910 tablet_copy_client.cc:566] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.460932 21910 tablet_copy_client.cc:529] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.461334 21912 ts_tablet_manager.cc:1173] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.461464 21912 tablet_copy_client.cc:566] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.461571 21912 tablet_copy_client.cc:529] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.461732 21915 ts_tablet_manager.cc:1173] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.461972 21913 ts_tablet_manager.cc:1173] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.462182 21913 tablet_copy_client.cc:566] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.462285 21913 tablet_copy_client.cc:529] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.463052 21815 service_pool.cc:132] FetchData request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.FetchData from 127.18.43.2:57047 (request call id 36) I0710 23:26:42.463341 21907 ts_tablet_manager.cc:1173] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.463665 21915 tablet_copy_client.cc:566] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.463778 21915 tablet_copy_client.cc:529] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.464263 21908 ts_tablet_manager.cc:1173] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.464351 21908 tablet_copy_client.cc:566] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.464408 21907 tablet_copy_client.cc:566] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.464449 21908 tablet_copy_client.cc:529] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.464491 21815 service_pool.cc:132] FetchData request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.FetchData from 127.18.43.2:57047 (request call id 36) I0710 23:26:42.464522 21907 tablet_copy_client.cc:529] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.465013 21918 ts_tablet_manager.cc:1173] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.465101 21918 tablet_copy_client.cc:566] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.465193 21918 tablet_copy_client.cc:529] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.465595 21923 ts_tablet_manager.cc:1173] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.465679 21923 tablet_copy_client.cc:566] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.465767 21923 tablet_copy_client.cc:529] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.465956 21925 ts_tablet_manager.cc:1173] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.466145 21925 tablet_copy_client.cc:566] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.466267 21925 tablet_copy_client.cc:529] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.466548 21917 ts_tablet_manager.cc:1173] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.466615 21917 tablet_copy_client.cc:566] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.466694 21917 tablet_copy_client.cc:529] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.470402 21815 service_pool.cc:132] FetchData request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.FetchData from 127.18.43.2:57047 (request call id 40) I0710 23:26:42.470896 21912 tablet_copy_client.cc:405] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.471933 21908 tablet_copy_client.cc:405] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.472775 21912 ts_tablet_manager.cc:1028] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.472982 21908 ts_tablet_manager.cc:1028] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.473043 21912 tablet_bootstrap.cc:427] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.473074 21908 tablet_bootstrap.cc:427] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.473927 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet e425aeacae634ba695a97557c5ebb75a from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.474061 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet e425aeacae634ba695a97557c5ebb75a from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-e425aeacae634ba695a97557c5ebb75a I0710 23:26:42.474941 21829 tablet_copy_source_session.cc:202] T e425aeacae634ba695a97557c5ebb75a P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.477025 21907 tablet_copy_client.cc:405] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.478101 21910 tablet_copy_client.cc:405] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.478364 21907 ts_tablet_manager.cc:1028] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.478476 21907 tablet_bootstrap.cc:427] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.479406 21910 ts_tablet_manager.cc:1028] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.479497 21910 tablet_bootstrap.cc:427] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.479792 21923 tablet_copy_client.cc:405] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.480911 21923 ts_tablet_manager.cc:1028] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.481003 21923 tablet_bootstrap.cc:427] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.483973 21909 ts_tablet_manager.cc:1173] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.484068 21909 tablet_copy_client.cc:566] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.484195 21909 tablet_copy_client.cc:529] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.491442 21925 tablet_copy_client.cc:405] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.492964 21925 ts_tablet_manager.cc:1028] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.493091 21925 tablet_bootstrap.cc:427] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.499831 21917 tablet_copy_client.cc:405] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.501480 21917 ts_tablet_manager.cc:1028] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.501595 21917 tablet_bootstrap.cc:427] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.502323 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet f49626b5d56d4f828e36578b5101e8e0 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.502382 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet f49626b5d56d4f828e36578b5101e8e0 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-f49626b5d56d4f828e36578b5101e8e0 I0710 23:26:42.503206 21829 tablet_copy_source_session.cc:202] T f49626b5d56d4f828e36578b5101e8e0 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.507830 21913 tablet_copy_client.cc:405] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.508934 21908 log.cc:525] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Log is configured to *not* fsync() on all Append() calls I0710 23:26:42.509203 21913 ts_tablet_manager.cc:1028] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.509322 21913 tablet_bootstrap.cc:427] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.520743 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet fbe2894430174092986bffc0d8021206 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.520838 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet fbe2894430174092986bffc0d8021206 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-fbe2894430174092986bffc0d8021206 I0710 23:26:42.521654 21829 tablet_copy_source_session.cc:202] T fbe2894430174092986bffc0d8021206 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.524587 21815 service_pool.cc:132] FetchData request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 53) I0710 23:26:42.524808 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 54) I0710 23:26:42.525055 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 55) I0710 23:26:42.525243 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 56) I0710 23:26:42.525426 21815 service_pool.cc:132] BeginTabletCopySession request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.18.43.2:57047 (request call id 57) I0710 23:26:42.525600 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 16e52b82ff124e2093345d5204b7d086 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.525660 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 16e52b82ff124e2093345d5204b7d086 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-16e52b82ff124e2093345d5204b7d086 I0710 23:26:42.526294 21829 tablet_copy_source_session.cc:202] T 16e52b82ff124e2093345d5204b7d086 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.526533 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet e55b3ed036a24cb1ac30f337d5386072 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.526588 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet e55b3ed036a24cb1ac30f337d5386072 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-e55b3ed036a24cb1ac30f337d5386072 I0710 23:26:42.527127 21829 tablet_copy_source_session.cc:202] T e55b3ed036a24cb1ac30f337d5386072 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.532533 21924 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet e425aeacae634ba695a97557c5ebb75a. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.534582 21924 ts_tablet_manager.cc:1173] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.534679 21924 tablet_copy_client.cc:566] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.534790 21924 tablet_copy_client.cc:529] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.535539 21915 tablet_copy_client.cc:405] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.536940 21915 ts_tablet_manager.cc:1028] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.537045 21915 tablet_bootstrap.cc:427] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.546164 21918 tablet_copy_client.cc:405] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.547549 21918 ts_tablet_manager.cc:1028] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.547719 21918 tablet_bootstrap.cc:427] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.556128 21928 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet f49626b5d56d4f828e36578b5101e8e0. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.558190 21928 ts_tablet_manager.cc:1173] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.558280 21928 tablet_copy_client.cc:566] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.558389 21928 tablet_copy_client.cc:529] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.560606 21922 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet fbe2894430174092986bffc0d8021206. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.562614 21922 ts_tablet_manager.cc:1173] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.562723 21922 tablet_copy_client.cc:566] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.562849 21922 tablet_copy_client.cc:529] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.566929 21926 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 16e52b82ff124e2093345d5204b7d086. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.569044 21926 ts_tablet_manager.cc:1173] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.569150 21926 tablet_copy_client.cc:566] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.569258 21926 tablet_copy_client.cc:529] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.576264 21920 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet e55b3ed036a24cb1ac30f337d5386072. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.578423 21920 ts_tablet_manager.cc:1173] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.578544 21920 tablet_copy_client.cc:566] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.578655 21920 tablet_copy_client.cc:529] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.582818 21815 service_pool.cc:132] FetchData request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.FetchData from 127.18.43.2:57047 (request call id 59) I0710 23:26:42.590440 21815 service_pool.cc:132] FetchData request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.FetchData from 127.18.43.2:57047 (request call id 59) I0710 23:26:42.590872 21815 service_pool.cc:132] FetchData request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.FetchData from 127.18.43.2:57047 (request call id 62) I0710 23:26:42.591224 21815 service_pool.cc:132] FetchData request on kudu.tserver.TabletCopyService from 127.18.43.2:57047 dropped due to backpressure. The service queue is full; it has 1 items. Contents of service queue: Call kudu.tserver.TabletCopyService.FetchData from 127.18.43.2:57047 (request call id 62) I0710 23:26:42.593190 21924 tablet_copy_client.cc:405] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.594581 21924 ts_tablet_manager.cc:1028] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.594805 21924 tablet_bootstrap.cc:427] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.596407 21909 tablet_copy_client.cc:405] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.597661 21909 ts_tablet_manager.cc:1028] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.597754 21909 tablet_bootstrap.cc:427] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.612864 21926 tablet_copy_client.cc:405] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.613587 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 8a5f88d22d2b482d9691c52031cafd6e from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.613654 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 8a5f88d22d2b482d9691c52031cafd6e from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-8a5f88d22d2b482d9691c52031cafd6e I0710 23:26:42.614516 21829 tablet_copy_source_session.cc:202] T 8a5f88d22d2b482d9691c52031cafd6e P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.616124 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 420e91af2ba54520ac1b422b22a543eb from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.616189 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 420e91af2ba54520ac1b422b22a543eb from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-420e91af2ba54520ac1b422b22a543eb I0710 23:26:42.616937 21829 tablet_copy_source_session.cc:202] T 420e91af2ba54520ac1b422b22a543eb P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.618953 21922 tablet_copy_client.cc:405] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.619772 21928 tablet_copy_client.cc:405] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.621330 21920 tablet_copy_client.cc:405] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.624128 21916 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 8a5f88d22d2b482d9691c52031cafd6e. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.627919 21927 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 420e91af2ba54520ac1b422b22a543eb. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.630966 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 05ab889d520c4b5db0cab1b6d7e8ae86 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.631043 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 05ab889d520c4b5db0cab1b6d7e8ae86 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-05ab889d520c4b5db0cab1b6d7e8ae86 I0710 23:26:42.631973 21829 tablet_copy_source_session.cc:202] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.633682 21921 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 05ab889d520c4b5db0cab1b6d7e8ae86. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.635752 21920 ts_tablet_manager.cc:1028] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.635864 21920 tablet_bootstrap.cc:427] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.636016 21921 ts_tablet_manager.cc:1173] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.636090 21921 tablet_copy_client.cc:566] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.636200 21921 tablet_copy_client.cc:529] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.637814 21829 tablet_copy_service.cc:135] P 3eefa81a1d344cca94cb71d8fc3a7c08: Received BeginTabletCopySession request for tablet 224d94b52b9e4f859d90edb71b9dc822 from peer 5cb08d1962334a93b8e230c76a0b6099 ({username='slave'} at 127.18.43.2:57047) I0710 23:26:42.637902 21829 tablet_copy_service.cc:156] P 3eefa81a1d344cca94cb71d8fc3a7c08: Beginning new tablet copy session on tablet 224d94b52b9e4f859d90edb71b9dc822 from peer 5cb08d1962334a93b8e230c76a0b6099 at {username='slave'} at 127.18.43.2:57047: session id = 5cb08d1962334a93b8e230c76a0b6099-224d94b52b9e4f859d90edb71b9dc822 I0710 23:26:42.638701 21829 tablet_copy_source_session.cc:202] T 224d94b52b9e4f859d90edb71b9dc822 P 3eefa81a1d344cca94cb71d8fc3a7c08: Tablet Copy: opened 0 blocks and 1 log segments I0710 23:26:42.639350 21921 tablet_copy_client.cc:405] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.640805 21928 ts_tablet_manager.cc:1028] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.640923 21928 tablet_bootstrap.cc:427] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.645973 21922 ts_tablet_manager.cc:1028] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.646098 21922 tablet_bootstrap.cc:427] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.649188 21927 ts_tablet_manager.cc:1173] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.649302 21927 tablet_copy_client.cc:566] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.649416 21927 tablet_copy_client.cc:529] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.650596 21916 ts_tablet_manager.cc:1173] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.650691 21916 tablet_copy_client.cc:566] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.650792 21916 tablet_copy_client.cc:529] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.651464 21926 ts_tablet_manager.cc:1028] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.651562 21926 tablet_bootstrap.cc:427] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.668006 21921 ts_tablet_manager.cc:1028] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.668128 21921 tablet_bootstrap.cc:427] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. W0710 23:26:42.699445 21692 outbound_call.cc:287] RPC callback for RPC call kudu.tserver.TabletCopyService.FetchData -> {remote=127.18.43.1:46659, user_credentials={real_user=slave}} blocked reactor thread for 60172.4us I0710 23:26:42.710911 21911 data_dirs.cc:934] Could only allocate 1 dirs of requested 3 for tablet 224d94b52b9e4f859d90edb71b9dc822. 1 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:42.713176 21911 ts_tablet_manager.cc:1173] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:42.713309 21911 tablet_copy_client.cc:566] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 0 data blocks... I0710 23:26:42.713423 21911 tablet_copy_client.cc:529] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Starting download of 1 WAL segments... I0710 23:26:42.716483 21927 tablet_copy_client.cc:405] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.717839 21927 ts_tablet_manager.cc:1028] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.717967 21927 tablet_bootstrap.cc:427] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.728107 21916 tablet_copy_client.cc:405] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.729437 21916 ts_tablet_manager.cc:1028] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.729555 21916 tablet_bootstrap.cc:427] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. I0710 23:26:42.740353 21911 tablet_copy_client.cc:405] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:42.741650 21911 ts_tablet_manager.cc:1028] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrapping tablet I0710 23:26:42.741777 21911 tablet_bootstrap.cc:427] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap starting. W0710 23:26:42.846637 21921 log.cc:667] Time spent T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Append to log took a long time: real 0.070s user 0.000s sys 0.000s I0710 23:26:43.031647 21908 tablet_bootstrap.cc:427] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=492 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.031953 21910 tablet_bootstrap.cc:427] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=487 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.032316 21917 tablet_bootstrap.cc:427] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=529 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.033833 21913 tablet_bootstrap.cc:427] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=188 overwritten=0 applied=188 ignored=0} inserts{seen=492 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.034150 21912 tablet_bootstrap.cc:427] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=189 overwritten=0 applied=189 ignored=0} inserts{seen=506 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.036206 21908 tablet_bootstrap.cc:427] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.036456 21917 tablet_bootstrap.cc:427] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.036752 21917 ts_tablet_manager.cc:1045] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.535s user 0.114s sys 0.010s I0710 23:26:43.038106 21908 ts_tablet_manager.cc:1045] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.565s user 0.112s sys 0.009s I0710 23:26:43.044206 21912 tablet_bootstrap.cc:427] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.044391 21912 ts_tablet_manager.cc:1045] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.572s user 0.117s sys 0.000s I0710 23:26:43.044770 21910 tablet_bootstrap.cc:427] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.044909 21910 ts_tablet_manager.cc:1045] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.565s user 0.108s sys 0.009s I0710 23:26:43.056037 21913 tablet_bootstrap.cc:427] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.056263 21913 ts_tablet_manager.cc:1045] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.547s user 0.106s sys 0.007s I0710 23:26:43.181306 21925 tablet_bootstrap.cc:427] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=186 overwritten=0 applied=186 ignored=0} inserts{seen=482 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.185669 21907 tablet_bootstrap.cc:427] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=579 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.200142 21925 tablet_bootstrap.cc:427] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.200352 21925 ts_tablet_manager.cc:1045] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.707s user 0.103s sys 0.007s I0710 23:26:43.234194 21923 tablet_bootstrap.cc:427] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=546 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.234585 21923 tablet_bootstrap.cc:427] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.234777 21923 ts_tablet_manager.cc:1045] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.754s user 0.106s sys 0.009s I0710 23:26:43.247959 21907 tablet_bootstrap.cc:427] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.248181 21907 ts_tablet_manager.cc:1045] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.770s user 0.116s sys 0.000s I0710 23:26:43.284314 21928 tablet_bootstrap.cc:427] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=493 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.284672 21928 tablet_bootstrap.cc:427] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.284840 21928 ts_tablet_manager.cc:1045] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.644s user 0.103s sys 0.004s I0710 23:26:43.295127 21926 tablet_bootstrap.cc:427] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=196 overwritten=0 applied=196 ignored=0} inserts{seen=520 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.295634 21926 tablet_bootstrap.cc:427] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.295869 21926 ts_tablet_manager.cc:1045] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.644s user 0.106s sys 0.008s I0710 23:26:43.297991 21924 tablet_bootstrap.cc:427] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=527 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.298326 21924 tablet_bootstrap.cc:427] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.298498 21924 ts_tablet_manager.cc:1045] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.704s user 0.110s sys 0.000s W0710 23:26:43.314700 21909 log.cc:667] Time spent T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Append to log took a long time: real 0.067s user 0.000s sys 0.004s I0710 23:26:43.321740 21926 raft_consensus.cc:325] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.321732 21907 raft_consensus.cc:325] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.321756 21928 raft_consensus.cc:325] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.322114 21928 raft_consensus.cc:630] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.322197 21917 raft_consensus.cc:325] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.322243 21917 raft_consensus.cc:630] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.322540 21928 consensus_queue.cc:227] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 2.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.322540 21917 consensus_queue.cc:227] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 2.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.323246 21917 ts_tablet_manager.cc:1073] T 0617cd1d64ed4dfab4679b69255e839e P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.286s user 0.005s sys 0.000s I0710 23:26:43.323408 21926 raft_consensus.cc:630] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.323529 21926 consensus_queue.cc:227] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 196, Last appended: 2.196, Last appended by leader: 196, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.323765 21913 raft_consensus.cc:325] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.323791 21913 raft_consensus.cc:630] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.323807 21926 ts_tablet_manager.cc:1073] T 16e52b82ff124e2093345d5204b7d086 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.028s user 0.006s sys 0.020s I0710 23:26:43.323868 21913 consensus_queue.cc:227] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 188, Last appended: 2.188, Last appended by leader: 188, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.323966 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-0617cd1d64ed4dfab4679b69255e839e received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.324000 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-0617cd1d64ed4dfab4679b69255e839e on tablet 0617cd1d64ed4dfab4679b69255e839e with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.324182 21913 ts_tablet_manager.cc:1073] T ec16d86dcdb34a5b9f6dc60e9a5d3866 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.268s user 0.001s sys 0.051s I0710 23:26:43.324335 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-16e52b82ff124e2093345d5204b7d086 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.324357 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-16e52b82ff124e2093345d5204b7d086 on tablet 16e52b82ff124e2093345d5204b7d086 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.324384 21925 raft_consensus.cc:325] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.324409 21925 raft_consensus.cc:630] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.324479 21925 consensus_queue.cc:227] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 186, Last appended: 2.186, Last appended by leader: 186, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.324636 21925 ts_tablet_manager.cc:1073] T d9d53b3911f045fda410a0ae098496f4 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.124s user 0.000s sys 0.014s I0710 23:26:43.324852 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-ec16d86dcdb34a5b9f6dc60e9a5d3866 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.324877 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-ec16d86dcdb34a5b9f6dc60e9a5d3866 on tablet ec16d86dcdb34a5b9f6dc60e9a5d3866 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.325202 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-d9d53b3911f045fda410a0ae098496f4 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.325235 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-d9d53b3911f045fda410a0ae098496f4 on tablet d9d53b3911f045fda410a0ae098496f4 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.325394 21928 ts_tablet_manager.cc:1073] T f49626b5d56d4f828e36578b5101e8e0 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.041s user 0.006s sys 0.013s I0710 23:26:43.325500 21907 raft_consensus.cc:630] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.325605 21907 consensus_queue.cc:227] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 2.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.325672 21910 raft_consensus.cc:325] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.325697 21910 raft_consensus.cc:630] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.321781 21924 raft_consensus.cc:325] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.325768 21924 raft_consensus.cc:630] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.325773 21910 consensus_queue.cc:227] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 2.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.325853 21924 consensus_queue.cc:227] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 2.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.325911 21910 ts_tablet_manager.cc:1073] T 9dded2401cb943f0a2bea0337291992a P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.281s user 0.026s sys 0.080s I0710 23:26:43.326028 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-f49626b5d56d4f828e36578b5101e8e0 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.326035 21924 ts_tablet_manager.cc:1073] T e425aeacae634ba695a97557c5ebb75a P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.027s user 0.005s sys 0.008s I0710 23:26:43.326051 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-f49626b5d56d4f828e36578b5101e8e0 on tablet f49626b5d56d4f828e36578b5101e8e0 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.321880 21923 raft_consensus.cc:325] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.326340 21923 raft_consensus.cc:630] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.326432 21923 consensus_queue.cc:227] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 2.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.326478 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-9dded2401cb943f0a2bea0337291992a received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.326508 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-9dded2401cb943f0a2bea0337291992a on tablet 9dded2401cb943f0a2bea0337291992a with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.326642 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-e425aeacae634ba695a97557c5ebb75a received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.326663 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-e425aeacae634ba695a97557c5ebb75a on tablet e425aeacae634ba695a97557c5ebb75a with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.326891 21912 raft_consensus.cc:325] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.326925 21912 raft_consensus.cc:630] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.326995 21912 consensus_queue.cc:227] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 189, Last appended: 2.189, Last appended by leader: 189, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.327183 21912 ts_tablet_manager.cc:1073] T 5a0de49957f84b51b2c03d3e432ee897 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.283s user 0.023s sys 0.054s I0710 23:26:43.327579 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-5a0de49957f84b51b2c03d3e432ee897 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.327621 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-5a0de49957f84b51b2c03d3e432ee897 on tablet 5a0de49957f84b51b2c03d3e432ee897 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.327739 21908 raft_consensus.cc:325] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.327764 21908 raft_consensus.cc:630] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.327831 21908 consensus_queue.cc:227] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 2.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.328006 21908 ts_tablet_manager.cc:1073] T 6be9b59101ec4ae6bec4f3111efb82b3 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.290s user 0.008s sys 0.039s I0710 23:26:43.328377 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-6be9b59101ec4ae6bec4f3111efb82b3 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.328399 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-6be9b59101ec4ae6bec4f3111efb82b3 on tablet 6be9b59101ec4ae6bec4f3111efb82b3 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.331893 21923 ts_tablet_manager.cc:1073] T 39212fb42d874c3cad5a34357eae1a51 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.097s user 0.002s sys 0.000s I0710 23:26:43.332801 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-39212fb42d874c3cad5a34357eae1a51 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.332839 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-39212fb42d874c3cad5a34357eae1a51 on tablet 39212fb42d874c3cad5a34357eae1a51 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.338889 21907 ts_tablet_manager.cc:1073] T bfe7d79a3ac644dc8598fc864fbe659e P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.091s user 0.002s sys 0.000s I0710 23:26:43.339712 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-bfe7d79a3ac644dc8598fc864fbe659e received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.339754 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-bfe7d79a3ac644dc8598fc864fbe659e on tablet bfe7d79a3ac644dc8598fc864fbe659e with peer 5cb08d1962334a93b8e230c76a0b6099 W0710 23:26:43.359683 21915 log.cc:667] Time spent T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Append to log took a long time: real 0.068s user 0.000s sys 0.000s I0710 23:26:43.359758 21915 tablet_bootstrap.cc:427] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=185 overwritten=0 applied=185 ignored=0} inserts{seen=528 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.360121 21915 tablet_bootstrap.cc:427] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.360316 21915 ts_tablet_manager.cc:1045] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.823s user 0.100s sys 0.012s I0710 23:26:43.360913 21915 raft_consensus.cc:325] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.360957 21915 raft_consensus.cc:630] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.361074 21915 consensus_queue.cc:227] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 185, Last appended: 2.185, Last appended by leader: 185, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.361346 21915 ts_tablet_manager.cc:1073] T 3382fcc7728248248fce1bb6b6e10422 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0710 23:26:43.361986 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-3382fcc7728248248fce1bb6b6e10422 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.362020 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-3382fcc7728248248fce1bb6b6e10422 on tablet 3382fcc7728248248fce1bb6b6e10422 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.376503 21918 tablet_bootstrap.cc:427] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=501 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.376869 21918 tablet_bootstrap.cc:427] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.377073 21918 ts_tablet_manager.cc:1045] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.829s user 0.106s sys 0.004s I0710 23:26:43.377634 21918 raft_consensus.cc:325] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.377676 21918 raft_consensus.cc:630] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.377780 21918 consensus_queue.cc:227] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 2.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.391851 21918 ts_tablet_manager.cc:1073] T 58a8d45cf5284f579b89c73d87015736 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.015s user 0.002s sys 0.000s I0710 23:26:43.392503 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-58a8d45cf5284f579b89c73d87015736 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.392556 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-58a8d45cf5284f579b89c73d87015736 on tablet 58a8d45cf5284f579b89c73d87015736 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.409879 21911 tablet_bootstrap.cc:427] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=540 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.410255 21911 tablet_bootstrap.cc:427] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.410442 21911 ts_tablet_manager.cc:1045] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.669s user 0.109s sys 0.004s I0710 23:26:43.411015 21911 raft_consensus.cc:325] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.411054 21911 raft_consensus.cc:630] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.411154 21911 consensus_queue.cc:227] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 2.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.414942 21911 ts_tablet_manager.cc:1073] T 224d94b52b9e4f859d90edb71b9dc822 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0710 23:26:43.415724 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-224d94b52b9e4f859d90edb71b9dc822 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.415763 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-224d94b52b9e4f859d90edb71b9dc822 on tablet 224d94b52b9e4f859d90edb71b9dc822 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.428591 21909 tablet_bootstrap.cc:427] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=190 overwritten=0 applied=190 ignored=0} inserts{seen=479 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.429003 21909 tablet_bootstrap.cc:427] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.429208 21909 ts_tablet_manager.cc:1045] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.831s user 0.107s sys 0.004s I0710 23:26:43.429827 21909 raft_consensus.cc:325] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.429869 21909 raft_consensus.cc:630] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.429997 21909 consensus_queue.cc:227] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 190, Last appended: 2.190, Last appended by leader: 190, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.436687 21909 ts_tablet_manager.cc:1073] T 188113a621d14966945feb51e41ea4a5 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s I0710 23:26:43.437482 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-188113a621d14966945feb51e41ea4a5 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.437531 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-188113a621d14966945feb51e41ea4a5 on tablet 188113a621d14966945feb51e41ea4a5 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.451447 21922 tablet_bootstrap.cc:427] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=191 overwritten=0 applied=191 ignored=0} inserts{seen=509 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.451928 21922 tablet_bootstrap.cc:427] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.453837 21922 ts_tablet_manager.cc:1045] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.808s user 0.113s sys 0.000s I0710 23:26:43.454710 21922 raft_consensus.cc:325] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.454844 21922 raft_consensus.cc:630] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.454998 21922 consensus_queue.cc:227] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 191, Last appended: 2.191, Last appended by leader: 191, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.458312 21922 ts_tablet_manager.cc:1073] T fbe2894430174092986bffc0d8021206 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0710 23:26:43.460336 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-fbe2894430174092986bffc0d8021206 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.460377 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-fbe2894430174092986bffc0d8021206 on tablet fbe2894430174092986bffc0d8021206 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.467180 21920 tablet_bootstrap.cc:427] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=193 overwritten=0 applied=193 ignored=0} inserts{seen=528 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.467514 21920 tablet_bootstrap.cc:427] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.467727 21920 ts_tablet_manager.cc:1045] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.832s user 0.106s sys 0.007s I0710 23:26:43.468437 21920 raft_consensus.cc:325] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.468470 21920 raft_consensus.cc:630] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.468556 21920 consensus_queue.cc:227] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 193, Last appended: 2.193, Last appended by leader: 193, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.469676 21921 tablet_bootstrap.cc:427] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=192 overwritten=0 applied=192 ignored=0} inserts{seen=482 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.470001 21921 tablet_bootstrap.cc:427] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.470180 21921 ts_tablet_manager.cc:1045] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.802s user 0.102s sys 0.008s I0710 23:26:43.470661 21921 raft_consensus.cc:325] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.470696 21921 raft_consensus.cc:630] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.470787 21921 consensus_queue.cc:227] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 192, Last appended: 2.192, Last appended by leader: 192, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.471067 21921 ts_tablet_manager.cc:1073] T 05ab889d520c4b5db0cab1b6d7e8ae86 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.001s user 0.003s sys 0.000s I0710 23:26:43.471632 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-05ab889d520c4b5db0cab1b6d7e8ae86 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.471673 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-05ab889d520c4b5db0cab1b6d7e8ae86 on tablet 05ab889d520c4b5db0cab1b6d7e8ae86 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.472364 21920 ts_tablet_manager.cc:1073] T e55b3ed036a24cb1ac30f337d5386072 P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.005s user 0.000s sys 0.001s I0710 23:26:43.472798 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-e55b3ed036a24cb1ac30f337d5386072 received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.472833 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-e55b3ed036a24cb1ac30f337d5386072 on tablet e55b3ed036a24cb1ac30f337d5386072 with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.483304 21927 tablet_bootstrap.cc:427] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=195 overwritten=0 applied=195 ignored=0} inserts{seen=517 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.483664 21927 tablet_bootstrap.cc:427] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.483835 21927 ts_tablet_manager.cc:1045] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.766s user 0.092s sys 0.024s I0710 23:26:43.484287 21927 raft_consensus.cc:325] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.484330 21927 raft_consensus.cc:630] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.484416 21927 consensus_queue.cc:227] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 195, Last appended: 2.195, Last appended by leader: 195, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.484709 21927 ts_tablet_manager.cc:1073] T 420e91af2ba54520ac1b422b22a543eb P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0710 23:26:43.485371 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-420e91af2ba54520ac1b422b22a543eb received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.485410 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-420e91af2ba54520ac1b422b22a543eb on tablet 420e91af2ba54520ac1b422b22a543eb with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.489332 21916 tablet_bootstrap.cc:427] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap replayed 1/1 log segments. Stats: ops{read=194 overwritten=0 applied=194 ignored=0} inserts{seen=513 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:43.489673 21916 tablet_bootstrap.cc:427] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: Bootstrap complete. I0710 23:26:43.489826 21916 ts_tablet_manager.cc:1045] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: Time spent bootstrapping tablet: real 0.760s user 0.100s sys 0.011s I0710 23:26:43.490260 21916 raft_consensus.cc:325] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.490289 21916 raft_consensus.cc:630] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099 [term 2 NON_PARTICIPANT]: Becoming Follower/Learner. State: Replica: 5cb08d1962334a93b8e230c76a0b6099, State: Initialized, Role: NON_PARTICIPANT I0710 23:26:43.490380 21916 consensus_queue.cc:227] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 194, Last appended: 2.194, Last appended by leader: 194, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3eefa81a1d344cca94cb71d8fc3a7c08" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 46659 } } I0710 23:26:43.490582 21916 ts_tablet_manager.cc:1073] T 8a5f88d22d2b482d9691c52031cafd6e P 5cb08d1962334a93b8e230c76a0b6099: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0710 23:26:43.491230 21829 tablet_copy_service.cc:325] P 3eefa81a1d344cca94cb71d8fc3a7c08: Request end of tablet copy session 5cb08d1962334a93b8e230c76a0b6099-8a5f88d22d2b482d9691c52031cafd6e received from {username='slave'} at 127.18.43.2:57047 I0710 23:26:43.491268 21829 tablet_copy_service.cc:413] P 3eefa81a1d344cca94cb71d8fc3a7c08: ending tablet copy session 5cb08d1962334a93b8e230c76a0b6099-8a5f88d22d2b482d9691c52031cafd6e on tablet 8a5f88d22d2b482d9691c52031cafd6e with peer 5cb08d1962334a93b8e230c76a0b6099 I0710 23:26:43.502131 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 21808 W0710 23:26:43.505352 21527 connection.cc:512] server connection from 127.18.43.1:49927 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:49927): Connection reset by peer (error 104) W0710 23:26:43.505399 21194 connection.cc:512] client connection to 127.18.43.1:46659 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:46659): Connection reset by peer (error 104) W0710 23:26:43.505414 21692 connection.cc:512] client connection to 127.18.43.1:46659 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:46659): Connection reset by peer (error 104) I0710 23:26:43.505625 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 21685 W0710 23:26:43.510768 21526 connection.cc:512] server connection from 127.18.43.2:40405 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:40405): Connection reset by peer (error 104) W0710 23:26:43.510803 21194 connection.cc:512] client connection to 127.18.43.2:38483 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:38483): Connection reset by peer (error 104) I0710 23:26:43.511034 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 21517 W0710 23:26:43.514758 21194 connection.cc:512] client connection to 127.18.43.62:33645 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:33645): Connection reset by peer (error 104) [ OK ] TabletCopyClientSessionITest.TestTabletCopyWithBusySource (7072 ms) [ RUN ] TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure I0710 23:26:43.528944 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1 --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:34207 --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:43.576593 21953 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:43.576773 21953 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:43.577735 21953 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:43.577759 21953 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:43.577765 21953 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:43.577772 21953 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:43.579291 21953 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1 --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:34207 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/info.pb --webserver_interface=127.18.43.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:43.582581 21953 master_main.cc:80] Initializing master server... I0710 23:26:43.583068 21953 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 196016us I0710 23:26:43.583976 21953 fs_manager.cc:261] Metadata directory not provided I0710 23:26:43.584022 21953 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:43.584285 21953 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:43.584305 21953 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:43.586918 21953 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/instance: uuid: "c1d0bed5fc8648d595d0d2207e59d80d" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.587255 21953 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1/instance: uuid: "c1d0bed5fc8648d595d0d2207e59d80d" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.587482 21953 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal/instance: uuid: "c1d0bed5fc8648d595d0d2207e59d80d" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.593405 21953 fs_manager.cc:501] Time spent creating directory manager: real 0.006s user 0.003s sys 0.001s I0710 23:26:43.594238 21953 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:43.594516 21953 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:43.597705 21953 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:43.597826 21953 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal uuid: "c1d0bed5fc8648d595d0d2207e59d80d" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.597928 21953 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal 2 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/data, /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:43.622262 21953 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:43.622860 21953 master_main.cc:83] Starting Master server... I0710 23:26:43.627148 21953 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:34207 I0710 23:26:43.627511 21953 webserver.cc:175] Starting webserver on 127.18.43.62:0 I0710 23:26:43.627532 21953 webserver.cc:186] Document root disabled I0710 23:26:43.627990 21953 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:40881/ I0710 23:26:43.628587 21953 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/info.pb I0710 23:26:43.631376 22013 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 00000000000000000000000000000000. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:43.633148 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 21953 I0710 23:26:43.633585 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-1 --block_manager=log --rpc_bind_addresses=127.18.43.1:0 --local_ip_for_outbound_sockets=127.18.43.1 --webserver_interface=127.18.43.1 --webserver_port=0 --tserver_master_addrs=127.18.43.62:34207 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-0/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --num_tablets_to_copy_simultaneously=10 --flush_threshold_mb=1 --flush_threshold_secs=1 --crash_on_eio=false with env {} I0710 23:26:43.636693 22013 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Bootstrap starting. I0710 23:26:43.638689 22013 tablet_bootstrap.cc:578] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: No blocks or log segments found. Creating new log. I0710 23:26:43.639464 22013 log.cc:525] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Log is configured to *not* fsync() on all Append() calls I0710 23:26:43.640863 22013 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: No bootstrap required, opened a new log I0710 23:26:43.643815 22013 raft_consensus.cc:325] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } I0710 23:26:43.643889 22013 raft_consensus.cc:351] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:43.643920 22013 raft_consensus.cc:630] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d0bed5fc8648d595d0d2207e59d80d, State: Initialized, Role: FOLLOWER I0710 23:26:43.644356 22013 consensus_queue.cc:227] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } I0710 23:26:43.644429 22013 raft_consensus.cc:365] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:43.644469 22013 raft_consensus.cc:457] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:43.644533 22013 raft_consensus.cc:2732] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Snoozing failure detection for 1.996s (starting election) I0710 23:26:43.644565 22013 raft_consensus.cc:2784] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:43.645720 22013 raft_consensus.cc:479] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } I0710 23:26:43.646095 22013 leader_election.cc:278] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:43.646625 22016 raft_consensus.cc:2732] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Snoozing failure detection for 1.554s (election complete) I0710 23:26:43.646675 22016 raft_consensus.cc:2539] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:43.646847 22016 raft_consensus.cc:595] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 1 LEADER]: Becoming Leader. State: Replica: c1d0bed5fc8648d595d0d2207e59d80d, State: Running, Role: LEADER I0710 23:26:43.647135 22016 consensus_queue.cc:204] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } I0710 23:26:43.648646 22017 sys_catalog.cc:337] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1d0bed5fc8648d595d0d2207e59d80d. Latest consensus state: current_term: 1 leader_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } } I0710 23:26:43.648694 22017 sys_catalog.cc:340] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: This master's current role is: LEADER I0710 23:26:43.648644 22018 sys_catalog.cc:337] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } } I0710 23:26:43.648911 22018 sys_catalog.cc:340] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: This master's current role is: LEADER I0710 23:26:43.649355 22013 sys_catalog.cc:337] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } } I0710 23:26:43.649396 22013 sys_catalog.cc:340] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: This master's current role is: LEADER I0710 23:26:43.650204 22013 sys_catalog.cc:424] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:43.650552 21953 master_main.cc:86] Master server successfully started. W0710 23:26:43.657229 22021 catalog_manager.cc:1075] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0710 23:26:43.657299 22021 catalog_manager.cc:574] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0710 23:26:43.657483 22020 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:43.658780 22020 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:43.684345 22014 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:43.684588 22014 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:43.685801 22014 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:43.685863 22014 flags.cc:406] Enabled experimental flag: --flush_threshold_mb=1 W0710 23:26:43.685879 22014 flags.cc:406] Enabled experimental flag: --flush_threshold_secs=1 W0710 23:26:43.685904 22014 flags.cc:406] Enabled experimental flag: --crash_on_eio=false W0710 23:26:43.685993 22014 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.1 I0710 23:26:43.688019 22014 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-1 --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-0/info.pb --webserver_interface=127.18.43.1 --webserver_port=0 --flush_threshold_mb=1 --flush_threshold_secs=1 --tserver_master_addrs=127.18.43.62:34207 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:43.692610 22014 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:43.693646 22014 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 196016us I0710 23:26:43.694377 22014 fs_manager.cc:261] Metadata directory not provided I0710 23:26:43.694422 22014 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:43.694666 22014 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:43.694681 22014 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:43.698310 22014 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-0/instance: uuid: "3576d2baa86141439f2e837433589a9b" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.698770 22014 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-1/instance: uuid: "3576d2baa86141439f2e837433589a9b" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.699065 22014 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/wal/instance: uuid: "3576d2baa86141439f2e837433589a9b" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.699754 22020 catalog_manager.cc:915] Generated new certificate authority record I0710 23:26:43.701133 22020 catalog_manager.cc:1037] Loading token signing keys... I0710 23:26:43.706735 22014 fs_manager.cc:501] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s I0710 23:26:43.707727 22014 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:43.708015 22014 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:43.711197 22014 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:43.711345 22014 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-1,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/wal uuid: "3576d2baa86141439f2e837433589a9b" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.711457 22014 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/wal 2 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-0/data, /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-1/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:43.721237 22020 catalog_manager.cc:4131] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Generated new TSK 0 I0710 23:26:43.744570 22014 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:43.745427 22014 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:43.745549 22014 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:43.752768 22014 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.1:45577 I0710 23:26:43.753080 22014 webserver.cc:175] Starting webserver on 127.18.43.1:0 I0710 23:26:43.753098 22014 webserver.cc:186] Document root disabled I0710 23:26:43.753532 22014 webserver.cc:313] Webserver started. Bound to: http://127.18.43.1:44103/ I0710 23:26:43.754081 22014 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-0/data-0/info.pb I0710 23:26:43.754523 22014 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:43.758208 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 22014 I0710 23:26:43.758641 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1 --block_manager=log --rpc_bind_addresses=127.18.43.2:0 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_interface=127.18.43.2 --webserver_port=0 --tserver_master_addrs=127.18.43.62:34207 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --num_tablets_to_copy_simultaneously=10 --flush_threshold_mb=1 --flush_threshold_secs=1 --crash_on_eio=false with env {} I0710 23:26:43.769073 22144 heartbeater.cc:346] Connected to a master server at 127.18.43.62:34207 I0710 23:26:43.769280 22144 heartbeater.cc:426] Registering TS with master... I0710 23:26:43.769788 22144 heartbeater.cc:475] Master 127.18.43.62:34207 requested a full tablet report, sending... I0710 23:26:43.771384 21980 ts_manager.cc:98] Registered new tserver with Master: 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:43.772976 21980 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.1:53727 WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:43.802543 22148 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:43.802739 22148 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:43.803561 22148 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:43.803647 22148 flags.cc:406] Enabled experimental flag: --flush_threshold_mb=1 W0710 23:26:43.803660 22148 flags.cc:406] Enabled experimental flag: --flush_threshold_secs=1 W0710 23:26:43.803671 22148 flags.cc:406] Enabled experimental flag: --crash_on_eio=false W0710 23:26:43.803692 22148 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:43.805143 22148 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1 --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/info.pb --webserver_interface=127.18.43.2 --webserver_port=0 --flush_threshold_mb=1 --flush_threshold_secs=1 --tserver_master_addrs=127.18.43.62:34207 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:43.809181 22148 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:43.810004 22148 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 196016us I0710 23:26:43.810562 22148 fs_manager.cc:261] Metadata directory not provided I0710 23:26:43.810595 22148 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:43.810791 22148 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0710 23:26:43.810808 22148 server_base.cc:433] Attempting to create new FS layout instead I0710 23:26:43.813529 22148 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/instance: uuid: "6ec7d1737cd1460ab9dd752e64eac912" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.813843 22148 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/instance: uuid: "6ec7d1737cd1460ab9dd752e64eac912" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.814047 22148 fs_manager.cc:601] Generated new instance metadata in path /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal/instance: uuid: "6ec7d1737cd1460ab9dd752e64eac912" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.820188 22148 fs_manager.cc:501] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s I0710 23:26:43.820971 22148 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:43.821259 22148 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:43.824182 22148 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0710 23:26:43.824299 22148 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "6ec7d1737cd1460ab9dd752e64eac912" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.824381 22148 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal 2 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/data, /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:43.845628 22148 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:43.846453 22148 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:43.846571 22148 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:43.852629 22148 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:45917 I0710 23:26:43.852985 22148 webserver.cc:175] Starting webserver on 127.18.43.2:0 I0710 23:26:43.853006 22148 webserver.cc:186] Document root disabled I0710 23:26:43.853430 22148 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:46731/ I0710 23:26:43.853987 22148 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/info.pb I0710 23:26:43.854418 22148 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:43.862170 22268 heartbeater.cc:346] Connected to a master server at 127.18.43.62:34207 I0710 23:26:43.862313 22268 heartbeater.cc:426] Registering TS with master... I0710 23:26:43.862709 22268 heartbeater.cc:475] Master 127.18.43.62:34207 requested a full tablet report, sending... I0710 23:26:43.863670 21980 ts_manager.cc:98] Registered new tserver with Master: 6ec7d1737cd1460ab9dd752e64eac912 (127.18.43.2:45917) I0710 23:26:43.863874 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 22148 I0710 23:26:43.864452 21980 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:35671 I0710 23:26:43.868981 18604 external_mini_cluster.cc:505] 2 TS(s) registered with all masters I0710 23:26:43.876442 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 22148 W0710 23:26:43.880421 21963 connection.cc:512] server connection from 127.18.43.2:35671 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:35671): Connection reset by peer (error 104) I0710 23:26:43.880528 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 21953 W0710 23:26:43.884536 22274 connection.cc:512] client connection to 127.18.43.62:34207 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:34207): Connection reset by peer (error 104) W0710 23:26:43.884536 21952 connection.cc:512] client connection to 127.18.43.62:34207 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:34207): Connection reset by peer (error 104) W0710 23:26:43.884604 22034 connection.cc:512] client connection to 127.18.43.62:34207 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:34207): Connection reset by peer (error 104) I0710 23:26:43.885058 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1 --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:34207 --webserver_interface=127.18.43.62 --webserver_port=40881 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --master_tombstone_evicted_tablet_replicas=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:43.933848 22277 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:43.934043 22277 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:43.934983 22277 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0710 23:26:43.935003 22277 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:43.935009 22277 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0710 23:26:43.935020 22277 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0710 23:26:43.936514 22277 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1 --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal --master_tombstone_evicted_tablet_replicas=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.18.43.62:34207 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/info.pb --webserver_interface=127.18.43.62 --webserver_port=40881 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:43.940076 22277 master_main.cc:80] Initializing master server... I0710 23:26:43.940537 22277 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 196016us I0710 23:26:43.941365 22277 fs_manager.cc:261] Metadata directory not provided I0710 23:26:43.941421 22277 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:43.945713 22277 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:43.946152 22277 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:43.946399 22277 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:43.949448 22277 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s I0710 23:26:43.950016 22277 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal uuid: "c1d0bed5fc8648d595d0d2207e59d80d" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:43.950109 22277 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/wal 2 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/data, /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-1/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:43.975621 22277 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:43.976161 22277 master_main.cc:83] Starting Master server... I0710 23:26:43.980295 22277 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.62:34207 I0710 23:26:43.980623 22277 webserver.cc:175] Starting webserver on 127.18.43.62:40881 I0710 23:26:43.980639 22277 webserver.cc:186] Document root disabled I0710 23:26:43.981015 22277 webserver.cc:313] Webserver started. Bound to: http://127.18.43.62:40881/ I0710 23:26:43.981606 22277 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/master-0/data-0/info.pb I0710 23:26:43.986191 22337 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Bootstrap starting. I0710 23:26:43.989138 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master as pid 22277 I0710 23:26:43.998709 22337 log.cc:525] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Log is configured to *not* fsync() on all Append() calls I0710 23:26:44.004500 22337 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=1} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0710 23:26:44.004962 22337 tablet_bootstrap.cc:427] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Bootstrap complete. I0710 23:26:44.008750 22337 raft_consensus.cc:325] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } I0710 23:26:44.008831 22337 raft_consensus.cc:630] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1d0bed5fc8648d595d0d2207e59d80d, State: Initialized, Role: FOLLOWER I0710 23:26:44.009207 22337 consensus_queue.cc:227] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } I0710 23:26:44.009269 22337 raft_consensus.cc:365] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.009305 22337 raft_consensus.cc:457] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.009367 22337 raft_consensus.cc:2732] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Snoozing failure detection for 1.943s (starting election) I0710 23:26:44.009390 22337 raft_consensus.cc:2784] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 1 FOLLOWER]: Advancing to term 2 I0710 23:26:44.011240 22337 raft_consensus.cc:479] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } I0710 23:26:44.011514 22337 leader_election.cc:278] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. I0710 23:26:44.012080 22337 sys_catalog.cc:337] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } } I0710 23:26:44.012115 22337 sys_catalog.cc:340] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: This master's current role is: FOLLOWER I0710 23:26:44.012763 22337 sys_catalog.cc:424] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: configured and running, proceeding with master startup. I0710 23:26:44.013056 22340 raft_consensus.cc:2732] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Snoozing failure detection for 2.024s (election complete) I0710 23:26:44.013232 22277 master_main.cc:86] Master server successfully started. I0710 23:26:44.013288 22340 raft_consensus.cc:2539] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 2 FOLLOWER]: Leader election won for term 2 I0710 23:26:44.013432 22340 raft_consensus.cc:595] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [term 2 LEADER]: Becoming Leader. State: Replica: c1d0bed5fc8648d595d0d2207e59d80d, State: Running, Role: LEADER I0710 23:26:44.013689 22340 consensus_queue.cc:204] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } I0710 23:26:44.014503 22340 sys_catalog.cc:337] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1d0bed5fc8648d595d0d2207e59d80d. Latest consensus state: current_term: 2 leader_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } } I0710 23:26:44.014528 22340 sys_catalog.cc:340] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: This master's current role is: LEADER I0710 23:26:44.014909 22341 sys_catalog.cc:337] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1d0bed5fc8648d595d0d2207e59d80d" member_type: VOTER } } I0710 23:26:44.014935 22341 sys_catalog.cc:340] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d [sys.catalog]: This master's current role is: LEADER I0710 23:26:44.019006 22342 catalog_manager.cc:1073] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: acquiring CA information for follower catalog manager: success I0710 23:26:44.020264 22342 catalog_manager.cc:1101] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0710 23:26:44.020370 22345 catalog_manager.cc:1017] Loading table and tablet metadata into memory... I0710 23:26:44.021628 22345 catalog_manager.cc:1028] Initializing Kudu internal certificate authority... I0710 23:26:44.022409 22345 catalog_manager.cc:1037] Loading token signing keys... I0710 23:26:44.022923 22345 catalog_manager.cc:4142] T 00000000000000000000000000000000 P c1d0bed5fc8648d595d0d2207e59d80d: Loaded TSK: 0 I0710 23:26:44.775368 22144 heartbeater.cc:467] Master 127.18.43.62:34207 was elected leader, sending a full tablet report... I0710 23:26:44.780697 22304 master_service.cc:205] Got heartbeat from unknown tserver (permanent_uuid: "3576d2baa86141439f2e837433589a9b" instance_seqno: 1531265203751713) as {username='slave'} at 127.18.43.1:56931; Asking this server to re-register. I0710 23:26:44.781201 22144 heartbeater.cc:426] Registering TS with master... I0710 23:26:44.781332 22144 heartbeater.cc:475] Master 127.18.43.62:34207 requested a full tablet report, sending... I0710 23:26:44.782385 22304 ts_manager.cc:98] Registered new tserver with Master: 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:44.783133 18604 external_mini_cluster.cc:505] 1 TS(s) registered with all masters I0710 23:26:44.783221 18604 test_util.cc:208] Using random seed: 1989576819 I0710 23:26:44.793711 22304 catalog_manager.cc:1350] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58180: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s" } partition_schema { range_schema { columns { name: "key" } } } I0710 23:26:44.811321 22079 tablet_service.cc:759] Processing CreateTablet for tablet 7dcd98b4c6f0472cbd570a3408ab1aa1 (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092 I0710 23:26:44.811365 22076 tablet_service.cc:759] Processing CreateTablet for tablet 18aa52f6e09947709e0b183c6d7d21d3 (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184 I0710 23:26:44.811321 22073 tablet_service.cc:759] Processing CreateTablet for tablet 45da44391d8a42a780127f45b9ec59e6 (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276 I0710 23:26:44.811491 22077 tablet_service.cc:759] Processing CreateTablet for tablet 8facaf1b4c2e4745baf379f06a8773c8 (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820 I0710 23:26:44.811516 22072 tablet_service.cc:759] Processing CreateTablet for tablet 782cbc85002b4ef594bdd8a41b62d57e (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION VALUES >= 1932735276 I0710 23:26:44.811321 22075 tablet_service.cc:759] Processing CreateTablet for tablet f5d922d9e6fb45bd9d98acf118e6d9e8 (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548 I0710 23:26:44.811563 22074 tablet_service.cc:759] Processing CreateTablet for tablet e076cfa4d8674332aef98dec88fd570e (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912 I0710 23:26:44.811321 22078 tablet_service.cc:759] Processing CreateTablet for tablet e84b278749d54e9b9978065912c42363 (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456 I0710 23:26:44.811873 22080 tablet_service.cc:759] Processing CreateTablet for tablet 2ec5b22f7bc141d2b4fbfc3b12bb7207 (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728 I0710 23:26:44.812253 22081 tablet_service.cc:759] Processing CreateTablet for tablet 628f1e270e1948d2b555b1827254d4ab (table=test-workload [id=5deb6e4963944526be7b024288f92eef]), partition=RANGE (key) PARTITION VALUES < 214748364 I0710 23:26:44.812441 22077 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 8facaf1b4c2e4745baf379f06a8773c8. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.812732 22073 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 45da44391d8a42a780127f45b9ec59e6. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.813583 22072 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 782cbc85002b4ef594bdd8a41b62d57e. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.813760 22074 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet e076cfa4d8674332aef98dec88fd570e. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.813870 22080 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 2ec5b22f7bc141d2b4fbfc3b12bb7207. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.814121 22076 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 18aa52f6e09947709e0b183c6d7d21d3. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.814298 22075 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet f5d922d9e6fb45bd9d98acf118e6d9e8. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.814425 22078 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet e84b278749d54e9b9978065912c42363. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.814783 22081 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 628f1e270e1948d2b555b1827254d4ab. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.815564 22079 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 7dcd98b4c6f0472cbd570a3408ab1aa1. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:44.823880 22081 ts_tablet_manager.cc:1173] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.824239 22079 ts_tablet_manager.cc:1173] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.824357 22075 ts_tablet_manager.cc:1173] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.824753 22074 ts_tablet_manager.cc:1173] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.824954 22076 ts_tablet_manager.cc:1173] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.825063 22072 ts_tablet_manager.cc:1173] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.825197 22362 ts_tablet_manager.cc:1028] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.825413 22362 tablet_bootstrap.cc:427] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.825819 22077 ts_tablet_manager.cc:1173] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.826025 22080 ts_tablet_manager.cc:1173] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.826671 22073 ts_tablet_manager.cc:1173] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.826984 22362 tablet_bootstrap.cc:578] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.827214 22078 ts_tablet_manager.cc:1173] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Registered tablet (data state: TABLET_DATA_READY) I0710 23:26:44.827466 22361 ts_tablet_manager.cc:1028] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.827544 22361 tablet_bootstrap.cc:427] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.827775 22362 log.cc:525] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Log is configured to *not* fsync() on all Append() calls I0710 23:26:44.828303 22361 tablet_bootstrap.cc:578] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.828765 22362 tablet_bootstrap.cc:427] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.828979 22362 ts_tablet_manager.cc:1045] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0710 23:26:44.829134 22361 tablet_bootstrap.cc:427] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.829205 22361 ts_tablet_manager.cc:1045] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:44.831475 22362 raft_consensus.cc:325] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.831475 22361 raft_consensus.cc:325] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.831543 22362 raft_consensus.cc:351] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.831545 22361 raft_consensus.cc:351] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.831579 22362 raft_consensus.cc:630] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.831579 22361 raft_consensus.cc:630] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.832026 22362 consensus_queue.cc:227] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.832026 22361 consensus_queue.cc:227] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.832093 22362 raft_consensus.cc:365] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.832094 22361 raft_consensus.cc:365] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.832137 22362 raft_consensus.cc:457] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.832137 22361 raft_consensus.cc:457] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.832209 22361 raft_consensus.cc:2732] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.938s (starting election) I0710 23:26:44.832209 22362 raft_consensus.cc:2732] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.086s (starting election) I0710 23:26:44.832240 22361 raft_consensus.cc:2784] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.832242 22362 raft_consensus.cc:2784] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.833523 22362 raft_consensus.cc:479] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.833547 22361 raft_consensus.cc:479] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.833966 22361 leader_election.cc:278] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.833967 22362 leader_election.cc:278] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.834509 22366 raft_consensus.cc:2732] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.143s (election complete) I0710 23:26:44.834590 22366 raft_consensus.cc:2539] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.834700 22366 raft_consensus.cc:595] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.834972 22361 ts_tablet_manager.cc:1073] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s I0710 23:26:44.835007 22366 consensus_queue.cc:204] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.835036 22362 ts_tablet_manager.cc:1073] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.006s user 0.002s sys 0.005s I0710 23:26:44.835127 22361 ts_tablet_manager.cc:1028] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.835208 22361 tablet_bootstrap.cc:427] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.835665 22362 ts_tablet_manager.cc:1028] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.835741 22362 tablet_bootstrap.cc:427] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.834511 22365 raft_consensus.cc:2732] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.884s (election complete) I0710 23:26:44.835844 22365 raft_consensus.cc:2539] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.835896 22365 raft_consensus.cc:595] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.836012 22365 consensus_queue.cc:204] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.836518 22362 tablet_bootstrap.cc:578] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.838078 22361 tablet_bootstrap.cc:578] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.838994 22361 tablet_bootstrap.cc:427] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.839004 22362 tablet_bootstrap.cc:427] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.839082 22361 ts_tablet_manager.cc:1045] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s I0710 23:26:44.839082 22362 ts_tablet_manager.cc:1045] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.001s I0710 23:26:44.839265 22304 catalog_manager.cc:3827] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.839514 22304 catalog_manager.cc:3827] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.839644 22362 raft_consensus.cc:325] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.839648 22361 raft_consensus.cc:325] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.839678 22362 raft_consensus.cc:351] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.839679 22361 raft_consensus.cc:351] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.839699 22362 raft_consensus.cc:630] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.839699 22361 raft_consensus.cc:630] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.839823 22361 consensus_queue.cc:227] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.839823 22362 consensus_queue.cc:227] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.839850 22361 raft_consensus.cc:365] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.839854 22362 raft_consensus.cc:365] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.839869 22361 raft_consensus.cc:457] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.839871 22362 raft_consensus.cc:457] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.839895 22361 raft_consensus.cc:2732] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.684s (starting election) I0710 23:26:44.839910 22361 raft_consensus.cc:2784] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.839895 22362 raft_consensus.cc:2732] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.956s (starting election) I0710 23:26:44.839927 22362 raft_consensus.cc:2784] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.840929 22361 raft_consensus.cc:479] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.840941 22362 raft_consensus.cc:479] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.841012 22361 leader_election.cc:278] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.841012 22362 leader_election.cc:278] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.841128 22365 raft_consensus.cc:2732] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.183s (election complete) I0710 23:26:44.841156 22365 raft_consensus.cc:2539] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.841188 22365 raft_consensus.cc:595] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.841275 22361 ts_tablet_manager.cc:1073] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:44.841298 22365 consensus_queue.cc:204] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.841344 22361 ts_tablet_manager.cc:1028] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.841435 22361 tablet_bootstrap.cc:427] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.842167 22361 tablet_bootstrap.cc:578] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.842720 22369 raft_consensus.cc:2732] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.835s (election complete) I0710 23:26:44.842779 22369 raft_consensus.cc:2539] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.842819 22369 raft_consensus.cc:595] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.842825 22362 ts_tablet_manager.cc:1073] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.004s user 0.000s sys 0.002s I0710 23:26:44.842882 22362 ts_tablet_manager.cc:1028] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.842957 22369 consensus_queue.cc:204] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.842972 22362 tablet_bootstrap.cc:427] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.843302 22304 catalog_manager.cc:3827] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.843700 22362 tablet_bootstrap.cc:578] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.844765 22362 tablet_bootstrap.cc:427] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.844844 22362 ts_tablet_manager.cc:1045] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.002s user 0.000s sys 0.001s I0710 23:26:44.844955 22361 tablet_bootstrap.cc:427] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.845023 22361 ts_tablet_manager.cc:1045] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s I0710 23:26:44.845306 22362 raft_consensus.cc:325] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.845342 22362 raft_consensus.cc:351] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.845356 22362 raft_consensus.cc:630] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.845365 22361 raft_consensus.cc:325] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.845386 22361 raft_consensus.cc:351] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.845398 22361 raft_consensus.cc:630] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.845517 22362 consensus_queue.cc:227] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.845547 22361 consensus_queue.cc:227] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.845554 22362 raft_consensus.cc:365] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.845566 22362 raft_consensus.cc:457] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.845568 22361 raft_consensus.cc:365] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.845592 22361 raft_consensus.cc:457] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.845594 22362 raft_consensus.cc:2732] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.713s (starting election) I0710 23:26:44.845620 22361 raft_consensus.cc:2732] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.619s (starting election) I0710 23:26:44.845624 22362 raft_consensus.cc:2784] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.845636 22361 raft_consensus.cc:2784] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.846616 22361 raft_consensus.cc:479] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.846632 22362 raft_consensus.cc:479] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.846710 22362 leader_election.cc:278] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.846712 22361 leader_election.cc:278] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.846886 22366 raft_consensus.cc:2732] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.818s (election complete) I0710 23:26:44.846930 22366 raft_consensus.cc:2539] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.846969 22366 raft_consensus.cc:595] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.846993 22369 raft_consensus.cc:2732] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.069s (election complete) I0710 23:26:44.847014 22369 raft_consensus.cc:2539] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.847021 22361 ts_tablet_manager.cc:1073] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:44.847052 22304 catalog_manager.cc:3827] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.847095 22366 consensus_queue.cc:204] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.847133 22369 raft_consensus.cc:595] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.847223 22369 consensus_queue.cc:204] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.847226 22362 ts_tablet_manager.cc:1073] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s I0710 23:26:44.847328 22362 ts_tablet_manager.cc:1028] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.847097 22361 ts_tablet_manager.cc:1028] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.847419 22362 tablet_bootstrap.cc:427] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.847468 22361 tablet_bootstrap.cc:427] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.848387 22361 tablet_bootstrap.cc:578] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.848953 22362 tablet_bootstrap.cc:578] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.849715 22361 tablet_bootstrap.cc:427] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.849808 22361 ts_tablet_manager.cc:1045] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:44.850200 22361 raft_consensus.cc:325] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.850224 22361 raft_consensus.cc:351] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.850234 22361 raft_consensus.cc:630] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.850620 22361 consensus_queue.cc:227] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.850656 22361 raft_consensus.cc:365] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.850669 22361 raft_consensus.cc:457] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.850692 22361 raft_consensus.cc:2732] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.897s (starting election) I0710 23:26:44.850708 22361 raft_consensus.cc:2784] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.850744 22303 catalog_manager.cc:3827] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.850780 22362 tablet_bootstrap.cc:427] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.850847 22362 ts_tablet_manager.cc:1045] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s I0710 23:26:44.850883 22303 catalog_manager.cc:3827] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.851198 22362 raft_consensus.cc:325] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.851225 22362 raft_consensus.cc:351] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.851239 22362 raft_consensus.cc:630] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.851362 22362 consensus_queue.cc:227] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.851387 22362 raft_consensus.cc:365] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.851399 22362 raft_consensus.cc:457] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.851426 22362 raft_consensus.cc:2732] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.122s (starting election) I0710 23:26:44.851442 22362 raft_consensus.cc:2784] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.851687 22361 raft_consensus.cc:479] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.851763 22361 leader_election.cc:278] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.851907 22369 raft_consensus.cc:2732] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.217s (election complete) I0710 23:26:44.851934 22369 raft_consensus.cc:2539] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.851969 22369 raft_consensus.cc:595] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.852077 22369 consensus_queue.cc:204] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.852293 22362 raft_consensus.cc:479] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.852351 22362 leader_election.cc:278] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.852469 22378 raft_consensus.cc:2732] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.211s (election complete) I0710 23:26:44.852480 22361 ts_tablet_manager.cc:1073] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0710 23:26:44.852497 22378 raft_consensus.cc:2539] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.852538 22361 ts_tablet_manager.cc:1028] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.852584 22378 raft_consensus.cc:595] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.852597 22361 tablet_bootstrap.cc:427] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.852612 22362 ts_tablet_manager.cc:1073] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0710 23:26:44.852677 22362 ts_tablet_manager.cc:1028] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Bootstrapping tablet I0710 23:26:44.852679 22378 consensus_queue.cc:204] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.852735 22362 tablet_bootstrap.cc:427] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Bootstrap starting. I0710 23:26:44.853334 22361 tablet_bootstrap.cc:578] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.853492 22362 tablet_bootstrap.cc:578] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: No blocks or log segments found. Creating new log. I0710 23:26:44.854604 22303 catalog_manager.cc:3827] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.854619 22361 tablet_bootstrap.cc:427] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.854681 22361 ts_tablet_manager.cc:1045] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:44.854694 22362 tablet_bootstrap.cc:427] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: No bootstrap required, opened a new log I0710 23:26:44.854748 22362 ts_tablet_manager.cc:1045] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0710 23:26:44.854773 22303 catalog_manager.cc:3827] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.855159 22361 raft_consensus.cc:325] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.855165 22362 raft_consensus.cc:325] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.855186 22361 raft_consensus.cc:351] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.855196 22362 raft_consensus.cc:351] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0710 23:26:44.855201 22361 raft_consensus.cc:630] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.855209 22362 raft_consensus.cc:630] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Initialized, Role: FOLLOWER I0710 23:26:44.855337 22361 consensus_queue.cc:227] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.855342 22362 consensus_queue.cc:227] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.855358 22361 raft_consensus.cc:365] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.855366 22362 raft_consensus.cc:365] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0710 23:26:44.855370 22361 raft_consensus.cc:457] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.855378 22362 raft_consensus.cc:457] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0710 23:26:44.855386 22361 raft_consensus.cc:2732] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.982s (starting election) I0710 23:26:44.855396 22362 raft_consensus.cc:2732] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.197s (starting election) I0710 23:26:44.855399 22361 raft_consensus.cc:2784] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.855412 22362 raft_consensus.cc:2784] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 0 FOLLOWER]: Advancing to term 1 I0710 23:26:44.856436 22362 raft_consensus.cc:479] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.856493 22361 raft_consensus.cc:479] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.856514 22362 leader_election.cc:278] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.856559 22361 leader_election.cc:278] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. I0710 23:26:44.856614 22369 raft_consensus.cc:2732] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 2.053s (election complete) I0710 23:26:44.856636 22369 raft_consensus.cc:2539] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.856658 22378 raft_consensus.cc:2732] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Snoozing failure detection for 1.820s (election complete) I0710 23:26:44.856675 22369 raft_consensus.cc:595] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.856681 22378 raft_consensus.cc:2539] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 1 FOLLOWER]: Leader election won for term 1 I0710 23:26:44.856720 22378 raft_consensus.cc:595] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [term 1 LEADER]: Becoming Leader. State: Replica: 3576d2baa86141439f2e837433589a9b, State: Running, Role: LEADER I0710 23:26:44.856786 22369 consensus_queue.cc:204] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.856817 22378 consensus_queue.cc:204] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } } I0710 23:26:44.857206 22361 ts_tablet_manager.cc:1073] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0710 23:26:44.857314 22362 ts_tablet_manager.cc:1073] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s I0710 23:26:44.858171 22303 catalog_manager.cc:3827] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:44.858280 22303 catalog_manager.cc:3827] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b reported cstate change: term changed from 0 to 1, leader changed from to 3576d2baa86141439f2e837433589a9b (127.18.43.1). New cstate: current_term: 1 leader_uuid: "3576d2baa86141439f2e837433589a9b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3576d2baa86141439f2e837433589a9b" member_type: VOTER last_known_addr { host: "127.18.43.1" port: 45577 } health_report { overall_health: HEALTHY } } } I0710 23:26:46.008553 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(7dcd98b4c6f0472cbd570a3408ab1aa1): perf score=0.000326 I0710 23:26:46.009346 22039 tablet.cc:1152] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.009371 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.009382 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.009392 22039 tablet.cc:1154] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.009454 22039 tablet.cc:1443] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062283811115008}] I0710 23:26:46.014678 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.076848 22039 tablet.cc:1528] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.077167 22039 tablet.cc:1583] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.077203 22039 tablet.cc:1585] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284079775744 or (T in {6272062284079775744})}] I0710 23:26:46.085826 22039 tablet.cc:1633] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush successful on 962 rows (29302 bytes) I0710 23:26:46.086450 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(7dcd98b4c6f0472cbd570a3408ab1aa1) complete. Timing: real 0.077s user 0.038s sys 0.000s Metrics: {"cfile_init":1,"compiler_manager_pool.queue_time_us":580,"data dirs.queue_time_us":643,"data dirs.run_cpu_time_us":171,"data dirs.run_wall_time_us":1209,"lbm_read_time_us":67,"lbm_reads_lt_1ms":4,"lbm_write_time_us":508,"lbm_writes_lt_1ms":23,"thread_start_us":121,"threads_started":2} I0710 23:26:46.087637 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(628f1e270e1948d2b555b1827254d4ab): perf score=0.000348 I0710 23:26:46.087945 22039 tablet.cc:1152] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.087972 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.087980 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.087987 22039 tablet.cc:1154] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.088012 22039 tablet.cc:1443] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284094251008 or (T in {6272062284094251008})}] I0710 23:26:46.088773 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.124439 22039 tablet.cc:1528] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.124567 22039 tablet.cc:1583] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.124599 22039 tablet.cc:1585] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284276580352 or (T in {6272062284276580352})}] I0710 23:26:46.135368 22039 tablet.cc:1633] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush successful on 913 rows (28016 bytes) I0710 23:26:46.139741 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(628f1e270e1948d2b555b1827254d4ab) complete. Timing: real 0.048s user 0.022s sys 0.004s Metrics: {"cfile_init":1,"data dirs.queue_time_us":3274,"data dirs.run_cpu_time_us":185,"data dirs.run_wall_time_us":2321,"lbm_read_time_us":44,"lbm_reads_lt_1ms":4,"lbm_write_time_us":487,"lbm_writes_lt_1ms":23,"thread_start_us":52,"threads_started":1} I0710 23:26:46.140300 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(f5d922d9e6fb45bd9d98acf118e6d9e8): perf score=0.000361 I0710 23:26:46.140578 22039 tablet.cc:1152] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.140597 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.140604 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.140610 22039 tablet.cc:1154] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.140631 22039 tablet.cc:1443] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284292562944 or (T in {6272062284292562944})}] I0710 23:26:46.141206 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.161378 22039 tablet.cc:1528] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.161525 22039 tablet.cc:1583] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.161553 22039 tablet.cc:1585] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284435316736}] I0710 23:26:46.167969 22039 tablet.cc:1633] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush successful on 940 rows (28697 bytes) I0710 23:26:46.168304 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(f5d922d9e6fb45bd9d98acf118e6d9e8) complete. Timing: real 0.028s user 0.025s sys 0.001s Metrics: {"cfile_init":1,"data dirs.queue_time_us":31,"data dirs.run_cpu_time_us":158,"data dirs.run_wall_time_us":1979,"lbm_read_time_us":55,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1766,"lbm_writes_1-10_ms":1,"lbm_writes_lt_1ms":22} I0710 23:26:46.168839 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(7dcd98b4c6f0472cbd570a3408ab1aa1): 9322 bytes on disk I0710 23:26:46.169487 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(7dcd98b4c6f0472cbd570a3408ab1aa1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":78,"lbm_reads_lt_1ms":4} I0710 23:26:46.169911 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(f5d922d9e6fb45bd9d98acf118e6d9e8): 9122 bytes on disk I0710 23:26:46.170269 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(f5d922d9e6fb45bd9d98acf118e6d9e8) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":54,"lbm_reads_lt_1ms":4} I0710 23:26:46.170588 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(e076cfa4d8674332aef98dec88fd570e): perf score=0.000369 I0710 23:26:46.170837 22039 tablet.cc:1152] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.170856 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.170864 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.170871 22039 tablet.cc:1154] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.170892 22039 tablet.cc:1443] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284406063104 or (T in {6272062284406063104})}] I0710 23:26:46.171557 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.188544 22039 tablet.cc:1528] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.188665 22039 tablet.cc:1583] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.188695 22039 tablet.cc:1585] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284537077760 or (T in {6272062284537077760})}] I0710 23:26:46.194919 22039 tablet.cc:1633] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush successful on 993 rows (30082 bytes) I0710 23:26:46.195288 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(e076cfa4d8674332aef98dec88fd570e) complete. Timing: real 0.025s user 0.023s sys 0.001s Metrics: {"cfile_init":1,"data dirs.queue_time_us":24,"data dirs.run_cpu_time_us":165,"data dirs.run_wall_time_us":1452,"lbm_read_time_us":41,"lbm_reads_lt_1ms":4,"lbm_write_time_us":449,"lbm_writes_lt_1ms":23} I0710 23:26:46.195930 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(e076cfa4d8674332aef98dec88fd570e): 9662 bytes on disk I0710 23:26:46.196367 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(e076cfa4d8674332aef98dec88fd570e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4} I0710 23:26:46.196717 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(782cbc85002b4ef594bdd8a41b62d57e): perf score=0.000375 I0710 23:26:46.196971 22039 tablet.cc:1152] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.196986 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.196992 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.197000 22039 tablet.cc:1154] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.197019 22039 tablet.cc:1443] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284530257920 or (T in {6272062284530257920})}] I0710 23:26:46.197696 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.215670 22039 tablet.cc:1528] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.215792 22039 tablet.cc:1583] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.215814 22039 tablet.cc:1585] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284653645824 or (T in {6272062284653645824})}] I0710 23:26:46.220659 22039 tablet.cc:1633] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush successful on 964 rows (29311 bytes) I0710 23:26:46.221020 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(782cbc85002b4ef594bdd8a41b62d57e) complete. Timing: real 0.024s user 0.022s sys 0.000s Metrics: {"cfile_init":1,"compiler_manager_pool.queue_time_us":16580,"compiler_manager_pool.run_cpu_time_us":44,"compiler_manager_pool.run_wall_time_us":43,"data dirs.queue_time_us":29,"data dirs.run_cpu_time_us":120,"data dirs.run_wall_time_us":975,"lbm_read_time_us":45,"lbm_reads_lt_1ms":4,"lbm_write_time_us":464,"lbm_writes_lt_1ms":23} I0710 23:26:46.221582 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(782cbc85002b4ef594bdd8a41b62d57e): 9426 bytes on disk I0710 23:26:46.222002 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(782cbc85002b4ef594bdd8a41b62d57e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4} I0710 23:26:46.222373 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(18aa52f6e09947709e0b183c6d7d21d3): perf score=0.000382 I0710 23:26:46.222626 22039 tablet.cc:1152] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.222647 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.222652 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.222659 22039 tablet.cc:1154] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.222679 22039 tablet.cc:1443] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284671291392 or (T in {6272062284671291392})}] I0710 23:26:46.223314 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.230156 18604 external_mini_cluster.cc:809] Running /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1 --block_manager=log --rpc_bind_addresses=127.18.43.2:45917 --local_ip_for_outbound_sockets=127.18.43.2 --webserver_port=46731 --webserver_interface=127.18.43.2 --tserver_master_addrs=127.18.43.62:34207 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --num_tablets_to_copy_simultaneously=10 --flush_threshold_mb=1 --flush_threshold_secs=1 --crash_on_eio=false with env {} I0710 23:26:46.237689 22039 tablet.cc:1528] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.237845 22039 tablet.cc:1583] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.237874 22039 tablet.cc:1585] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284686508032 or (T in {6272062284686508032})}] I0710 23:26:46.241904 22039 tablet.cc:1633] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush successful on 1052 rows (31523 bytes) I0710 23:26:46.242218 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(18aa52f6e09947709e0b183c6d7d21d3) complete. Timing: real 0.020s user 0.017s sys 0.002s Metrics: {"cfile_init":1,"data dirs.queue_time_us":92,"data dirs.run_cpu_time_us":200,"data dirs.run_wall_time_us":907,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":405,"lbm_writes_lt_1ms":23} I0710 23:26:46.242913 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(8facaf1b4c2e4745baf379f06a8773c8): perf score=0.000386 I0710 23:26:46.243254 22039 tablet.cc:1152] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.243276 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.243283 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.243290 22039 tablet.cc:1154] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.243310 22039 tablet.cc:1443] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284713193472 or (T in {6272062284713193472})}] I0710 23:26:46.244026 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.257058 22039 tablet.cc:1528] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.257243 22039 tablet.cc:1583] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.257274 22039 tablet.cc:1585] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284713193472 or (T in {6272062284713193472})}] I0710 23:26:46.261234 22039 tablet.cc:1633] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Flush successful on 1040 rows (31146 bytes) I0710 23:26:46.261534 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(8facaf1b4c2e4745baf379f06a8773c8) complete. Timing: real 0.018s user 0.017s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":84,"data dirs.run_cpu_time_us":196,"data dirs.run_wall_time_us":854,"lbm_read_time_us":52,"lbm_reads_lt_1ms":4,"lbm_write_time_us":442,"lbm_writes_lt_1ms":23} I0710 23:26:46.262045 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(18aa52f6e09947709e0b183c6d7d21d3): 10222 bytes on disk I0710 23:26:46.262452 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(18aa52f6e09947709e0b183c6d7d21d3) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":59,"lbm_reads_lt_1ms":4} I0710 23:26:46.262743 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(2ec5b22f7bc141d2b4fbfc3b12bb7207): perf score=0.000392 I0710 23:26:46.263044 22039 tablet.cc:1152] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.263061 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.263067 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.263074 22039 tablet.cc:1154] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.263097 22039 tablet.cc:1443] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284691140608 or (T in {6272062284691140608})}] I0710 23:26:46.263708 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) WARNING: Logging before InitGoogleLogging() is written to STDERR W0710 23:26:46.269829 22413 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0710 23:26:46.270030 22413 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0710 23:26:46.270898 22413 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0710 23:26:46.270944 22413 flags.cc:406] Enabled experimental flag: --flush_threshold_mb=1 W0710 23:26:46.270957 22413 flags.cc:406] Enabled experimental flag: --flush_threshold_secs=1 W0710 23:26:46.270973 22413 flags.cc:406] Enabled experimental flag: --crash_on_eio=false W0710 23:26:46.270993 22413 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.18.43.2 I0710 23:26:46.272462 22413 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1 --fs_wal_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.18.43.2:45917 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/info.pb --webserver_interface=127.18.43.2 --webserver_port=46731 --flush_threshold_mb=1 --flush_threshold_secs=1 --tserver_master_addrs=127.18.43.62:34207 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.18.43.2 --log_dir=/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.8.0-SNAPSHOT revision 025067de3b780c42022b7a08ed16eb82cdb574dc build type DEBUG built by None at 10 Jul 2018 23:14:03 UTC on jenkins-slave-8qw8 build id 14092 I0710 23:26:46.275949 22413 tablet_server_main.cc:85] Initializing tablet server... I0710 23:26:46.276257 22039 tablet.cc:1528] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.276381 22039 tablet.cc:1583] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.276407 22039 tablet.cc:1585] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284691140608 or (T in {6272062284691140608})}] I0710 23:26:46.276757 22413 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 197516us I0710 23:26:46.277328 22413 fs_manager.cc:261] Metadata directory not provided I0710 23:26:46.277382 22413 fs_manager.cc:267] Using write-ahead log directory (fs_wal_dir) as metadata directory I0710 23:26:46.280236 22039 tablet.cc:1633] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Flush successful on 1065 rows (31847 bytes) I0710 23:26:46.280571 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(2ec5b22f7bc141d2b4fbfc3b12bb7207) complete. Timing: real 0.018s user 0.017s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":105,"data dirs.run_cpu_time_us":167,"data dirs.run_wall_time_us":829,"lbm_read_time_us":38,"lbm_reads_lt_1ms":4,"lbm_write_time_us":360,"lbm_writes_lt_1ms":23} I0710 23:26:46.281082 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(2ec5b22f7bc141d2b4fbfc3b12bb7207): 10351 bytes on disk I0710 23:26:46.281478 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(2ec5b22f7bc141d2b4fbfc3b12bb7207) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":58,"lbm_reads_lt_1ms":4} I0710 23:26:46.281646 22413 fs_manager.cc:397] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s I0710 23:26:46.281817 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(45da44391d8a42a780127f45b9ec59e6): perf score=0.000396 I0710 23:26:46.281985 22413 env_posix.cc:1674] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0710 23:26:46.282095 22039 tablet.cc:1152] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.282115 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.282121 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.282130 22039 tablet.cc:1154] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.282148 22039 tablet.cc:1443] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284707659776 or (T in {6272062284707659776})}] I0710 23:26:46.282248 22413 file_cache.cc:470] Constructed file cache lbm with capacity 419430 I0710 23:26:46.282702 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.285141 22413 fs_manager.cc:417] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s I0710 23:26:46.285708 22413 fs_manager.cc:434] Opened local filesystem: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1,/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal uuid: "6ec7d1737cd1460ab9dd752e64eac912" format_stamp: "Formatted at 2018-07-10 23:26:43 on dist-test-slave-dist-test-slave-4h7p" I0710 23:26:46.285815 22413 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal 2 data directories: /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/data, /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0710 23:26:46.293707 22039 tablet.cc:1528] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.293851 22039 tablet.cc:1583] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.293880 22039 tablet.cc:1585] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284707659776 or (T in {6272062284707659776})}] I0710 23:26:46.297605 22039 tablet.cc:1633] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Flush successful on 995 rows (30134 bytes) I0710 23:26:46.297950 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(45da44391d8a42a780127f45b9ec59e6) complete. Timing: real 0.016s user 0.015s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":84,"data dirs.run_cpu_time_us":191,"data dirs.run_wall_time_us":864,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":380,"lbm_writes_lt_1ms":23} I0710 23:26:46.298548 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(8facaf1b4c2e4745baf379f06a8773c8): 10104 bytes on disk I0710 23:26:46.299000 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(8facaf1b4c2e4745baf379f06a8773c8) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":48,"lbm_reads_lt_1ms":4} I0710 23:26:46.299345 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(45da44391d8a42a780127f45b9ec59e6): 9710 bytes on disk I0710 23:26:46.299739 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(45da44391d8a42a780127f45b9ec59e6) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":71,"lbm_reads_lt_1ms":4} I0710 23:26:46.300057 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(e84b278749d54e9b9978065912c42363): perf score=0.000401 I0710 23:26:46.300369 22039 tablet.cc:1152] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:46.300388 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:46.300393 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:46.300398 22039 tablet.cc:1154] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 127255 bytes I0710 23:26:46.300416 22039 tablet.cc:1443] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284711501824 or (T in {6272062284711501824})}] I0710 23:26:46.301017 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:46.302894 22413 env_posix.cc:1674] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0710 23:26:46.304069 22413 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0710 23:26:46.304203 22413 tablet_server_main.cc:90] Starting tablet server... I0710 23:26:46.309983 22413 rpc_server.cc:205] RPC server started. Bound to: 127.18.43.2:45917 I0710 23:26:46.310314 22413 webserver.cc:175] Starting webserver on 127.18.43.2:46731 I0710 23:26:46.310330 22413 webserver.cc:186] Document root disabled I0710 23:26:46.310721 22413 webserver.cc:313] Webserver started. Bound to: http://127.18.43.2:46731/ I0710 23:26:46.311307 22413 server_base.cc:607] Dumped server information to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-0/info.pb I0710 23:26:46.311739 22413 tablet_server_main.cc:93] Tablet server successfully started. I0710 23:26:46.312752 22039 tablet.cc:1528] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:46.312913 22039 tablet.cc:1583] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:46.312943 22039 tablet.cc:1585] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284711501824 or (T in {6272062284711501824})}] I0710 23:26:46.313973 18604 external_mini_cluster.cc:871] Started /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver as pid 22413 I0710 23:26:46.317056 22540 tablet_copy_client_session-itest.cc:378] Copying over tablet 4 / 10 I0710 23:26:46.317137 22538 tablet_copy_client_session-itest.cc:378] Copying over tablet 2 / 10 I0710 23:26:46.317287 22539 tablet_copy_client_session-itest.cc:378] Copying over tablet 3 / 10 I0710 23:26:46.318028 22541 tablet_copy_client_session-itest.cc:378] Copying over tablet 5 / 10 I0710 23:26:46.318256 22542 tablet_copy_client_session-itest.cc:378] Copying over tablet 6 / 10 I0710 23:26:46.318451 22543 tablet_copy_client_session-itest.cc:378] Copying over tablet 7 / 10 I0710 23:26:46.318461 22039 tablet.cc:1633] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Flush successful on 997 rows (30163 bytes) I0710 23:26:46.318619 22544 tablet_copy_client_session-itest.cc:378] Copying over tablet 8 / 10 I0710 23:26:46.318742 22545 tablet_copy_client_session-itest.cc:378] Copying over tablet 9 / 10 I0710 23:26:46.318857 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(e84b278749d54e9b9978065912c42363) complete. Timing: real 0.019s user 0.010s sys 0.007s Metrics: {"cfile_init":1,"data dirs.queue_time_us":59,"data dirs.run_cpu_time_us":220,"data dirs.run_wall_time_us":1546,"lbm_read_time_us":31,"lbm_reads_lt_1ms":4,"lbm_write_time_us":429,"lbm_writes_lt_1ms":23} I0710 23:26:46.319454 22537 tablet_copy_client_session-itest.cc:378] Copying over tablet 1 / 10 I0710 23:26:46.319447 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(e84b278749d54e9b9978065912c42363): 9765 bytes on disk I0710 23:26:46.319969 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(e84b278749d54e9b9978065912c42363) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":69,"lbm_reads_lt_1ms":4} I0710 23:26:46.320328 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(628f1e270e1948d2b555b1827254d4ab): 8910 bytes on disk I0710 23:26:46.320662 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(628f1e270e1948d2b555b1827254d4ab) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4} I0710 23:26:46.321300 22533 heartbeater.cc:346] Connected to a master server at 127.18.43.62:34207 I0710 23:26:46.321457 22533 heartbeater.cc:426] Registering TS with master... I0710 23:26:46.321892 22533 heartbeater.cc:475] Master 127.18.43.62:34207 requested a full tablet report, sending... I0710 23:26:46.322873 22304 ts_manager.cc:98] Registered new tserver with Master: 6ec7d1737cd1460ab9dd752e64eac912 (127.18.43.2:45917) I0710 23:26:46.323971 22304 master_service.cc:249] Signed X509 certificate for tserver {username='slave'} at 127.18.43.2:44613 I0710 23:26:46.324867 22547 ts_tablet_manager.cc:669] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.325104 22547 tablet_copy_client.cc:239] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.325321 22553 ts_tablet_manager.cc:669] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.325376 22549 ts_tablet_manager.cc:669] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.325393 22553 tablet_copy_client.cc:239] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.325413 22549 tablet_copy_client.cc:239] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.325534 22554 ts_tablet_manager.cc:669] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.325543 22552 ts_tablet_manager.cc:669] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.325582 22554 tablet_copy_client.cc:239] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.325582 22552 tablet_copy_client.cc:239] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.325683 22555 ts_tablet_manager.cc:669] T e076cfa4d8674332aef98dec88fd570e P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.325721 22555 tablet_copy_client.cc:239] T e076cfa4d8674332aef98dec88fd570e P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.325893 22550 ts_tablet_manager.cc:669] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.325960 22550 tablet_copy_client.cc:239] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.326114 22551 ts_tablet_manager.cc:669] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.326174 22551 tablet_copy_client.cc:239] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.325330 22548 ts_tablet_manager.cc:669] T 782cbc85002b4ef594bdd8a41b62d57e P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.326292 22548 tablet_copy_client.cc:239] T 782cbc85002b4ef594bdd8a41b62d57e P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.329464 22121 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet 8facaf1b4c2e4745baf379f06a8773c8 from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.329495 22120 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet f5d922d9e6fb45bd9d98acf118e6d9e8 from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.329545 22119 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet 7dcd98b4c6f0472cbd570a3408ab1aa1 from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.329563 22121 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet 8facaf1b4c2e4745baf379f06a8773c8 from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-8facaf1b4c2e4745baf379f06a8773c8 I0710 23:26:46.329646 22117 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet 18aa52f6e09947709e0b183c6d7d21d3 from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.329797 22118 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet e84b278749d54e9b9978065912c42363 from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.329800 22115 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet 2ec5b22f7bc141d2b4fbfc3b12bb7207 from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.329857 22118 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet e84b278749d54e9b9978065912c42363 from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-e84b278749d54e9b9978065912c42363 I0710 23:26:46.329939 22119 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet 7dcd98b4c6f0472cbd570a3408ab1aa1 from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-7dcd98b4c6f0472cbd570a3408ab1aa1 I0710 23:26:46.330715 22120 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet f5d922d9e6fb45bd9d98acf118e6d9e8 from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-f5d922d9e6fb45bd9d98acf118e6d9e8 I0710 23:26:46.330833 22115 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet 2ec5b22f7bc141d2b4fbfc3b12bb7207 from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-2ec5b22f7bc141d2b4fbfc3b12bb7207 I0710 23:26:46.331009 22119 tablet_copy_source_session.cc:202] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.331081 22118 tablet_copy_source_session.cc:202] T e84b278749d54e9b9978065912c42363 P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.331495 22116 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet e076cfa4d8674332aef98dec88fd570e from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.331502 22120 tablet_copy_source_session.cc:202] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.331547 22115 tablet_copy_source_session.cc:202] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.331557 22117 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet 18aa52f6e09947709e0b183c6d7d21d3 from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-18aa52f6e09947709e0b183c6d7d21d3 I0710 23:26:46.331640 22116 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet e076cfa4d8674332aef98dec88fd570e from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-e076cfa4d8674332aef98dec88fd570e I0710 23:26:46.331660 22113 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet 782cbc85002b4ef594bdd8a41b62d57e from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.331696 22113 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet 782cbc85002b4ef594bdd8a41b62d57e from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-782cbc85002b4ef594bdd8a41b62d57e I0710 23:26:46.332350 22113 tablet_copy_source_session.cc:202] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.332392 22116 tablet_copy_source_session.cc:202] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.332507 22114 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet 45da44391d8a42a780127f45b9ec59e6 from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.332569 22114 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet 45da44391d8a42a780127f45b9ec59e6 from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-45da44391d8a42a780127f45b9ec59e6 I0710 23:26:46.332973 22121 tablet_copy_source_session.cc:202] T 8facaf1b4c2e4745baf379f06a8773c8 P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.333492 22117 tablet_copy_source_session.cc:202] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.333533 22114 tablet_copy_source_session.cc:202] T 45da44391d8a42a780127f45b9ec59e6 P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.334944 22554 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 18aa52f6e09947709e0b183c6d7d21d3. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.335256 22553 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet f5d922d9e6fb45bd9d98acf118e6d9e8. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.335419 22550 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 2ec5b22f7bc141d2b4fbfc3b12bb7207. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.335569 22555 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet e076cfa4d8674332aef98dec88fd570e. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.335988 22552 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet e84b278749d54e9b9978065912c42363. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.336143 22548 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 782cbc85002b4ef594bdd8a41b62d57e. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.336347 22551 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 45da44391d8a42a780127f45b9ec59e6. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.336563 22547 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 8facaf1b4c2e4745baf379f06a8773c8. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.336880 22549 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 7dcd98b4c6f0472cbd570a3408ab1aa1. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.341729 22547 ts_tablet_manager.cc:1173] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.341850 22552 ts_tablet_manager.cc:1173] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.342339 22547 tablet_copy_client.cc:566] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... I0710 23:26:46.342849 22554 ts_tablet_manager.cc:1173] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.342875 22552 tablet_copy_client.cc:566] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... I0710 23:26:46.343312 22550 ts_tablet_manager.cc:1173] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.343713 22551 ts_tablet_manager.cc:1173] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.343909 22550 tablet_copy_client.cc:566] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... I0710 23:26:46.345644 22553 ts_tablet_manager.cc:1173] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.345803 22551 tablet_copy_client.cc:566] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... I0710 23:26:46.346943 22549 ts_tablet_manager.cc:1173] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.347692 22548 ts_tablet_manager.cc:1173] T 782cbc85002b4ef594bdd8a41b62d57e P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.347795 22548 tablet_copy_client.cc:566] T 782cbc85002b4ef594bdd8a41b62d57e P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... I0710 23:26:46.348214 22555 ts_tablet_manager.cc:1173] T e076cfa4d8674332aef98dec88fd570e P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.348476 22549 tablet_copy_client.cc:566] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... I0710 23:26:46.348597 18604 tablet_copy_client_session-itest.cc:398] Injecting failures to /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1 I0710 23:26:46.348634 22555 tablet_copy_client.cc:566] T e076cfa4d8674332aef98dec88fd570e P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... I0710 23:26:46.348743 22554 tablet_copy_client.cc:566] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... I0710 23:26:46.349225 22553 tablet_copy_client.cc:566] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... W0710 23:26:46.349769 22530 generic_service.cc:126] {username='slave'} at 127.0.0.1:53282 forcing change of non-runtime-safe flag env_inject_eio_globs I0710 23:26:46.349828 22530 generic_service.cc:146] {username='slave'} at 127.0.0.1:53282 changed flags via RPC: env_inject_eio_globs from '*' to '/tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/**' I0710 23:26:46.350361 18604 tablet_copy_client_session-itest.cc:378] Copying over tablet 10 / 10 I0710 23:26:46.351701 22556 ts_tablet_manager.cc:669] T 628f1e270e1948d2b555b1827254d4ab P 6ec7d1737cd1460ab9dd752e64eac912: Initiating tablet copy from peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577) I0710 23:26:46.352802 22556 tablet_copy_client.cc:239] T 628f1e270e1948d2b555b1827254d4ab P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Beginning tablet copy session from remote peer at address 127.18.43.1:45577 I0710 23:26:46.353381 22121 tablet_copy_service.cc:135] P 3576d2baa86141439f2e837433589a9b: Received BeginTabletCopySession request for tablet 628f1e270e1948d2b555b1827254d4ab from peer 6ec7d1737cd1460ab9dd752e64eac912 ({username='slave'} at 127.18.43.2:47165) I0710 23:26:46.353444 22121 tablet_copy_service.cc:156] P 3576d2baa86141439f2e837433589a9b: Beginning new tablet copy session on tablet 628f1e270e1948d2b555b1827254d4ab from peer 6ec7d1737cd1460ab9dd752e64eac912 at {username='slave'} at 127.18.43.2:47165: session id = 6ec7d1737cd1460ab9dd752e64eac912-628f1e270e1948d2b555b1827254d4ab I0710 23:26:46.354310 22121 tablet_copy_source_session.cc:202] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Tablet Copy: opened 5 blocks and 1 log segments I0710 23:26:46.354581 22552 tablet_copy_client.cc:529] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 1 WAL segments... I0710 23:26:46.354708 22550 tablet_copy_client.cc:529] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 1 WAL segments... I0710 23:26:46.355173 22551 tablet_copy_client.cc:529] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 1 WAL segments... I0710 23:26:46.357569 22556 data_dirs.cc:934] Could only allocate 2 dirs of requested 3 for tablet 628f1e270e1948d2b555b1827254d4ab. 2 dirs total, 0 dirs full, 0 dirs failed I0710 23:26:46.357852 22552 tablet_copy_client.cc:405] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:46.358736 22554 tablet_copy_client.cc:529] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 1 WAL segments... I0710 23:26:46.359490 22556 ts_tablet_manager.cc:1173] T 628f1e270e1948d2b555b1827254d4ab P 6ec7d1737cd1460ab9dd752e64eac912: Registered tablet (data state: TABLET_DATA_COPYING) I0710 23:26:46.360095 22551 tablet_copy_client.cc:405] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0710 23:26:46.360142 22550 tablet_copy_client.cc:405] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Tablet Copy complete. Replacing tablet superblock. W0710 23:26:46.360455 22530 generic_service.cc:126] {username='slave'} at 127.0.0.1:53282 forcing change of non-runtime-safe flag env_inject_eio I0710 23:26:46.360499 22530 generic_service.cc:146] {username='slave'} at 127.0.0.1:53282 changed flags via RPC: env_inject_eio from '0' to '1' W0710 23:26:46.360577 22551 fault_injection.cc:41] FAULT INJECTION ENABLED! W0710 23:26:46.360595 22551 fault_injection.cc:42] THIS SERVER MAY CRASH! E0710 23:26:46.361364 22554 env_posix.cc:316] I/O error, context: INJECTED FAILURE I0710 23:26:46.361718 22550 ts_tablet_manager.cc:1028] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: Bootstrapping tablet I0710 23:26:46.361740 22551 ts_tablet_manager.cc:1028] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: Bootstrapping tablet E0710 23:26:46.361862 22554 data_dirs.cc:1116] Directory /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data marked as failed I0710 23:26:46.361968 22554 ts_tablet_manager.cc:1437] Data dir 49b8d5daed9c488ba0ff634de5d5460e has 9 tablets I0710 23:26:46.361969 22550 tablet_bootstrap.cc:427] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: Bootstrap starting. I0710 23:26:46.362120 22552 ts_tablet_manager.cc:1028] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: Bootstrapping tablet I0710 23:26:46.362195 22552 tablet_bootstrap.cc:427] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: Bootstrap starting. W0710 23:26:46.362259 22553 ts_tablet_manager.cc:739] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 6ec7d1737cd1460ab9dd752e64eac912: Tablet Copy: Unable to fetch data from remote peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577): IO error: Unable to download block with id 0000000000000017: Not downloading block for replica: Tablet f5d922d9e6fb45bd9d98acf118e6d9e8 is in a failed directory E0710 23:26:46.362351 22552 ts_tablet_manager.cc:1066] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: Tablet failed to bootstrap: IO error: some tablet data is in a failed directory I0710 23:26:46.362387 22552 ts_tablet_manager.cc:1045] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: Time spent bootstrapping tablet: real 0.000s user 0.000s sys 0.000s I0710 23:26:46.362457 22552 tablet_replica.cc:261] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: stopping tablet replica W0710 23:26:46.362478 22555 ts_tablet_manager.cc:739] T e076cfa4d8674332aef98dec88fd570e P 6ec7d1737cd1460ab9dd752e64eac912: Tablet Copy: Unable to fetch data from remote peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577): IO error: Unable to download block with id 0000000000000023: Not downloading block for replica: Tablet e076cfa4d8674332aef98dec88fd570e is in a failed directory I0710 23:26:46.362560 22552 raft_consensus.cc:2042] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:46.362630 22552 raft_consensus.cc:2069] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus is shut down! W0710 23:26:46.362642 22548 ts_tablet_manager.cc:739] T 782cbc85002b4ef594bdd8a41b62d57e P 6ec7d1737cd1460ab9dd752e64eac912: Tablet Copy: Unable to fetch data from remote peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577): IO error: Unable to download block with id 0000000000000030: Not downloading block for replica: Tablet 782cbc85002b4ef594bdd8a41b62d57e is in a failed directory I0710 23:26:46.362715 22556 tablet_copy_client.cc:566] T 628f1e270e1948d2b555b1827254d4ab P 6ec7d1737cd1460ab9dd752e64eac912: tablet copy: Starting download of 5 data blocks... W0710 23:26:46.362800 22556 ts_tablet_manager.cc:739] T 628f1e270e1948d2b555b1827254d4ab P 6ec7d1737cd1460ab9dd752e64eac912: Tablet Copy: Unable to fetch data from remote peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577): IO error: Unable to download block with id 0000000000000008: Not downloading block for replica: Tablet 628f1e270e1948d2b555b1827254d4ab is in a failed directory E0710 23:26:46.362972 22549 env_posix.cc:316] I/O error, context: INJECTED FAILURE I0710 23:26:46.362998 22117 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-f5d922d9e6fb45bd9d98acf118e6d9e8 received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.363028 22117 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-f5d922d9e6fb45bd9d98acf118e6d9e8 on tablet f5d922d9e6fb45bd9d98acf118e6d9e8 with peer 6ec7d1737cd1460ab9dd752e64eac912 I0710 23:26:46.363481 22117 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-e076cfa4d8674332aef98dec88fd570e received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.363507 22117 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-e076cfa4d8674332aef98dec88fd570e on tablet e076cfa4d8674332aef98dec88fd570e with peer 6ec7d1737cd1460ab9dd752e64eac912 I0710 23:26:46.363672 22114 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-782cbc85002b4ef594bdd8a41b62d57e received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.363693 22114 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-782cbc85002b4ef594bdd8a41b62d57e on tablet 782cbc85002b4ef594bdd8a41b62d57e with peer 6ec7d1737cd1460ab9dd752e64eac912 I0710 23:26:46.363793 22121 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-e84b278749d54e9b9978065912c42363 received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.363819 22121 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-e84b278749d54e9b9978065912c42363 on tablet e84b278749d54e9b9978065912c42363 with peer 6ec7d1737cd1460ab9dd752e64eac912 I0710 23:26:46.363948 22118 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-628f1e270e1948d2b555b1827254d4ab received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.363965 22118 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-628f1e270e1948d2b555b1827254d4ab on tablet 628f1e270e1948d2b555b1827254d4ab with peer 6ec7d1737cd1460ab9dd752e64eac912 W0710 23:26:46.364043 22553 tablet_metadata.cc:421] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet f5d922d9e6fb45bd9d98acf118e6d9e8 but one is already registered I0710 23:26:46.364122 22553 ts_tablet_manager.cc:1369] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 6ec7d1737cd1460ab9dd752e64eac912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED W0710 23:26:46.364389 22548 tablet_metadata.cc:421] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 782cbc85002b4ef594bdd8a41b62d57e but one is already registered I0710 23:26:46.364446 22548 ts_tablet_manager.cc:1369] T 782cbc85002b4ef594bdd8a41b62d57e P 6ec7d1737cd1460ab9dd752e64eac912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED W0710 23:26:46.364480 22555 tablet_metadata.cc:421] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet e076cfa4d8674332aef98dec88fd570e but one is already registered I0710 23:26:46.364539 22555 ts_tablet_manager.cc:1369] T e076cfa4d8674332aef98dec88fd570e P 6ec7d1737cd1460ab9dd752e64eac912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED E0710 23:26:46.362264 22547 env_posix.cc:316] I/O error, context: INJECTED FAILURE I0710 23:26:46.361970 22551 tablet_bootstrap.cc:427] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: Bootstrap starting. E0710 23:26:46.365355 22551 ts_tablet_manager.cc:1066] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: Tablet failed to bootstrap: IO error: some tablet data is in a failed directory I0710 23:26:46.365387 22551 ts_tablet_manager.cc:1045] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.000s I0710 23:26:46.365411 22551 tablet_replica.cc:261] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: stopping tablet replica I0710 23:26:46.365445 22551 raft_consensus.cc:2042] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:46.365475 22551 raft_consensus.cc:2069] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus is shut down! W0710 23:26:46.365626 22556 tablet_metadata.cc:421] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 628f1e270e1948d2b555b1827254d4ab but one is already registered I0710 23:26:46.365715 22556 ts_tablet_manager.cc:1369] T 628f1e270e1948d2b555b1827254d4ab P 6ec7d1737cd1460ab9dd752e64eac912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0710 23:26:46.366072 22118 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-45da44391d8a42a780127f45b9ec59e6 received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.366106 22118 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-45da44391d8a42a780127f45b9ec59e6 on tablet 45da44391d8a42a780127f45b9ec59e6 with peer 6ec7d1737cd1460ab9dd752e64eac912 I0710 23:26:46.367002 22555 ts_tablet_manager.cc:1382] T e076cfa4d8674332aef98dec88fd570e P 6ec7d1737cd1460ab9dd752e64eac912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0 I0710 23:26:46.367055 22548 ts_tablet_manager.cc:1382] T 782cbc85002b4ef594bdd8a41b62d57e P 6ec7d1737cd1460ab9dd752e64eac912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0 I0710 23:26:46.367055 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 E0710 23:26:46.367521 22550 ts_tablet_manager.cc:1066] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: Tablet failed to bootstrap: IO error: some tablet data is in a failed directory I0710 23:26:46.367558 22550 ts_tablet_manager.cc:1045] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.001s I0710 23:26:46.367585 22550 tablet_replica.cc:261] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: stopping tablet replica I0710 23:26:46.367645 22550 raft_consensus.cc:2042] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:46.367674 22550 raft_consensus.cc:2069] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:46.367964 22554 ts_tablet_manager.cc:1444] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: failing tablet E0710 23:26:46.368118 22555 env_posix.cc:316] I/O error, context: INJECTED FAILURE E0710 23:26:46.368453 22548 env_posix.cc:316] I/O error, context: INJECTED FAILURE I0710 23:26:46.368523 22554 ts_tablet_manager.cc:1444] T 2ec5b22f7bc141d2b4fbfc3b12bb7207 P 6ec7d1737cd1460ab9dd752e64eac912: failing tablet I0710 23:26:46.368650 22554 ts_tablet_manager.cc:1444] T 45da44391d8a42a780127f45b9ec59e6 P 6ec7d1737cd1460ab9dd752e64eac912: failing tablet I0710 23:26:46.368690 22554 ts_tablet_manager.cc:1444] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: failing tablet I0710 23:26:46.368710 22554 ts_tablet_manager.cc:1444] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: failing tablet I0710 23:26:46.368727 22554 ts_tablet_manager.cc:1444] T e84b278749d54e9b9978065912c42363 P 6ec7d1737cd1460ab9dd752e64eac912: failing tablet I0710 23:26:46.368772 22118 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-2ec5b22f7bc141d2b4fbfc3b12bb7207 received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.368803 22118 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-2ec5b22f7bc141d2b4fbfc3b12bb7207 on tablet 2ec5b22f7bc141d2b4fbfc3b12bb7207 with peer 6ec7d1737cd1460ab9dd752e64eac912 W0710 23:26:46.368808 22549 ts_tablet_manager.cc:1431] Data directory is already marked failed. E0710 23:26:46.368911 22549 env_posix.cc:316] I/O error, context: INJECTED FAILURE W0710 23:26:46.368933 22549 ts_tablet_manager.cc:1431] Data directory is already marked failed. W0710 23:26:46.368958 22549 log_block_manager.cc:1151] Container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/d2972245262f479d8427e89054485017 being marked read-only: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.368971 22549 log_block_manager.cc:1370] Failed to abort block 0000000000000034: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.368984 22549 ts_tablet_manager.cc:739] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: Tablet Copy: Unable to fetch data from remote peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577): IO error: Unable to download block with id 0000000000000003: Unable to download block 0000000000000003: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369292 22547 ts_tablet_manager.cc:1431] Data directory is already marked failed. I0710 23:26:46.369287 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:46.369428 22118 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-7dcd98b4c6f0472cbd570a3408ab1aa1 received from {username='slave'} at 127.18.43.2:47165 E0710 23:26:46.369432 22547 env_posix.cc:316] I/O error, context: INJECTED FAILURE I0710 23:26:46.369459 22118 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-7dcd98b4c6f0472cbd570a3408ab1aa1 on tablet 7dcd98b4c6f0472cbd570a3408ab1aa1 with peer 6ec7d1737cd1460ab9dd752e64eac912 W0710 23:26:46.369467 22547 ts_tablet_manager.cc:1431] Data directory is already marked failed. W0710 23:26:46.369487 22547 log_block_manager.cc:1151] Container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/07c0916ebe6b4e3da1ccd83718d4d396 being marked read-only: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369500 22547 log_block_manager.cc:1370] Failed to abort block 0000000000000035: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369514 22547 ts_tablet_manager.cc:739] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: Tablet Copy: Unable to fetch data from remote peer 3576d2baa86141439f2e837433589a9b (127.18.43.1:45577): IO error: Unable to download block with id 0000000000000041: Unable to download block 0000000000000041: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369601 22555 ts_tablet_manager.cc:1431] Data directory is already marked failed. W0710 23:26:46.369626 22555 log_block_manager.cc:1151] Container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/b6fc9f84343542e1a5818c8536704651 being marked read-only: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369640 22555 log_block_manager.cc:1370] Failed to abort block 0000000000000025: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369659 22555 log_block_manager.cc:1370] Failed to abort block 0000000000000031: IO error: container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/b6fc9f84343542e1a5818c8536704651 is read-only: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) I0710 23:26:46.369706 22553 ts_tablet_manager.cc:1382] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 6ec7d1737cd1460ab9dd752e64eac912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0 E0710 23:26:46.369843 22553 env_posix.cc:316] I/O error, context: INJECTED FAILURE W0710 23:26:46.369894 22553 ts_tablet_manager.cc:1431] Data directory is already marked failed. W0710 23:26:46.369915 22553 log_block_manager.cc:1151] Container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/405ce21a2cd34e08be7c629995c76c53 being marked read-only: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369925 22548 ts_tablet_manager.cc:1431] Data directory is already marked failed. W0710 23:26:46.369931 22553 log_block_manager.cc:1370] Failed to abort block 0000000000000021: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369962 22548 log_block_manager.cc:1151] Container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/07c0916ebe6b4e3da1ccd83718d4d396 being marked read-only: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369973 22553 log_block_manager.cc:1370] Failed to abort block 0000000000000027: IO error: container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/d2972245262f479d8427e89054485017 is read-only: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.369994 22554 log_block_manager.cc:1151] Container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/a04d5aff929d440a96305afb50bad5aa being marked read-only: IO error: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.370013 22554 ts_tablet_manager.cc:750] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: Tablet Copy: Failure calling Finish(): IO error: INJECTED FAILURE: Input/output error (error 5) I0710 23:26:46.370344 22118 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-8facaf1b4c2e4745baf379f06a8773c8 received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.370379 22118 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-8facaf1b4c2e4745baf379f06a8773c8 on tablet 8facaf1b4c2e4745baf379f06a8773c8 with peer 6ec7d1737cd1460ab9dd752e64eac912 W0710 23:26:46.369978 22548 log_block_manager.cc:1370] Failed to abort block 0000000000000019: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) I0710 23:26:46.370514 22121 tablet_copy_service.cc:325] P 3576d2baa86141439f2e837433589a9b: Request end of tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-18aa52f6e09947709e0b183c6d7d21d3 received from {username='slave'} at 127.18.43.2:47165 I0710 23:26:46.370542 22121 tablet_copy_service.cc:413] P 3576d2baa86141439f2e837433589a9b: ending tablet copy session 6ec7d1737cd1460ab9dd752e64eac912-18aa52f6e09947709e0b183c6d7d21d3 on tablet 18aa52f6e09947709e0b183c6d7d21d3 with peer 6ec7d1737cd1460ab9dd752e64eac912 W0710 23:26:46.370580 22549 tablet_metadata.cc:421] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 7dcd98b4c6f0472cbd570a3408ab1aa1 but one is already registered I0710 23:26:46.370734 22549 ts_tablet_manager.cc:1369] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0710 23:26:46.370766 22556 ts_tablet_manager.cc:1382] T 628f1e270e1948d2b555b1827254d4ab P 6ec7d1737cd1460ab9dd752e64eac912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0 W0710 23:26:46.371325 22547 tablet_metadata.cc:421] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 8facaf1b4c2e4745baf379f06a8773c8 but one is already registered I0710 23:26:46.371383 22547 ts_tablet_manager.cc:1369] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED W0710 23:26:46.371906 22554 tablet_metadata.cc:421] failed to load DataDirGroup from superblock: Already present: tried to load directory group for tablet 18aa52f6e09947709e0b183c6d7d21d3 but one is already registered I0710 23:26:46.371965 22554 ts_tablet_manager.cc:1369] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0710 23:26:46.372463 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:46.373224 22547 ts_tablet_manager.cc:1382] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0 W0710 23:26:46.373328 22547 log_block_manager.cc:1370] Failed to abort block 0000000000000003: IO error: container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/b6fc9f84343542e1a5818c8536704651 is read-only: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.373575 22547 log_block_manager.cc:1370] Failed to abort block 0000000000000016: IO error: container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/b6fc9f84343542e1a5818c8536704651 is read-only: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.373610 22547 log_block_manager.cc:1370] Failed to abort block 0000000000000030: IO error: container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/07c0916ebe6b4e3da1ccd83718d4d396 is read-only: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) I0710 23:26:46.373983 22554 ts_tablet_manager.cc:1382] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0 I0710 23:26:46.374030 22554 log.cc:986] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: Deleting WAL directory at /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/wal/wals/18aa52f6e09947709e0b183c6d7d21d3 W0710 23:26:46.374368 22554 log_block_manager.cc:1370] Failed to abort block 0000000000000017: IO error: container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/a04d5aff929d440a96305afb50bad5aa is read-only: INJECTED FAILURE: Input/output error (error 5) I0710 23:26:46.374785 22549 ts_tablet_manager.cc:1382] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.0 E0710 23:26:46.374887 22549 env_posix.cc:316] I/O error, context: INJECTED FAILURE W0710 23:26:46.374927 22549 ts_tablet_manager.cc:1431] Data directory is already marked failed. W0710 23:26:46.374948 22549 log_block_manager.cc:1151] Container /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604/minicluster-data/ts-1/data-1/data/035e8032433a4fbcbb1115be2940122b being marked read-only: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) W0710 23:26:46.374956 22549 log_block_manager.cc:1370] Failed to abort block 0000000000000013: IO error: unable to append block's metadata during close: Failed to append data to file: INJECTED FAILURE: Input/output error (error 5) I0710 23:26:46.377562 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:46.379056 22558 tablet_replica.cc:261] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912: stopping tablet replica I0710 23:26:46.379120 22558 raft_consensus.cc:2042] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:46.379155 22558 raft_consensus.cc:2069] T 18aa52f6e09947709e0b183c6d7d21d3 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:46.379191 22559 tablet_replica.cc:261] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912: stopping tablet replica I0710 23:26:46.379238 22559 raft_consensus.cc:2042] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:46.379250 22558 tablet_replica.cc:261] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912: stopping tablet replica I0710 23:26:46.379266 22558 raft_consensus.cc:2042] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus shutting down. I0710 23:26:46.379266 22559 raft_consensus.cc:2069] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:46.379292 22558 raft_consensus.cc:2069] T 8facaf1b4c2e4745baf379f06a8773c8 P 6ec7d1737cd1460ab9dd752e64eac912 [term 1 NON_PARTICIPANT]: Raft consensus is shut down! I0710 23:26:46.386924 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:46.404363 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:46.437741 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:46.503129 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:46.632553 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:46.889931 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 2 / 10 I0710 23:26:47.323191 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(7dcd98b4c6f0472cbd570a3408ab1aa1): perf score=0.000344 I0710 23:26:47.323765 22039 tablet.cc:1152] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:47.323792 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:47.323801 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:47.323809 22039 tablet.cc:1154] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 15703 bytes I0710 23:26:47.323833 22039 tablet.cc:1443] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284694081536 or (T in {6272062284694081536})}] I0710 23:26:47.324503 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.325879 22533 heartbeater.cc:467] Master 127.18.43.62:34207 was elected leader, sending a full tablet report... W0710 23:26:47.327833 22304 catalog_manager.cc:3748] Tablet 8facaf1b4c2e4745baf379f06a8773c8 (table test-workload [id=5deb6e4963944526be7b024288f92eef]) has failed on TS 6ec7d1737cd1460ab9dd752e64eac912 (127.18.43.2:45917): IO error: failing tablet W0710 23:26:47.327878 22304 catalog_manager.cc:3748] Tablet e84b278749d54e9b9978065912c42363 (table test-workload [id=5deb6e4963944526be7b024288f92eef]) has failed on TS 6ec7d1737cd1460ab9dd752e64eac912 (127.18.43.2:45917): IO error: failing tablet W0710 23:26:47.327924 22304 catalog_manager.cc:3748] Tablet 18aa52f6e09947709e0b183c6d7d21d3 (table test-workload [id=5deb6e4963944526be7b024288f92eef]) has failed on TS 6ec7d1737cd1460ab9dd752e64eac912 (127.18.43.2:45917): IO error: failing tablet W0710 23:26:47.327947 22304 catalog_manager.cc:3748] Tablet 7dcd98b4c6f0472cbd570a3408ab1aa1 (table test-workload [id=5deb6e4963944526be7b024288f92eef]) has failed on TS 6ec7d1737cd1460ab9dd752e64eac912 (127.18.43.2:45917): IO error: failing tablet W0710 23:26:47.327968 22304 catalog_manager.cc:3748] Tablet 2ec5b22f7bc141d2b4fbfc3b12bb7207 (table test-workload [id=5deb6e4963944526be7b024288f92eef]) has failed on TS 6ec7d1737cd1460ab9dd752e64eac912 (127.18.43.2:45917): IO error: failing tablet W0710 23:26:47.328011 22304 catalog_manager.cc:3748] Tablet 45da44391d8a42a780127f45b9ec59e6 (table test-workload [id=5deb6e4963944526be7b024288f92eef]) has failed on TS 6ec7d1737cd1460ab9dd752e64eac912 (127.18.43.2:45917): IO error: failing tablet I0710 23:26:47.328652 22039 tablet.cc:1528] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.328805 22039 tablet.cc:1583] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.328836 22039 tablet.cc:1585] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284694081536 or (T in {6272062284694081536})}] I0710 23:26:47.331254 22039 tablet.cc:1633] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Flush successful on 112 rows (7531 bytes) I0710 23:26:47.331509 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(7dcd98b4c6f0472cbd570a3408ab1aa1) complete. Timing: real 0.008s user 0.007s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":200,"data dirs.run_cpu_time_us":198,"data dirs.run_wall_time_us":976,"lbm_read_time_us":35,"lbm_reads_lt_1ms":4,"lbm_write_time_us":370,"lbm_writes_lt_1ms":23,"thread_start_us":123,"threads_started":2,"wal-append.queue_time_us":137} I0710 23:26:47.332365 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling CompactRowSetsOp(7dcd98b4c6f0472cbd570a3408ab1aa1): perf score=0.982534 I0710 23:26:47.332712 22039 tablet.cc:1663] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Compaction: stage 1 complete, picked 2 rowsets to compact or flush I0710 23:26:47.332736 22039 compaction.cc:921] Selected 2 rowsets to compact: I0710 23:26:47.332746 22039 compaction.cc:924] RowSet(0)(current size on disk: ~38624 bytes) I0710 23:26:47.332753 22039 compaction.cc:924] RowSet(1)(current size on disk: ~8717 bytes) I0710 23:26:47.332780 22039 tablet.cc:1443] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284694081536 or (T in {6272062284694081536})}] I0710 23:26:47.333863 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.346619 22039 tablet.cc:1528] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.346771 22039 tablet.cc:1583] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.346801 22039 tablet.cc:1585] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284694081536 or (T in {6272062284694081536})}] I0710 23:26:47.351269 22039 tablet.cc:1633] T 7dcd98b4c6f0472cbd570a3408ab1aa1 P 3576d2baa86141439f2e837433589a9b: Compaction successful on 1074 rows (32157 bytes) I0710 23:26:47.352035 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: CompactRowSetsOp(7dcd98b4c6f0472cbd570a3408ab1aa1) complete. Timing: real 0.019s user 0.019s sys 0.000s Metrics: {"cfile_cache_hit":10,"cfile_cache_hit_bytes":19814,"cfile_cache_miss":26,"cfile_cache_miss_bytes":56836,"cfile_init":6,"data dirs.queue_time_us":329,"data dirs.run_cpu_time_us":166,"data dirs.run_wall_time_us":1454,"delta_iterators_relevant":4,"lbm_read_time_us":433,"lbm_reads_lt_1ms":50,"lbm_write_time_us":394,"lbm_writes_lt_1ms":23,"mutex_wait_us":26,"spinlock_wait_cycles":14080,"thread_start_us":43,"threads_started":1} I0710 23:26:47.352567 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(7dcd98b4c6f0472cbd570a3408ab1aa1): 10411 bytes on disk I0710 23:26:47.352977 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(7dcd98b4c6f0472cbd570a3408ab1aa1) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4} I0710 23:26:47.353332 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(628f1e270e1948d2b555b1827254d4ab): perf score=0.000338 I0710 23:26:47.353636 22039 tablet.cc:1152] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:47.353657 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:47.353662 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:47.353667 22039 tablet.cc:1154] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 7735 bytes I0710 23:26:47.353685 22039 tablet.cc:1443] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284704022528 or (T in {6272062284704022528})}] I0710 23:26:47.355459 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.358273 22039 tablet.cc:1528] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.358419 22039 tablet.cc:1583] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.358448 22039 tablet.cc:1585] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284704022528 or (T in {6272062284704022528})}] I0710 23:26:47.360337 22039 tablet.cc:1633] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Flush successful on 59 rows (6198 bytes) I0710 23:26:47.360633 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(628f1e270e1948d2b555b1827254d4ab) complete. Timing: real 0.007s user 0.005s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":42,"data dirs.run_cpu_time_us":76,"data dirs.run_wall_time_us":939,"lbm_read_time_us":31,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1380,"lbm_writes_lt_1ms":23,"thread_start_us":44,"threads_started":1,"wal-append.queue_time_us":108} I0710 23:26:47.361148 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling CompactRowSetsOp(628f1e270e1948d2b555b1827254d4ab): perf score=0.970732 I0710 23:26:47.361407 22039 tablet.cc:1663] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Compaction: stage 1 complete, picked 2 rowsets to compact or flush I0710 23:26:47.361425 22039 compaction.cc:921] Selected 2 rowsets to compact: I0710 23:26:47.361435 22039 compaction.cc:924] RowSet(0)(current size on disk: ~36926 bytes) I0710 23:26:47.361443 22039 compaction.cc:924] RowSet(1)(current size on disk: ~6888 bytes) I0710 23:26:47.361493 22039 tablet.cc:1443] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284704022528 or (T in {6272062284704022528})}] I0710 23:26:47.362099 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.372675 22039 tablet.cc:1528] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.372800 22039 tablet.cc:1583] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.372823 22039 tablet.cc:1585] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284704022528 or (T in {6272062284704022528})}] I0710 23:26:47.376776 22039 tablet.cc:1633] T 628f1e270e1948d2b555b1827254d4ab P 3576d2baa86141439f2e837433589a9b: Compaction successful on 972 rows (29457 bytes) I0710 23:26:47.377265 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: CompactRowSetsOp(628f1e270e1948d2b555b1827254d4ab) complete. Timing: real 0.016s user 0.016s sys 0.000s Metrics: {"cfile_cache_hit":10,"cfile_cache_hit_bytes":17955,"cfile_cache_miss":26,"cfile_cache_miss_bytes":51641,"cfile_init":6,"data dirs.queue_time_us":208,"data dirs.run_cpu_time_us":188,"data dirs.run_wall_time_us":944,"delta_iterators_relevant":4,"lbm_read_time_us":376,"lbm_reads_lt_1ms":50,"lbm_write_time_us":388,"lbm_writes_lt_1ms":23,"mutex_wait_us":24,"spinlock_wait_cycles":3968} I0710 23:26:47.377817 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(628f1e270e1948d2b555b1827254d4ab): 9529 bytes on disk I0710 23:26:47.378283 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(628f1e270e1948d2b555b1827254d4ab) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4} I0710 23:26:47.378631 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(f5d922d9e6fb45bd9d98acf118e6d9e8): perf score=0.000336 I0710 23:26:47.378940 22039 tablet.cc:1152] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:47.378959 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:47.378964 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:47.378969 22039 tablet.cc:1154] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 7735 bytes I0710 23:26:47.378988 22039 tablet.cc:1443] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284698300416 or (T in {6272062284698300416})}] I0710 23:26:47.380111 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.382777 22039 tablet.cc:1528] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.382918 22039 tablet.cc:1583] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.382946 22039 tablet.cc:1585] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284698300416 or (T in {6272062284698300416})}] I0710 23:26:47.384999 22039 tablet.cc:1633] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Flush successful on 46 rows (5849 bytes) I0710 23:26:47.385303 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(f5d922d9e6fb45bd9d98acf118e6d9e8) complete. Timing: real 0.006s user 0.004s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":53,"data dirs.run_cpu_time_us":96,"data dirs.run_wall_time_us":963,"lbm_read_time_us":34,"lbm_reads_lt_1ms":4,"lbm_write_time_us":1070,"lbm_writes_lt_1ms":23,"thread_start_us":71,"threads_started":1,"wal-append.queue_time_us":181} I0710 23:26:47.385828 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling CompactRowSetsOp(f5d922d9e6fb45bd9d98acf118e6d9e8): perf score=0.921920 I0710 23:26:47.386116 22039 tablet.cc:1663] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Compaction: stage 1 complete, picked 2 rowsets to compact or flush I0710 23:26:47.386137 22039 compaction.cc:921] Selected 2 rowsets to compact: I0710 23:26:47.386144 22039 compaction.cc:924] RowSet(0)(current size on disk: ~37819 bytes) I0710 23:26:47.386149 22039 compaction.cc:924] RowSet(1)(current size on disk: ~6400 bytes) I0710 23:26:47.386174 22039 tablet.cc:1443] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284698300416 or (T in {6272062284698300416})}] I0710 23:26:47.386847 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.398221 22039 tablet.cc:1528] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.398360 22039 tablet.cc:1583] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.398442 22039 tablet.cc:1585] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284698300416 or (T in {6272062284698300416})}] I0710 23:26:47.402473 22039 tablet.cc:1633] T f5d922d9e6fb45bd9d98acf118e6d9e8 P 3576d2baa86141439f2e837433589a9b: Compaction successful on 986 rows (29882 bytes) I0710 23:26:47.402966 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: CompactRowSetsOp(f5d922d9e6fb45bd9d98acf118e6d9e8) complete. Timing: real 0.017s user 0.017s sys 0.000s Metrics: {"cfile_cache_hit":10,"cfile_cache_hit_bytes":18208,"cfile_cache_miss":26,"cfile_cache_miss_bytes":52198,"cfile_init":6,"data dirs.queue_time_us":208,"data dirs.run_cpu_time_us":143,"data dirs.run_wall_time_us":899,"delta_iterators_relevant":4,"lbm_read_time_us":387,"lbm_reads_lt_1ms":50,"lbm_write_time_us":388,"lbm_writes_lt_1ms":23,"mutex_wait_us":26} I0710 23:26:47.403543 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(e076cfa4d8674332aef98dec88fd570e): perf score=0.000336 I0710 23:26:47.403580 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:47.403905 22039 tablet.cc:1152] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:47.403928 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:47.403933 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:47.403939 22039 tablet.cc:1154] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 7735 bytes I0710 23:26:47.403954 22039 tablet.cc:1443] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284704907264 or (T in {6272062284704907264})}] I0710 23:26:47.404479 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.407160 22039 tablet.cc:1528] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.407280 22039 tablet.cc:1583] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.407305 22039 tablet.cc:1585] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284704907264 or (T in {6272062284704907264})}] I0710 23:26:47.409348 22039 tablet.cc:1633] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Flush successful on 36 rows (5595 bytes) I0710 23:26:47.409633 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(e076cfa4d8674332aef98dec88fd570e) complete. Timing: real 0.006s user 0.004s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":55,"data dirs.run_cpu_time_us":119,"data dirs.run_wall_time_us":622,"lbm_read_time_us":30,"lbm_reads_lt_1ms":4,"lbm_write_time_us":280,"lbm_writes_lt_1ms":23,"thread_start_us":87,"threads_started":1,"wal-append.queue_time_us":156} I0710 23:26:47.410194 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling CompactRowSetsOp(e076cfa4d8674332aef98dec88fd570e): perf score=0.964650 I0710 23:26:47.410468 22039 tablet.cc:1663] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Compaction: stage 1 complete, picked 2 rowsets to compact or flush I0710 23:26:47.410488 22039 compaction.cc:921] Selected 2 rowsets to compact: I0710 23:26:47.410497 22039 compaction.cc:924] RowSet(0)(current size on disk: ~39744 bytes) I0710 23:26:47.410504 22039 compaction.cc:924] RowSet(1)(current size on disk: ~6053 bytes) I0710 23:26:47.410538 22039 tablet.cc:1443] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284704907264 or (T in {6272062284704907264})}] I0710 23:26:47.411188 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.422525 22039 tablet.cc:1528] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.422678 22039 tablet.cc:1583] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.422708 22039 tablet.cc:1585] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284704907264 or (T in {6272062284704907264})}] I0710 23:26:47.426980 22039 tablet.cc:1633] T e076cfa4d8674332aef98dec88fd570e P 3576d2baa86141439f2e837433589a9b: Compaction successful on 1029 rows (30964 bytes) I0710 23:26:47.427475 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: CompactRowSetsOp(e076cfa4d8674332aef98dec88fd570e) complete. Timing: real 0.017s user 0.017s sys 0.000s Metrics: {"cfile_cache_hit":10,"cfile_cache_hit_bytes":18994,"cfile_cache_miss":26,"cfile_cache_miss_bytes":54568,"cfile_init":6,"data dirs.queue_time_us":199,"data dirs.run_cpu_time_us":190,"data dirs.run_wall_time_us":1528,"delta_iterators_relevant":4,"lbm_read_time_us":456,"lbm_reads_lt_1ms":50,"lbm_write_time_us":378,"lbm_writes_lt_1ms":23,"mutex_wait_us":13,"spinlock_wait_cycles":3328} I0710 23:26:47.428031 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(e076cfa4d8674332aef98dec88fd570e): 10031 bytes on disk I0710 23:26:47.428464 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(e076cfa4d8674332aef98dec88fd570e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":39,"lbm_reads_lt_1ms":4} I0710 23:26:47.428797 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(782cbc85002b4ef594bdd8a41b62d57e): perf score=0.000335 I0710 23:26:47.429144 22039 tablet.cc:1152] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:47.429163 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:47.429170 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:47.429178 22039 tablet.cc:1154] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 3751 bytes I0710 23:26:47.429200 22039 tablet.cc:1443] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284694028288 or (T in {6272062284694028288})}] I0710 23:26:47.429831 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.432837 22039 tablet.cc:1528] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.432976 22039 tablet.cc:1583] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.433001 22039 tablet.cc:1585] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284694028288 or (T in {6272062284694028288})}] I0710 23:26:47.434794 22039 tablet.cc:1633] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Flush successful on 20 rows (5156 bytes) I0710 23:26:47.435048 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(782cbc85002b4ef594bdd8a41b62d57e) complete. Timing: real 0.006s user 0.005s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":45,"data dirs.run_cpu_time_us":108,"data dirs.run_wall_time_us":503,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":339,"lbm_writes_lt_1ms":23,"thread_start_us":73,"threads_started":1,"wal-append.queue_time_us":138} I0710 23:26:47.435544 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(f5d922d9e6fb45bd9d98acf118e6d9e8): 9600 bytes on disk I0710 23:26:47.435951 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(f5d922d9e6fb45bd9d98acf118e6d9e8) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":50,"lbm_reads_lt_1ms":4} I0710 23:26:47.436257 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(782cbc85002b4ef594bdd8a41b62d57e): 307 bytes on disk I0710 23:26:47.436599 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(782cbc85002b4ef594bdd8a41b62d57e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":40,"lbm_reads_lt_1ms":4} I0710 23:26:47.436836 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling CompactRowSetsOp(782cbc85002b4ef594bdd8a41b62d57e): perf score=0.822184 I0710 23:26:47.437094 22039 tablet.cc:1663] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Compaction: stage 1 complete, picked 2 rowsets to compact or flush I0710 23:26:47.437114 22039 compaction.cc:921] Selected 2 rowsets to compact: I0710 23:26:47.437124 22039 compaction.cc:924] RowSet(0)(current size on disk: ~38737 bytes) I0710 23:26:47.437130 22039 compaction.cc:924] RowSet(1)(current size on disk: ~5463 bytes) I0710 23:26:47.437157 22039 tablet.cc:1443] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284694028288 or (T in {6272062284694028288})}] I0710 23:26:47.437772 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.447903 22039 tablet.cc:1528] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.448068 22039 tablet.cc:1583] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.448097 22039 tablet.cc:1585] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284694028288 or (T in {6272062284694028288})}] I0710 23:26:47.452070 22039 tablet.cc:1633] T 782cbc85002b4ef594bdd8a41b62d57e P 3576d2baa86141439f2e837433589a9b: Compaction successful on 984 rows (29755 bytes) I0710 23:26:47.452570 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: CompactRowSetsOp(782cbc85002b4ef594bdd8a41b62d57e) complete. Timing: real 0.016s user 0.015s sys 0.000s Metrics: {"cfile_cache_hit":10,"cfile_cache_hit_bytes":18167,"cfile_cache_miss":26,"cfile_cache_miss_bytes":52203,"cfile_init":5,"data dirs.queue_time_us":241,"data dirs.run_cpu_time_us":192,"data dirs.run_wall_time_us":937,"delta_iterators_relevant":4,"lbm_read_time_us":380,"lbm_reads_lt_1ms":46,"lbm_write_time_us":369,"lbm_writes_lt_1ms":23,"mutex_wait_us":22,"spinlock_wait_cycles":1920} I0710 23:26:47.453120 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(782cbc85002b4ef594bdd8a41b62d57e): 9594 bytes on disk I0710 23:26:47.453639 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(782cbc85002b4ef594bdd8a41b62d57e) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":47,"lbm_reads_lt_1ms":4} I0710 23:26:47.453938 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling FlushMRSOp(18aa52f6e09947709e0b183c6d7d21d3): perf score=0.000337 I0710 23:26:47.454289 22039 tablet.cc:1152] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush: entering stage 1 (old memrowset already frozen for inserts) I0710 23:26:47.454309 22039 compaction.cc:921] Selected 1 rowsets to compact: I0710 23:26:47.454318 22039 compaction.cc:924] memrowset(current size on disk: ~0 bytes) I0710 23:26:47.454325 22039 tablet.cc:1154] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Memstore in-memory size: 763 bytes I0710 23:26:47.454347 22039 tablet.cc:1443] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284686508032 or (T in {6272062284686508032})}] I0710 23:26:47.455641 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.457873 22039 tablet.cc:1528] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.458055 22039 tablet.cc:1583] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.458083 22039 tablet.cc:1585] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284686508032 or (T in {6272062284686508032})}] I0710 23:26:47.460124 22039 tablet.cc:1633] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Flush successful on 6 rows (4764 bytes) I0710 23:26:47.460393 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: FlushMRSOp(18aa52f6e09947709e0b183c6d7d21d3) complete. Timing: real 0.006s user 0.005s sys 0.000s Metrics: {"cfile_init":1,"data dirs.queue_time_us":90,"data dirs.run_cpu_time_us":227,"data dirs.run_wall_time_us":1140,"lbm_read_time_us":36,"lbm_reads_lt_1ms":4,"lbm_write_time_us":886,"lbm_writes_lt_1ms":23,"thread_start_us":83,"threads_started":1,"wal-append.queue_time_us":191} I0710 23:26:47.460889 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling CompactRowSetsOp(18aa52f6e09947709e0b183c6d7d21d3): perf score=0.654935 I0710 23:26:47.461177 22039 tablet.cc:1663] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Compaction: stage 1 complete, picked 2 rowsets to compact or flush I0710 23:26:47.461199 22039 compaction.cc:921] Selected 2 rowsets to compact: I0710 23:26:47.461205 22039 compaction.cc:924] RowSet(0)(current size on disk: ~41745 bytes) I0710 23:26:47.461210 22039 compaction.cc:924] RowSet(1)(current size on disk: ~4952 bytes) I0710 23:26:47.461232 22039 tablet.cc:1443] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 1 (flushing snapshot). Phase 1 snapshot: MvccSnapshot[committed={T|T < 6272062284686508032 or (T in {6272062284686508032})}] I0710 23:26:47.461858 22039 multi_column_writer.cc:98] Opened CFile writers for 3 column(s) I0710 23:26:47.472959 22039 tablet.cc:1528] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Compaction: entering phase 2 (starting to duplicate updates in new rowsets) I0710 23:26:47.473098 22039 tablet.cc:1583] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Compaction Phase 2: carrying over any updates which arrived during Phase 1 I0710 23:26:47.473151 22039 tablet.cc:1585] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Phase 2 snapshot: MvccSnapshot[committed={T|T < 6272062284686508032 or (T in {6272062284686508032})}] I0710 23:26:47.477120 22039 tablet.cc:1633] T 18aa52f6e09947709e0b183c6d7d21d3 P 3576d2baa86141439f2e837433589a9b: Compaction successful on 1058 rows (31696 bytes) I0710 23:26:47.477596 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: CompactRowSetsOp(18aa52f6e09947709e0b183c6d7d21d3) complete. Timing: real 0.016s user 0.016s sys 0.000s Metrics: {"cfile_cache_hit":10,"cfile_cache_hit_bytes":19529,"cfile_cache_miss":26,"cfile_cache_miss_bytes":55845,"cfile_init":6,"data dirs.queue_time_us":221,"data dirs.run_cpu_time_us":182,"data dirs.run_wall_time_us":1386,"delta_iterators_relevant":4,"lbm_read_time_us":381,"lbm_reads_lt_1ms":50,"lbm_write_time_us":374,"lbm_writes_lt_1ms":23,"mutex_wait_us":22,"spinlock_wait_cycles":17536} I0710 23:26:47.478044 22145 maintenance_manager.cc:304] P 3576d2baa86141439f2e837433589a9b: Scheduling UndoDeltaBlockGCOp(18aa52f6e09947709e0b183c6d7d21d3): 10290 bytes on disk I0710 23:26:47.478447 22039 maintenance_manager.cc:494] P 3576d2baa86141439f2e837433589a9b: UndoDeltaBlockGCOp(18aa52f6e09947709e0b183c6d7d21d3) complete. Timing: real 0.000s user 0.000s sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":49,"lbm_reads_lt_1ms":4} I0710 23:26:48.405045 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:49.406461 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:50.407891 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:51.409301 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:52.410727 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:53.412380 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:54.413789 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:55.415179 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:56.416596 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:57.418123 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:58.419469 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:26:59.420924 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:00.422327 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:01.423743 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:02.425096 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:03.426508 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:04.427959 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:05.429391 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:06.430845 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:07.432289 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:08.433732 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:09.435497 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:10.436923 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:11.438374 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:12.439798 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:13.441087 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:14.442431 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:15.443853 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 I0710 23:27:16.445246 18604 tablet_copy_client_session-itest.cc:417] Waiting for tablets to fail: 6 / 10 /home/jenkins-slave/workspace/kudu-master/1/src/kudu/integration-tests/tablet_copy_client_session-itest.cc:417: Failure Expected: (failed_on_ts) >= (kNumTablets - 1), actual: 6 vs 9 /home/jenkins-slave/workspace/kudu-master/1/src/kudu/util/test_util.cc:322: Failure Failed Timed out waiting for assertion to pass. I0710 23:27:16.445425 18604 external_mini_cluster-itest-base.cc:80] Found fatal failure I0710 23:27:16.445466 18604 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 0 with UUID 3576d2baa86141439f2e837433589a9b and pid 22014 ************************ BEGIN STACKS ************************** Could not attach to process. If your uid matches the uid of the target process, check the setting of /proc/sys/kernel/yama/ptrace_scope, or try again as the root user. For more details, see /etc/sysctl.d/10-ptrace.conf ptrace: Operation not permitted. /tmp/dist-test-taskXw_ur6/build/debug/test-work/tablet_copy_client_session-itest/22014: No such file or directory. No threads. ************************* END STACKS *************************** I0710 23:27:16.608888 18604 external_mini_cluster-itest-base.cc:86] Attempting to dump stacks of TS 1 with UUID 6ec7d1737cd1460ab9dd752e64eac912 and pid 22413 ************************ BEGIN STACKS ************************** Could not attach to process. If your uid matches the uid of the target process, check the setting of /proc/sys/kernel/yama/ptrace_scope, or try again as the root user. For more details, see /etc/sysctl.d/10-ptrace.conf ptrace: Operation not permitted. /tmp/dist-test-taskXw_ur6/build/debug/test-work/tablet_copy_client_session-itest/22413: No such file or directory. No threads. ************************* END STACKS *************************** I0710 23:27:16.767777 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 22014 W0710 23:27:16.772034 22421 connection.cc:512] client connection to 127.18.43.1:45577 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:45577): Connection reset by peer (error 104) W0710 23:27:16.772056 21952 connection.cc:512] client connection to 127.18.43.1:45577 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:45577): Connection reset by peer (error 104) W0710 23:27:16.772074 22285 connection.cc:512] client connection to 127.18.43.1:45577 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:45577): Connection reset by peer (error 104) W0710 23:27:16.772074 22287 connection.cc:512] server connection from 127.18.43.1:56931 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.1:56931): Connection reset by peer (error 104) I0710 23:27:16.772671 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-tserver with pid 22413 W0710 23:27:16.776202 22288 connection.cc:512] server connection from 127.18.43.2:44613 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:44613): Connection reset by peer (error 104) W0710 23:27:16.776218 21952 connection.cc:512] client connection to 127.18.43.2:45917 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.2:45917): Connection reset by peer (error 104) I0710 23:27:16.776355 18604 external_mini_cluster.cc:1008] Killing /tmp/dist-test-taskXw_ur6/build/debug/bin/kudu-master with pid 22277 W0710 23:27:16.780448 21952 connection.cc:512] client connection to 127.18.43.62:34207 recv error: Network error: failed to read from TLS socket (remote: 127.18.43.62:34207): Connection reset by peer (error 104) I0710 23:27:16.781569 18604 test_util.cc:131] ----------------------------------------------- I0710 23:27:16.781591 18604 test_util.cc:132] Had fatal failures, leaving test files at /tmp/dist-test-taskXw_ur6/test-tmp/tablet_copy_client_session-itest.0.TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure.1531265186290008-18604 [ FAILED ] TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure (33254 ms) [----------] 5 tests from TabletCopyClientSessionITest (50485 ms total) [----------] Global test environment tear-down [==========] 5 tests from 1 test case ran. (50486 ms total) [ PASSED ] 4 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TabletCopyClientSessionITest.TestStopCopyOnClientDiskFailure 1 FAILED TEST