[==========] Running 9 tests from 2 test cases. [----------] Global test environment set-up. [----------] 1 test from ClientLocationAssignmentITest [ RUN ] ClientLocationAssignmentITest.Basic WARNING: Logging before InitGoogleLogging() is written to STDERR I0301 23:03:38.405758 90 test_util.cc:212] Using random seed: 1792137075 I0301 23:03:38.409236 90 ts_itest-base.cc:112] Starting cluster with: I0301 23:03:38.409256 90 ts_itest-base.cc:113] -------------- I0301 23:03:38.409262 90 ts_itest-base.cc:114] 3 tablet servers I0301 23:03:38.409265 90 ts_itest-base.cc:115] 3 replicas per TS I0301 23:03:38.409270 90 ts_itest-base.cc:116] -------------- I0301 23:03:38.409648 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:38515 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/location-assignment.state --map /L0:2 --map /L1:1 --map /L2:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:38.420033 100 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:38.420120 100 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:38.420948 100 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:03:38.420971 100 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:38.420979 100 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:03:38.420984 100 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:03:38.422109 100 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/wal --ipki_ca_key_size=1024 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/location-assignment.state --map /L0:2 --map /L1:1 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:38515 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.100 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:38.422878 100 master_main.cc:80] Initializing master server... I0301 23:03:38.423019 100 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25016us I0301 23:03:38.423112 100 fs_manager.cc:263] Metadata directory not provided I0301 23:03:38.423140 100 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:38.423177 100 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:38.423192 100 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:38.423734 100 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/data/instance: uuid: "baad555517754dc1b624124e531bd363" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.423902 100 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/wal/instance: uuid: "baad555517754dc1b624124e531bd363" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.424973 100 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:03:38.425185 100 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:38.425281 100 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:38.425827 100 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:38.425855 100 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/wal uuid: "baad555517754dc1b624124e531bd363" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.425879 100 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:38.444453 100 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:38.444607 100 master_main.cc:83] Starting Master server... I0301 23:03:38.446507 100 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:38515 I0301 23:03:38.446557 100 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:03:38.446564 100 webserver.cc:186] Document root disabled I0301 23:03:38.446671 100 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:33773/ I0301 23:03:38.446782 100 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/master-0/data/info.pb I0301 23:03:38.447158 159 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:03:38.448741 159 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363: Bootstrap starting. I0301 23:03:38.448992 159 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363: No blocks or log segments found. Creating new log. I0301 23:03:38.449143 159 log.cc:525] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363: Log is configured to *not* fsync() on all Append() calls I0301 23:03:38.449414 159 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363: No bootstrap required, opened a new log I0301 23:03:38.450418 159 raft_consensus.cc:340] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baad555517754dc1b624124e531bd363" member_type: VOTER } I0301 23:03:38.450443 159 raft_consensus.cc:366] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:03:38.450448 159 raft_consensus.cc:705] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: baad555517754dc1b624124e531bd363, State: Initialized, Role: FOLLOWER I0301 23:03:38.450486 159 consensus_queue.cc:229] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baad555517754dc1b624124e531bd363" member_type: VOTER } I0301 23:03:38.450510 159 raft_consensus.cc:380] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0301 23:03:38.450520 159 raft_consensus.cc:472] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0301 23:03:38.450525 159 raft_consensus.cc:2886] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:03:38.450891 159 raft_consensus.cc:494] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baad555517754dc1b624124e531bd363" member_type: VOTER } I0301 23:03:38.450927 159 leader_election.cc:306] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: baad555517754dc1b624124e531bd363; no voters: I0301 23:03:38.450978 159 leader_election.cc:292] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [CANDIDATE]: Term 1 election: Requested vote from peers I0301 23:03:38.451079 159 sys_catalog.cc:337] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baad555517754dc1b624124e531bd363" member_type: VOTER } } I0301 23:03:38.451098 159 sys_catalog.cc:340] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:03:38.451153 159 sys_catalog.cc:424] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:03:38.451251 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 100 I0301 23:03:38.451262 161 raft_consensus.cc:2640] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:03:38.451431 100 master_main.cc:86] Master server successfully started. I0301 23:03:38.451520 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:38515 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --log_cache_size_limit_mb=10 --consensus_rpc_timeout_ms=30000 with env {} I0301 23:03:38.451541 161 raft_consensus.cc:667] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [term 1 LEADER]: Becoming Leader. State: Replica: baad555517754dc1b624124e531bd363, State: Running, Role: LEADER I0301 23:03:38.451573 161 consensus_queue.cc:206] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baad555517754dc1b624124e531bd363" member_type: VOTER } I0301 23:03:38.451722 162 sys_catalog.cc:337] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "baad555517754dc1b624124e531bd363" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baad555517754dc1b624124e531bd363" member_type: VOTER } } I0301 23:03:38.451748 162 sys_catalog.cc:340] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [sys.catalog]: This master's current role is: LEADER I0301 23:03:38.452002 164 sys_catalog.cc:337] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [sys.catalog]: SysCatalogTable state changed. Reason: New leader baad555517754dc1b624124e531bd363. Latest consensus state: current_term: 1 leader_uuid: "baad555517754dc1b624124e531bd363" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "baad555517754dc1b624124e531bd363" member_type: VOTER } } I0301 23:03:38.452020 164 sys_catalog.cc:340] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363 [sys.catalog]: This master's current role is: LEADER W0301 23:03:38.452139 163 catalog_manager.cc:1104] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:03:38.452160 163 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:03:38.452208 166 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:03:38.452303 166 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:38.471222 168 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:38.471328 168 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:38.472373 168 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:38.472437 168 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:03:38.473629 168 tablet_server_main.cc:78] Tablet server non-default flags: --log_cache_size_limit_mb=10 --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:38515 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.168 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:38.474720 168 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:38.474882 168 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25016us I0301 23:03:38.474982 168 fs_manager.cc:263] Metadata directory not provided I0301 23:03:38.475014 168 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:38.475067 168 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:38.475086 168 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:38.476775 168 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/data/instance: uuid: "e841b5267f1e499a86a0e35e283ce039" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.476969 168 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/wal/instance: uuid: "e841b5267f1e499a86a0e35e283ce039" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.480377 168 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.002s sys 0.000s I0301 23:03:38.480660 168 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:38.480739 168 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:38.481456 168 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:38.481490 168 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/wal uuid: "e841b5267f1e499a86a0e35e283ce039" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.481515 168 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:38.508452 166 catalog_manager.cc:941] Generated new certificate authority record I0301 23:03:38.509112 166 catalog_manager.cc:1066] Loading token signing keys... I0301 23:03:38.511554 166 catalog_manager.cc:4095] T 00000000000000000000000000000000 P baad555517754dc1b624124e531bd363: Generated new TSK 0 I0301 23:03:38.511916 168 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:38.512141 168 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:38.512250 168 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:38.518301 168 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:37181 I0301 23:03:38.518353 168 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:03:38.518360 168 webserver.cc:186] Document root disabled I0301 23:03:38.518512 168 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:42061/ I0301 23:03:38.518622 168 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-0/data/info.pb I0301 23:03:38.518923 168 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:38.523056 289 heartbeater.cc:345] Connected to a master server at 127.0.22.190:38515 I0301 23:03:38.523083 289 heartbeater.cc:425] Registering TS with master... I0301 23:03:38.523123 289 heartbeater.cc:474] Master 127.0.22.190:38515 requested a full tablet report, sending... I0301 23:03:38.527732 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 168 I0301 23:03:38.528018 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:0 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:38515 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --log_cache_size_limit_mb=10 --consensus_rpc_timeout_ms=30000 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:38.550783 294 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:38.550869 294 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:38.551573 294 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:38.551607 294 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:03:38.556550 294 tablet_server_main.cc:78] Tablet server non-default flags: --log_cache_size_limit_mb=10 --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:38515 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.294 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:38.557361 294 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:38.557533 294 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25016us I0301 23:03:38.557624 294 fs_manager.cc:263] Metadata directory not provided I0301 23:03:38.557654 294 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:38.557699 294 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:38.557714 294 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:38.558265 294 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/data/instance: uuid: "9e981a7936e942b89b5076b0f0eb11bf" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.558451 294 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/wal/instance: uuid: "9e981a7936e942b89b5076b0f0eb11bf" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.559504 294 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:38.559784 294 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:38.559871 294 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:38.560659 294 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:38.560695 294 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/wal uuid: "9e981a7936e942b89b5076b0f0eb11bf" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.560719 294 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:38.564195 126 ts_manager.cc:98] Registered new tserver with Master: e841b5267f1e499a86a0e35e283ce039 (127.0.22.129:37181) I0301 23:03:38.564963 126 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:48757 I0301 23:03:38.603739 294 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:38.603977 294 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:38.604120 294 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:38.609123 294 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:44241 I0301 23:03:38.609170 294 webserver.cc:175] Starting webserver on 127.0.22.130:0 I0301 23:03:38.609176 294 webserver.cc:186] Document root disabled I0301 23:03:38.609305 294 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:43719/ I0301 23:03:38.609441 294 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-1/data/info.pb I0301 23:03:38.609971 294 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:38.612468 413 heartbeater.cc:345] Connected to a master server at 127.0.22.190:38515 I0301 23:03:38.612491 413 heartbeater.cc:425] Registering TS with master... I0301 23:03:38.612530 413 heartbeater.cc:474] Master 127.0.22.190:38515 requested a full tablet report, sending... I0301 23:03:38.613749 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 294 I0301 23:03:38.613996 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:0 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:38515 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --log_cache_size_limit_mb=10 --consensus_rpc_timeout_ms=30000 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:38.635027 417 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:38.635112 417 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:38.635788 417 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:38.635818 417 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:03:38.640733 417 tablet_server_main.cc:78] Tablet server non-default flags: --log_cache_size_limit_mb=10 --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:38515 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.417 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:38.641517 417 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:38.641641 417 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25016us I0301 23:03:38.641705 417 fs_manager.cc:263] Metadata directory not provided I0301 23:03:38.641726 417 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:38.641757 417 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:38.641768 417 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:38.642283 417 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/data/instance: uuid: "5486c6d5f4aa46d2a490ab6e76a18733" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.642447 417 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/wal/instance: uuid: "5486c6d5f4aa46d2a490ab6e76a18733" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.643411 417 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:38.643617 417 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:38.643693 417 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:38.644214 417 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:38.644246 417 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/wal uuid: "5486c6d5f4aa46d2a490ab6e76a18733" format_stamp: "Formatted at 2019-03-01 23:03:38 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:38.644271 417 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:38.652972 126 ts_manager.cc:98] Registered new tserver with Master: 9e981a7936e942b89b5076b0f0eb11bf (127.0.22.130:44241) I0301 23:03:38.653803 126 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:57189 I0301 23:03:38.693418 417 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:38.693622 417 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:38.693672 417 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:38.697233 417 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:33049 I0301 23:03:38.697294 417 webserver.cc:175] Starting webserver on 127.0.22.131:0 I0301 23:03:38.697301 417 webserver.cc:186] Document root disabled I0301 23:03:38.697448 417 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:44453/ I0301 23:03:38.697568 417 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.ClientLocationAssignmentITest.Basic.1551481418399944-90/raft_consensus-itest-cluster/ts-2/data/info.pb I0301 23:03:38.697846 417 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:38.700927 536 heartbeater.cc:345] Connected to a master server at 127.0.22.190:38515 I0301 23:03:38.700947 536 heartbeater.cc:425] Registering TS with master... I0301 23:03:38.700984 536 heartbeater.cc:474] Master 127.0.22.190:38515 requested a full tablet report, sending... I0301 23:03:38.707507 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 417 I0301 23:03:38.728149 126 ts_manager.cc:98] Registered new tserver with Master: 5486c6d5f4aa46d2a490ab6e76a18733 (127.0.22.131:33049) I0301 23:03:38.728569 90 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0301 23:03:38.728986 126 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:47377 I0301 23:03:38.759868 126 catalog_manager.cc:1386] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52616: name: "TestTable" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } W0301 23:03:38.759961 126 catalog_manager.cc:1537] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestTable in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0301 23:03:38.764071 350 tablet_service.cc:774] Processing CreateTablet for tablet eee07e353042465691f1c5cffa355aaf (table=TestTable [id=b1cd5778898c426dbbd60038bf857a78]), partition=RANGE (key) PARTITION UNBOUNDED I0301 23:03:38.764420 350 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet eee07e353042465691f1c5cffa355aaf. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:03:38.764716 473 tablet_service.cc:774] Processing CreateTablet for tablet eee07e353042465691f1c5cffa355aaf (table=TestTable [id=b1cd5778898c426dbbd60038bf857a78]), partition=RANGE (key) PARTITION UNBOUNDED I0301 23:03:38.764791 473 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet eee07e353042465691f1c5cffa355aaf. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:03:38.764793 220 tablet_service.cc:774] Processing CreateTablet for tablet eee07e353042465691f1c5cffa355aaf (table=TestTable [id=b1cd5778898c426dbbd60038bf857a78]), partition=RANGE (key) PARTITION UNBOUNDED I0301 23:03:38.764863 220 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet eee07e353042465691f1c5cffa355aaf. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:03:38.765957 350 ts_tablet_manager.cc:1175] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: Registered tablet (data state: TABLET_DATA_READY) I0301 23:03:38.766088 553 ts_tablet_manager.cc:1030] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: Bootstrapping tablet I0301 23:03:38.766110 553 tablet_bootstrap.cc:439] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: Bootstrap starting. I0301 23:03:38.766335 553 tablet_bootstrap.cc:593] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: No blocks or log segments found. Creating new log. I0301 23:03:38.766463 553 log.cc:525] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: Log is configured to *not* fsync() on all Append() calls I0301 23:03:38.766518 220 ts_tablet_manager.cc:1175] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: Registered tablet (data state: TABLET_DATA_READY) I0301 23:03:38.766518 473 ts_tablet_manager.cc:1175] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: Registered tablet (data state: TABLET_DATA_READY) I0301 23:03:38.766652 556 ts_tablet_manager.cc:1030] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: Bootstrapping tablet I0301 23:03:38.766696 556 tablet_bootstrap.cc:439] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: Bootstrap starting. I0301 23:03:38.766924 553 tablet_bootstrap.cc:439] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: No bootstrap required, opened a new log I0301 23:03:38.766963 556 tablet_bootstrap.cc:593] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: No blocks or log segments found. Creating new log. I0301 23:03:38.766997 553 ts_tablet_manager.cc:1047] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s I0301 23:03:38.767035 555 ts_tablet_manager.cc:1030] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: Bootstrapping tablet I0301 23:03:38.767071 555 tablet_bootstrap.cc:439] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: Bootstrap starting. I0301 23:03:38.767328 555 tablet_bootstrap.cc:593] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: No blocks or log segments found. Creating new log. I0301 23:03:38.767506 555 log.cc:525] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: Log is configured to *not* fsync() on all Append() calls I0301 23:03:38.767719 556 log.cc:525] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: Log is configured to *not* fsync() on all Append() calls I0301 23:03:38.768013 555 tablet_bootstrap.cc:439] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: No bootstrap required, opened a new log I0301 23:03:38.768054 555 ts_tablet_manager.cc:1047] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: Time spent bootstrapping tablet: real 0.001s user 0.001s sys 0.000s I0301 23:03:38.768143 556 tablet_bootstrap.cc:439] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: No bootstrap required, opened a new log I0301 23:03:38.768206 556 ts_tablet_manager.cc:1047] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: Time spent bootstrapping tablet: real 0.002s user 0.001s sys 0.000s I0301 23:03:38.768275 553 raft_consensus.cc:340] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.768306 553 raft_consensus.cc:366] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:03:38.768314 553 raft_consensus.cc:705] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e981a7936e942b89b5076b0f0eb11bf, State: Initialized, Role: FOLLOWER I0301 23:03:38.768399 553 consensus_queue.cc:229] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.768522 413 heartbeater.cc:466] Master 127.0.22.190:38515 was elected leader, sending a full tablet report... I0301 23:03:38.768525 553 ts_tablet_manager.cc:1075] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s I0301 23:03:38.769194 556 raft_consensus.cc:340] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.769203 555 raft_consensus.cc:340] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.769219 555 raft_consensus.cc:366] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:03:38.769222 556 raft_consensus.cc:366] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:03:38.769227 555 raft_consensus.cc:705] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e841b5267f1e499a86a0e35e283ce039, State: Initialized, Role: FOLLOWER I0301 23:03:38.769227 556 raft_consensus.cc:705] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5486c6d5f4aa46d2a490ab6e76a18733, State: Initialized, Role: FOLLOWER I0301 23:03:38.769279 556 consensus_queue.cc:229] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.769281 555 consensus_queue.cc:229] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.769372 536 heartbeater.cc:466] Master 127.0.22.190:38515 was elected leader, sending a full tablet report... I0301 23:03:38.769418 555 ts_tablet_manager.cc:1075] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: Time spent starting tablet: real 0.001s user 0.001s sys 0.000s I0301 23:03:38.769423 289 heartbeater.cc:466] Master 127.0.22.190:38515 was elected leader, sending a full tablet report... I0301 23:03:38.769376 556 ts_tablet_manager.cc:1075] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: Time spent starting tablet: real 0.001s user 0.000s sys 0.001s I0301 23:03:38.775558 559 raft_consensus.cc:472] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0301 23:03:38.775609 559 raft_consensus.cc:494] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.775673 559 leader_election.cc:292] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e841b5267f1e499a86a0e35e283ce039 (127.0.22.129:37181), 5486c6d5f4aa46d2a490ab6e76a18733 (127.0.22.131:33049) I0301 23:03:38.778424 245 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "eee07e353042465691f1c5cffa355aaf" candidate_uuid: "9e981a7936e942b89b5076b0f0eb11bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e841b5267f1e499a86a0e35e283ce039" is_pre_election: true I0301 23:03:38.778458 245 raft_consensus.cc:2346] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e981a7936e942b89b5076b0f0eb11bf in term 0. I0301 23:03:38.778633 301 leader_election.cc:306] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9e981a7936e942b89b5076b0f0eb11bf, e841b5267f1e499a86a0e35e283ce039; no voters: I0301 23:03:38.778694 559 raft_consensus.cc:2640] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 0 FOLLOWER]: Leader pre-election won for term 1 I0301 23:03:38.778717 559 raft_consensus.cc:472] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0301 23:03:38.778723 559 raft_consensus.cc:2886] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 0 FOLLOWER]: Advancing to term 1 I0301 23:03:38.779181 559 raft_consensus.cc:494] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.779331 559 leader_election.cc:292] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [CANDIDATE]: Term 1 election: Requested vote from peers e841b5267f1e499a86a0e35e283ce039 (127.0.22.129:37181), 5486c6d5f4aa46d2a490ab6e76a18733 (127.0.22.131:33049) I0301 23:03:38.779342 493 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "eee07e353042465691f1c5cffa355aaf" candidate_uuid: "9e981a7936e942b89b5076b0f0eb11bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" is_pre_election: true I0301 23:03:38.779363 493 raft_consensus.cc:2346] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9e981a7936e942b89b5076b0f0eb11bf in term 0. I0301 23:03:38.779565 493 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "eee07e353042465691f1c5cffa355aaf" candidate_uuid: "9e981a7936e942b89b5076b0f0eb11bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" I0301 23:03:38.779593 493 raft_consensus.cc:2886] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:03:38.779635 245 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "eee07e353042465691f1c5cffa355aaf" candidate_uuid: "9e981a7936e942b89b5076b0f0eb11bf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e841b5267f1e499a86a0e35e283ce039" I0301 23:03:38.779659 245 raft_consensus.cc:2886] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:03:38.780033 245 raft_consensus.cc:2346] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e981a7936e942b89b5076b0f0eb11bf in term 1. I0301 23:03:38.780050 493 raft_consensus.cc:2346] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9e981a7936e942b89b5076b0f0eb11bf in term 1. I0301 23:03:38.780241 301 leader_election.cc:306] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5486c6d5f4aa46d2a490ab6e76a18733, 9e981a7936e942b89b5076b0f0eb11bf; no voters: I0301 23:03:38.780313 559 raft_consensus.cc:2640] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:03:38.780413 559 raft_consensus.cc:667] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [term 1 LEADER]: Becoming Leader. State: Replica: 9e981a7936e942b89b5076b0f0eb11bf, State: Running, Role: LEADER I0301 23:03:38.780478 559 consensus_queue.cc:206] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } } I0301 23:03:38.780915 126 catalog_manager.cc:3791] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf reported cstate change: term changed from 0 to 1, leader changed from to 9e981a7936e942b89b5076b0f0eb11bf (127.0.22.130). New cstate: current_term: 1 leader_uuid: "9e981a7936e942b89b5076b0f0eb11bf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9e981a7936e942b89b5076b0f0eb11bf" member_type: VOTER last_known_addr { host: "127.0.22.130" port: 44241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 } health_report { overall_health: UNKNOWN } } } I0301 23:03:38.783953 90 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0301 23:03:38.784413 90 ts_itest-base.cc:232] Waiting for 1 tablets on tserver e841b5267f1e499a86a0e35e283ce039 to finish bootstrapping I0301 23:03:38.786432 90 ts_itest-base.cc:232] Waiting for 1 tablets on tserver 9e981a7936e942b89b5076b0f0eb11bf to finish bootstrapping I0301 23:03:38.788352 90 ts_itest-base.cc:232] Waiting for 1 tablets on tserver 5486c6d5f4aa46d2a490ab6e76a18733 to finish bootstrapping I0301 23:03:38.796408 90 cluster_itest_util.cc:249] Not converged past 1 yet: 0.0 1.1 0.0 W0301 23:03:38.859726 414 tablet.cc:1786] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:03:38.897666 90 cluster_itest_util.cc:249] Not converged past 1 yet: 0.0 1.1 0.0 W0301 23:03:38.948207 537 tablet.cc:1786] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733: Can't schedule compaction. Clean time has not been advanced past its initial value. W0301 23:03:39.019286 290 tablet.cc:1786] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:03:39.099033 90 cluster_itest_util.cc:249] Not converged past 1 yet: 0.0 1.1 0.0 I0301 23:03:39.301254 245 raft_consensus.cc:1181] T eee07e353042465691f1c5cffa355aaf P e841b5267f1e499a86a0e35e283ce039 [term 1 FOLLOWER]: Refusing update from remote peer 9e981a7936e942b89b5076b0f0eb11bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0301 23:03:39.301622 566 consensus_queue.cc:984] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "e841b5267f1e499a86a0e35e283ce039" member_type: VOTER last_known_addr { host: "127.0.22.129" port: 37181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0301 23:03:39.302698 493 raft_consensus.cc:1181] T eee07e353042465691f1c5cffa355aaf P 5486c6d5f4aa46d2a490ab6e76a18733 [term 1 FOLLOWER]: Refusing update from remote peer 9e981a7936e942b89b5076b0f0eb11bf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0301 23:03:39.302913 569 consensus_queue.cc:984] T eee07e353042465691f1c5cffa355aaf P 9e981a7936e942b89b5076b0f0eb11bf [LEADER]: Connected to new peer: Peer: permanent_uuid: "5486c6d5f4aa46d2a490ab6e76a18733" member_type: VOTER last_known_addr { host: "127.0.22.131" port: 33049 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0301 23:03:39.413944 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 168 W0301 23:03:39.417246 95 connection.cc:647] client connection to 127.0.22.129:37181 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:37181): Connection reset by peer (error 104) W0301 23:03:39.417254 301 connection.cc:647] client connection to 127.0.22.129:37181 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:37181): Connection reset by peer (error 104) W0301 23:03:39.417254 99 connection.cc:647] client connection to 127.0.22.129:37181 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:37181): Connection reset by peer (error 104) W0301 23:03:39.417439 109 connection.cc:647] server connection from 127.0.22.129:48757 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:48757): Connection reset by peer (error 104) W0301 23:03:39.417618 107 connection.cc:647] client connection to 127.0.22.129:37181 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:37181): Connection reset by peer (error 104) I0301 23:03:39.417666 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 294 W0301 23:03:39.420711 96 connection.cc:647] client connection to 127.0.22.130:44241 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:44241): Connection reset by peer (error 104) W0301 23:03:39.420737 425 connection.cc:647] server connection from 127.0.22.130:37245 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:37245): Connection reset by peer (error 104) W0301 23:03:39.420785 108 connection.cc:647] client connection to 127.0.22.130:44241 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:44241): Connection reset by peer (error 104) W0301 23:03:39.420826 99 connection.cc:647] client connection to 127.0.22.130:44241 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:44241): Connection reset by peer (error 104) I0301 23:03:39.420878 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 417 W0301 23:03:39.420905 109 connection.cc:647] server connection from 127.0.22.130:57189 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:57189): Connection reset by peer (error 104) W0301 23:03:39.423081 95 connection.cc:647] client connection to 127.0.22.131:33049 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:33049): Connection reset by peer (error 104) W0301 23:03:39.423113 99 connection.cc:647] client connection to 127.0.22.131:33049 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:33049): Connection reset by peer (error 104) W0301 23:03:39.423149 110 connection.cc:647] server connection from 127.0.22.131:47377 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:47377): Connection reset by peer (error 104) W0301 23:03:39.423202 107 connection.cc:647] client connection to 127.0.22.131:33049 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:33049): Connection reset by peer (error 104) I0301 23:03:39.423203 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 100 W0301 23:03:39.426136 99 connection.cc:647] client connection to 127.0.22.190:38515 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:38515): Connection reset by peer (error 104) [ OK ] ClientLocationAssignmentITest.Basic (1023 ms) [----------] 1 test from ClientLocationAssignmentITest (1023 ms total) [----------] 8 tests from TsLocationAssignmentITest [ RUN ] TsLocationAssignmentITest.Basic/0 I0301 23:03:39.428997 90 test_util.cc:212] Using random seed: 1793160323 I0301 23:03:39.429350 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:38773 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.439584 583 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.439667 583 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.440665 583 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:03:39.440687 583 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.440691 583 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:03:39.440696 583 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:03:39.441705 583 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:38773 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.583 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.442469 583 master_main.cc:80] Initializing master server... I0301 23:03:39.442598 583 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.442692 583 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.442715 583 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.442749 583 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:39.442771 583 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:39.443308 583 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/instance: uuid: "642faa2effa145399932e0effe93e46d" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.443481 583 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal/instance: uuid: "642faa2effa145399932e0effe93e46d" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.444469 583 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:39.444681 583 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.444751 583 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.445247 583 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.445274 583 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal uuid: "642faa2effa145399932e0effe93e46d" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.445294 583 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.459892 583 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.460036 583 master_main.cc:83] Starting Master server... I0301 23:03:39.462216 583 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:38773 I0301 23:03:39.462270 583 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:03:39.462280 583 webserver.cc:186] Document root disabled I0301 23:03:39.462451 583 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:32827/ I0301 23:03:39.462566 583 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:03:39.462777 642 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:03:39.464319 642 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: Bootstrap starting. I0301 23:03:39.464565 642 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: No blocks or log segments found. Creating new log. I0301 23:03:39.464699 642 log.cc:525] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: Log is configured to *not* fsync() on all Append() calls I0301 23:03:39.464923 642 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: No bootstrap required, opened a new log I0301 23:03:39.465947 642 raft_consensus.cc:340] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } I0301 23:03:39.465975 642 raft_consensus.cc:366] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:03:39.465983 642 raft_consensus.cc:705] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642faa2effa145399932e0effe93e46d, State: Initialized, Role: FOLLOWER I0301 23:03:39.466027 642 consensus_queue.cc:229] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } I0301 23:03:39.466039 642 raft_consensus.cc:380] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0301 23:03:39.466047 642 raft_consensus.cc:472] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0301 23:03:39.466053 642 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 0 FOLLOWER]: Advancing to term 1 I0301 23:03:39.466428 642 raft_consensus.cc:494] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } I0301 23:03:39.466457 642 leader_election.cc:306] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 642faa2effa145399932e0effe93e46d; no voters: I0301 23:03:39.466526 642 leader_election.cc:292] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [CANDIDATE]: Term 1 election: Requested vote from peers I0301 23:03:39.466593 644 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:03:39.466701 644 raft_consensus.cc:667] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 1 LEADER]: Becoming Leader. State: Replica: 642faa2effa145399932e0effe93e46d, State: Running, Role: LEADER I0301 23:03:39.466744 644 consensus_queue.cc:206] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } I0301 23:03:39.466850 644 sys_catalog.cc:337] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 642faa2effa145399932e0effe93e46d. Latest consensus state: current_term: 1 leader_uuid: "642faa2effa145399932e0effe93e46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } } I0301 23:03:39.466859 642 sys_catalog.cc:337] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "642faa2effa145399932e0effe93e46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } } I0301 23:03:39.466887 645 sys_catalog.cc:337] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "642faa2effa145399932e0effe93e46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } } I0301 23:03:39.466899 642 sys_catalog.cc:340] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.466907 645 sys_catalog.cc:340] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.466996 642 sys_catalog.cc:424] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: configured and running, proceeding with master startup. I0301 23:03:39.467005 648 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:03:39.466881 644 sys_catalog.cc:340] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.467484 583 master_main.cc:86] Master server successfully started. I0301 23:03:39.467324 648 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:03:39.470968 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 583 I0301 23:03:39.471161 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:38773 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.484714 652 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.484799 652 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.485508 652 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.485544 652 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:03:39.486440 652 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:38773 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.652 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.487231 652 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:39.487419 652 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.487509 652 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.487536 652 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.487581 652 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:39.487596 652 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:39.488116 652 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/instance: uuid: "62ff118e95054d1baf98b9ad9bf36574" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.488304 652 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal/instance: uuid: "62ff118e95054d1baf98b9ad9bf36574" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.492424 652 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s I0301 23:03:39.492621 652 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.492696 652 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.493212 652 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.493244 652 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal uuid: "62ff118e95054d1baf98b9ad9bf36574" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.493273 652 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.500211 648 catalog_manager.cc:941] Generated new certificate authority record I0301 23:03:39.501118 648 catalog_manager.cc:1066] Loading token signing keys... I0301 23:03:39.503556 648 catalog_manager.cc:4095] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: Generated new TSK 0 I0301 23:03:39.508095 652 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.508314 652 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:39.508376 652 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:39.512459 652 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:35913 I0301 23:03:39.512516 652 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:03:39.512527 652 webserver.cc:186] Document root disabled I0301 23:03:39.512660 652 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:42799/ I0301 23:03:39.512785 652 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:03:39.513281 652 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:39.513494 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 652 I0301 23:03:39.517725 772 heartbeater.cc:345] Connected to a master server at 127.0.22.190:38773 I0301 23:03:39.517750 772 heartbeater.cc:425] Registering TS with master... I0301 23:03:39.517788 772 heartbeater.cc:474] Master 127.0.22.190:38773 requested a full tablet report, sending... I0301 23:03:39.542338 608 ts_manager.cc:98] Registered new tserver with Master: 62ff118e95054d1baf98b9ad9bf36574 (127.0.22.129:35913) I0301 23:03:39.542631 90 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0301 23:03:39.543076 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 652 I0301 23:03:39.543575 608 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:53851 W0301 23:03:39.545789 593 connection.cc:647] server connection from 127.0.22.129:53851 recv error: Network error: failed to read from TLS socket (remote: 0.0.0.0:0): Connection reset by peer (error 104) I0301 23:03:39.545816 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 583 W0301 23:03:39.549146 582 connection.cc:647] client connection to 127.0.22.190:38773 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:38773): Connection reset by peer (error 104) I0301 23:03:39.549360 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:38773 --webserver_interface=127.0.22.190 --webserver_port=32827 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.559363 779 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.559458 779 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.560257 779 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:03:39.560278 779 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.560283 779 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:03:39.560287 779 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:03:39.561278 779 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:38773 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=32827 --never_fsync=true --heap_profile_path=/tmp/kudu-master.779 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.562028 779 master_main.cc:80] Initializing master server... I0301 23:03:39.562160 779 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.562255 779 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.562285 779 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.562983 779 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:03:39.563151 779 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.563216 779 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.563729 779 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.563860 779 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal uuid: "642faa2effa145399932e0effe93e46d" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.563890 779 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.614476 779 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.614624 779 master_main.cc:83] Starting Master server... I0301 23:03:39.616837 779 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:38773 I0301 23:03:39.616899 779 webserver.cc:175] Starting webserver on 127.0.22.190:32827 I0301 23:03:39.616915 779 webserver.cc:186] Document root disabled I0301 23:03:39.617053 779 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:32827/ I0301 23:03:39.617185 779 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:03:39.617965 838 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: Bootstrap starting. I0301 23:03:39.621157 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 779 I0301 23:03:39.621336 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:35913 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_port=42799 --webserver_interface=127.0.22.129 --tserver_master_addrs=127.0.22.190:38773 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:39.623359 838 log.cc:525] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: Log is configured to *not* fsync() on all Append() calls I0301 23:03:39.624315 838 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:03:39.624560 838 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: Bootstrap complete. I0301 23:03:39.627223 838 raft_consensus.cc:340] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } I0301 23:03:39.627255 838 raft_consensus.cc:705] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 642faa2effa145399932e0effe93e46d, State: Initialized, Role: FOLLOWER I0301 23:03:39.627302 838 consensus_queue.cc:229] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } I0301 23:03:39.627324 838 raft_consensus.cc:380] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0301 23:03:39.627332 838 raft_consensus.cc:472] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0301 23:03:39.627341 838 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 1 FOLLOWER]: Advancing to term 2 I0301 23:03:39.628231 838 raft_consensus.cc:494] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } I0301 23:03:39.628265 838 leader_election.cc:306] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 642faa2effa145399932e0effe93e46d; no voters: I0301 23:03:39.628336 838 leader_election.cc:292] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [CANDIDATE]: Term 2 election: Requested vote from peers I0301 23:03:39.628422 841 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 2 FOLLOWER]: Leader election won for term 2 I0301 23:03:39.628494 841 raft_consensus.cc:667] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [term 2 LEADER]: Becoming Leader. State: Replica: 642faa2effa145399932e0effe93e46d, State: Running, Role: LEADER I0301 23:03:39.628540 841 consensus_queue.cc:206] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } I0301 23:03:39.628648 841 sys_catalog.cc:337] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "642faa2effa145399932e0effe93e46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } } I0301 23:03:39.628655 838 sys_catalog.cc:337] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "642faa2effa145399932e0effe93e46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } } I0301 23:03:39.628679 841 sys_catalog.cc:340] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.628688 838 sys_catalog.cc:340] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.628726 838 sys_catalog.cc:424] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: configured and running, proceeding with master startup. I0301 23:03:39.628756 841 sys_catalog.cc:337] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 642faa2effa145399932e0effe93e46d. Latest consensus state: current_term: 2 leader_uuid: "642faa2effa145399932e0effe93e46d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "642faa2effa145399932e0effe93e46d" member_type: VOTER } } I0301 23:03:39.628765 841 sys_catalog.cc:340] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.628985 779 master_main.cc:86] Master server successfully started. I0301 23:03:39.629825 846 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: acquiring CA information for follower catalog manager: success I0301 23:03:39.629948 846 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0301 23:03:39.632288 845 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:03:39.632411 845 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:03:39.632547 845 catalog_manager.cc:1066] Loading token signing keys... I0301 23:03:39.632604 845 catalog_manager.cc:4106] T 00000000000000000000000000000000 P 642faa2effa145399932e0effe93e46d: Loaded TSK: 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.633884 839 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.633975 839 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.634668 839 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.634698 839 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:03:39.635563 839 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:35913 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=42799 --tserver_master_addrs=127.0.22.190:38773 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.839 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.636406 839 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:39.636548 839 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.636624 839 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.636658 839 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.640342 839 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.000s sys 0.000s I0301 23:03:39.640489 839 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.640552 839 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.641099 839 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.641235 839 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal uuid: "62ff118e95054d1baf98b9ad9bf36574" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.641264 839 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.655858 839 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.656065 839 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:39.656128 839 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:39.659979 839 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:35913 I0301 23:03:39.660028 839 webserver.cc:175] Starting webserver on 127.0.22.129:42799 I0301 23:03:39.660046 839 webserver.cc:186] Document root disabled I0301 23:03:39.660208 839 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:42799/ I0301 23:03:39.660327 839 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_0.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:03:39.660814 839 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:39.664731 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 839 I0301 23:03:39.664865 967 heartbeater.cc:345] Connected to a master server at 127.0.22.190:38773 I0301 23:03:39.664922 967 heartbeater.cc:425] Registering TS with master... I0301 23:03:39.664988 967 heartbeater.cc:474] Master 127.0.22.190:38773 requested a full tablet report, sending... I0301 23:03:39.690699 805 ts_manager.cc:98] Registered new tserver with Master: 62ff118e95054d1baf98b9ad9bf36574 (127.0.22.129:35913) I0301 23:03:39.691045 90 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0301 23:03:39.691582 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 839 I0301 23:03:39.691880 805 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:58127 W0301 23:03:39.694339 787 connection.cc:647] server connection from 127.0.22.129:58127 recv error: Network error: failed to read from TLS socket (remote: 0.0.0.0:0): Connection reset by peer (error 104) I0301 23:03:39.694368 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 779 W0301 23:03:39.697070 582 connection.cc:647] client connection to 127.0.22.190:38773 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:38773): Connection reset by peer (error 104) [ OK ] TsLocationAssignmentITest.Basic/0 (270 ms) [ RUN ] TsLocationAssignmentITest.Basic/1 I0301 23:03:39.698689 90 test_util.cc:212] Using random seed: 1793430007 I0301 23:03:39.699095 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:42411 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:5 --map /L1:1 --map /L2:1 --map /L3:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.709271 973 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.709352 973 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.710117 973 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:03:39.710139 973 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.710142 973 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:03:39.710146 973 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:03:39.711164 973 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:5 --map /L1:1 --map /L2:1 --map /L3:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:42411 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.973 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.711932 973 master_main.cc:80] Initializing master server... I0301 23:03:39.712064 973 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.712159 973 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.712213 973 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.712255 973 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:39.712260 973 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:39.712802 973 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/instance: uuid: "5f83a99d85a4460094690664420c3578" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.712968 973 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal/instance: uuid: "5f83a99d85a4460094690664420c3578" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.713946 973 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s I0301 23:03:39.714139 973 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.714206 973 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.714718 973 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.714745 973 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal uuid: "5f83a99d85a4460094690664420c3578" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.714763 973 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.726691 973 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.726837 973 master_main.cc:83] Starting Master server... I0301 23:03:39.728780 973 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:42411 I0301 23:03:39.728823 973 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:03:39.728828 973 webserver.cc:186] Document root disabled I0301 23:03:39.728941 973 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:33197/ I0301 23:03:39.729038 973 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:03:39.729420 1032 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:03:39.730541 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 973 I0301 23:03:39.730746 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:39.730996 1032 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: Bootstrap starting. I0301 23:03:39.731271 1032 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: No blocks or log segments found. Creating new log. I0301 23:03:39.731464 1032 log.cc:525] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: Log is configured to *not* fsync() on all Append() calls I0301 23:03:39.731760 1032 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: No bootstrap required, opened a new log I0301 23:03:39.732847 1032 raft_consensus.cc:340] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } I0301 23:03:39.732874 1032 raft_consensus.cc:366] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:03:39.732883 1032 raft_consensus.cc:705] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f83a99d85a4460094690664420c3578, State: Initialized, Role: FOLLOWER I0301 23:03:39.732950 1032 consensus_queue.cc:229] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } I0301 23:03:39.732972 1032 raft_consensus.cc:380] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0301 23:03:39.732980 1032 raft_consensus.cc:472] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0301 23:03:39.732988 1032 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:03:39.733325 1032 raft_consensus.cc:494] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } I0301 23:03:39.733358 1032 leader_election.cc:306] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f83a99d85a4460094690664420c3578; no voters: I0301 23:03:39.733450 1032 leader_election.cc:292] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [CANDIDATE]: Term 1 election: Requested vote from peers I0301 23:03:39.733508 1035 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:03:39.733608 1035 raft_consensus.cc:667] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 1 LEADER]: Becoming Leader. State: Replica: 5f83a99d85a4460094690664420c3578, State: Running, Role: LEADER I0301 23:03:39.733655 1035 consensus_queue.cc:206] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } I0301 23:03:39.733775 1032 sys_catalog.cc:337] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "5f83a99d85a4460094690664420c3578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } } I0301 23:03:39.733803 1032 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.733778 1035 sys_catalog.cc:337] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f83a99d85a4460094690664420c3578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } } I0301 23:03:39.733826 1035 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.733865 1037 sys_catalog.cc:337] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f83a99d85a4460094690664420c3578. Latest consensus state: current_term: 1 leader_uuid: "5f83a99d85a4460094690664420c3578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } } I0301 23:03:39.733884 1037 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: This master's current role is: LEADER I0301 23:03:39.733984 1032 sys_catalog.cc:424] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:03:39.733991 1039 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:03:39.734398 973 master_main.cc:86] Master server successfully started. I0301 23:03:39.734355 1039 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.744019 1033 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.744128 1033 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.745226 1033 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.745270 1033 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:03:39.746533 1033 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.1033 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.747781 1033 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:39.747994 1033 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.748095 1033 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.748127 1033 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.748206 1033 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:39.748229 1033 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:39.748970 1033 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/instance: uuid: "3e08fb121ff24220ba9307068ac981c8" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.749163 1033 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal/instance: uuid: "3e08fb121ff24220ba9307068ac981c8" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.752362 1033 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s I0301 23:03:39.752650 1033 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.752729 1033 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.753448 1033 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.753489 1033 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal uuid: "3e08fb121ff24220ba9307068ac981c8" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.753512 1033 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.767473 1039 catalog_manager.cc:941] Generated new certificate authority record I0301 23:03:39.768360 1039 catalog_manager.cc:1066] Loading token signing keys... I0301 23:03:39.776631 1039 catalog_manager.cc:4095] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: Generated new TSK 0 I0301 23:03:39.809307 1033 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.809540 1033 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:39.809597 1033 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:39.813789 1033 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:40207 I0301 23:03:39.813859 1033 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:03:39.813882 1033 webserver.cc:186] Document root disabled I0301 23:03:39.814054 1033 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:37439/ I0301 23:03:39.814198 1033 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:03:39.814617 1033 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:39.818244 1162 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:39.818269 1162 heartbeater.cc:425] Registering TS with master... I0301 23:03:39.818308 1162 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:39.822968 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 1033 I0301 23:03:39.823179 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:0 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.833083 1167 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.833173 1167 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.833869 1167 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.833906 1167 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:03:39.834777 1167 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.1167 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.835587 1167 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:39.835749 1167 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.835837 1167 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.835866 1167 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.835911 1167 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:39.835927 1167 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:39.836531 1167 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/instance: uuid: "538908ce65aa450b85fd88e4c6bc942c" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.836693 1167 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal/instance: uuid: "538908ce65aa450b85fd88e4c6bc942c" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.837630 1167 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:03:39.837839 1167 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.837929 1167 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.838424 1167 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.838456 1167 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal uuid: "538908ce65aa450b85fd88e4c6bc942c" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.838480 1167 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.850620 999 ts_manager.cc:98] Registered new tserver with Master: 3e08fb121ff24220ba9307068ac981c8 (127.0.22.129:40207) I0301 23:03:39.851848 999 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:38489 I0301 23:03:39.856828 1167 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.857003 1167 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:39.857051 1167 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:39.860945 1167 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:36519 I0301 23:03:39.860988 1167 webserver.cc:175] Starting webserver on 127.0.22.130:0 I0301 23:03:39.861006 1167 webserver.cc:186] Document root disabled I0301 23:03:39.861124 1167 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:37165/ I0301 23:03:39.861224 1167 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:03:39.861546 1167 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:39.864274 1286 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:39.864295 1286 heartbeater.cc:425] Registering TS with master... I0301 23:03:39.864326 1286 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:39.864856 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 1167 I0301 23:03:39.865067 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:0 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.885422 1290 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.885509 1290 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.886204 1290 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.886240 1290 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:03:39.888440 1290 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.1290 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.889245 1290 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:39.889428 1290 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.889518 1290 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.889546 1290 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.889590 1290 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:39.889605 1290 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:39.890147 1290 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/instance: uuid: "d0470e9320d544e39029971cf8be764d" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.890314 1290 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal/instance: uuid: "d0470e9320d544e39029971cf8be764d" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.896351 1290 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.001s sys 0.001s I0301 23:03:39.896600 1290 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.896672 1290 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.897177 1290 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.897204 1290 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal uuid: "d0470e9320d544e39029971cf8be764d" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.897222 1290 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.902798 999 ts_manager.cc:98] Registered new tserver with Master: 538908ce65aa450b85fd88e4c6bc942c (127.0.22.130:36519) I0301 23:03:39.903666 999 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:58611 I0301 23:03:39.913859 1290 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.914111 1290 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:39.914170 1290 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:39.918514 1290 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:42583 I0301 23:03:39.918561 1290 webserver.cc:175] Starting webserver on 127.0.22.131:0 I0301 23:03:39.918568 1290 webserver.cc:186] Document root disabled I0301 23:03:39.918699 1290 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:32847/ I0301 23:03:39.918809 1290 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:03:39.919183 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 1290 I0301 23:03:39.919188 1290 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:39.919472 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:0 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:39.926429 1409 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:39.926452 1409 heartbeater.cc:425] Registering TS with master... I0301 23:03:39.926492 1409 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.930565 1412 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.930642 1412 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.931401 1412 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.931432 1412 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:03:39.936375 1412 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.1412 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:39.937160 1412 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:39.937290 1412 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:39.937369 1412 fs_manager.cc:263] Metadata directory not provided I0301 23:03:39.937405 1412 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:39.937446 1412 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:39.937467 1412 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:39.937996 1412 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/instance: uuid: "2fd755e168eb4c93bdcf39efb7dad987" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.938153 1412 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal/instance: uuid: "2fd755e168eb4c93bdcf39efb7dad987" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.939131 1412 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:39.939328 1412 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:39.939411 1412 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:39.939908 1412 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:39.939935 1412 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal uuid: "2fd755e168eb4c93bdcf39efb7dad987" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:39.939954 1412 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:39.959359 999 ts_manager.cc:98] Registered new tserver with Master: d0470e9320d544e39029971cf8be764d (127.0.22.131:42583) I0301 23:03:39.960234 999 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:60353 I0301 23:03:39.962340 1412 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:39.962563 1412 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:39.962623 1412 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:39.967578 1412 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:35901 I0301 23:03:39.967617 1412 webserver.cc:175] Starting webserver on 127.0.22.132:0 I0301 23:03:39.967622 1412 webserver.cc:186] Document root disabled I0301 23:03:39.967726 1412 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:46829/ I0301 23:03:39.967815 1412 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:03:39.968109 1412 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:39.970760 1532 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:39.970784 1532 heartbeater.cc:425] Registering TS with master... I0301 23:03:39.970819 1532 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:39.971496 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 1412 I0301 23:03:39.971688 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:0 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:39.994343 1536 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:39.994455 1536 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:39.995131 1536 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:39.995165 1536 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:03:39.996067 1536 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.1536 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.000948 1536 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.001070 1536 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25516us I0301 23:03:40.001135 1536 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.001159 1536 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.001190 1536 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:40.001196 1536 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:40.001710 1536 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/instance: uuid: "51f7d6d9c4524eceae8130f947d3b707" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.001847 1536 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal/instance: uuid: "51f7d6d9c4524eceae8130f947d3b707" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.002815 1536 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:40.003051 1536 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.003125 1536 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.003639 1536 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.003667 1536 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal uuid: "51f7d6d9c4524eceae8130f947d3b707" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.003685 1536 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.011831 999 ts_manager.cc:98] Registered new tserver with Master: 2fd755e168eb4c93bdcf39efb7dad987 (127.0.22.132:35901) I0301 23:03:40.012612 999 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.132:41811 I0301 23:03:40.033267 1536 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.033488 1536 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.033546 1536 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.038041 1536 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:41583 I0301 23:03:40.038082 1536 webserver.cc:175] Starting webserver on 127.0.22.133:0 I0301 23:03:40.038087 1536 webserver.cc:186] Document root disabled I0301 23:03:40.038183 1536 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:33287/ I0301 23:03:40.038281 1536 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:03:40.038594 1536 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.041492 1655 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.041514 1655 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.041543 1655 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:40.043579 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 1536 I0301 23:03:40.043823 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:0 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.066803 1659 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.066884 1659 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.067607 1659 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.067637 1659 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:03:40.072562 1659 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.1659 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.073354 1659 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.073509 1659 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.073585 1659 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.073616 1659 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.073658 1659 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:40.073689 1659 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:40.074221 1659 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/instance: uuid: "5944da6fde5e49d28e34981175f1be3d" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.074380 1659 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal/instance: uuid: "5944da6fde5e49d28e34981175f1be3d" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.075336 1659 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:40.075570 1659 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.075634 1659 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.076158 1659 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.076215 1659 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal uuid: "5944da6fde5e49d28e34981175f1be3d" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.076237 1659 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.082231 999 ts_manager.cc:98] Registered new tserver with Master: 51f7d6d9c4524eceae8130f947d3b707 (127.0.22.133:41583) I0301 23:03:40.082780 999 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.133:60443 I0301 23:03:40.092023 1659 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.092253 1659 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.092311 1659 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.096576 1659 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:35415 I0301 23:03:40.096626 1659 webserver.cc:175] Starting webserver on 127.0.22.134:0 I0301 23:03:40.096633 1659 webserver.cc:186] Document root disabled I0301 23:03:40.096741 1659 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:38083/ I0301 23:03:40.096846 1659 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:03:40.097148 1659 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.099310 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 1659 I0301 23:03:40.099577 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:0 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:40.099840 1778 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.099864 1778 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.099902 1778 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.119829 1781 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.119910 1781 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.124665 1781 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.124698 1781 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:03:40.125576 1781 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.1781 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.126358 1781 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.126514 1781 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.126595 1781 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.126622 1781 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.126663 1781 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:40.126680 1781 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:40.127212 1781 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/instance: uuid: "624ce36f411d47a4a4f651646ac49825" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.127364 1781 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal/instance: uuid: "624ce36f411d47a4a4f651646ac49825" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.132329 1781 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.000s sys 0.001s I0301 23:03:40.132560 1781 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.132627 1781 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.133147 1781 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.133183 1781 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal uuid: "624ce36f411d47a4a4f651646ac49825" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.133208 1781 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.143280 999 ts_manager.cc:98] Registered new tserver with Master: 5944da6fde5e49d28e34981175f1be3d (127.0.22.134:35415) I0301 23:03:40.143927 999 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.134:33989 I0301 23:03:40.186341 1781 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.186583 1781 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.186638 1781 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.191143 1781 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:36965 I0301 23:03:40.191185 1781 webserver.cc:175] Starting webserver on 127.0.22.135:0 I0301 23:03:40.191190 1781 webserver.cc:186] Document root disabled I0301 23:03:40.191321 1781 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:40493/ I0301 23:03:40.191457 1781 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:03:40.191857 1781 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.193414 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 1781 I0301 23:03:40.193631 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:0 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:40.195205 1901 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.195228 1901 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.195261 1901 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.210252 1904 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.210338 1904 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.211028 1904 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.211063 1904 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:03:40.211921 1904 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.1904 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.212764 1904 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.212903 1904 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.212988 1904 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.213016 1904 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.213058 1904 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:40.213076 1904 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:40.213608 1904 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/instance: uuid: "757ea656e1f54eb2a59f045467b26be7" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.213768 1904 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal/instance: uuid: "757ea656e1f54eb2a59f045467b26be7" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.214890 1904 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:40.215121 1904 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.215189 1904 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.215709 1904 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.215739 1904 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal uuid: "757ea656e1f54eb2a59f045467b26be7" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.215761 1904 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.226050 999 ts_manager.cc:98] Registered new tserver with Master: 624ce36f411d47a4a4f651646ac49825 (127.0.22.135:36965) I0301 23:03:40.226583 999 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.135:50093 I0301 23:03:40.231817 1904 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.232012 1904 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.232070 1904 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.236989 1904 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:34941 I0301 23:03:40.237047 1904 webserver.cc:175] Starting webserver on 127.0.22.136:0 I0301 23:03:40.237066 1904 webserver.cc:186] Document root disabled I0301 23:03:40.237196 1904 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:39531/ I0301 23:03:40.237304 1904 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:03:40.237772 1904 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.240381 2024 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.240420 2024 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.240460 2024 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:40.245415 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 1904 I0301 23:03:40.266763 999 ts_manager.cc:98] Registered new tserver with Master: 757ea656e1f54eb2a59f045467b26be7 (127.0.22.136:34941) I0301 23:03:40.267156 90 external_mini_cluster.cc:623] 8 TS(s) registered with all masters I0301 23:03:40.267442 999 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.136:42065 I0301 23:03:40.267794 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 1033 W0301 23:03:40.270637 983 connection.cc:647] server connection from 127.0.22.129:38489 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:38489): Connection reset by peer (error 104) I0301 23:03:40.270704 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 1167 W0301 23:03:40.273329 982 connection.cc:647] server connection from 127.0.22.130:58611 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:58611): Connection reset by peer (error 104) I0301 23:03:40.273345 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 1290 W0301 23:03:40.275784 981 connection.cc:647] server connection from 127.0.22.131:60353 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:60353): Connection reset by peer (error 104) I0301 23:03:40.275832 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 1412 W0301 23:03:40.278300 981 connection.cc:647] server connection from 127.0.22.132:41811 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:41811): Connection reset by peer (error 104) I0301 23:03:40.278400 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 1536 W0301 23:03:40.280668 981 connection.cc:647] server connection from 127.0.22.133:60443 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:60443): Connection reset by peer (error 104) I0301 23:03:40.280735 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 1659 W0301 23:03:40.282793 983 connection.cc:647] server connection from 127.0.22.134:33989 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:33989): Connection reset by peer (error 104) I0301 23:03:40.282853 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 1781 W0301 23:03:40.285274 982 connection.cc:647] server connection from 127.0.22.135:50093 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:50093): Connection reset by peer (error 104) I0301 23:03:40.285365 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 1904 W0301 23:03:40.287597 980 connection.cc:647] server connection from 127.0.22.136:42065 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:42065): Connection reset by peer (error 104) I0301 23:03:40.287652 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 973 W0301 23:03:40.290465 972 connection.cc:647] client connection to 127.0.22.190:42411 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:42411): Connection reset by peer (error 104) I0301 23:03:40.290644 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:42411 --webserver_interface=127.0.22.190 --webserver_port=33197 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:5 --map /L1:1 --map /L2:1 --map /L3:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.300678 2029 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.300757 2029 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.301558 2029 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:03:40.301579 2029 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.301586 2029 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:03:40.301591 2029 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:03:40.302598 2029 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:5 --map /L1:1 --map /L2:1 --map /L3:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:42411 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=33197 --never_fsync=true --heap_profile_path=/tmp/kudu-master.2029 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.303345 2029 master_main.cc:80] Initializing master server... I0301 23:03:40.303494 2029 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.303589 2029 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.303625 2029 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.304769 2029 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:40.304956 2029 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.305028 2029 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.305577 2029 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.305732 2029 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal uuid: "5f83a99d85a4460094690664420c3578" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.305766 2029 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.320484 2029 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.320633 2029 master_main.cc:83] Starting Master server... I0301 23:03:40.322497 2029 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:42411 I0301 23:03:40.322538 2029 webserver.cc:175] Starting webserver on 127.0.22.190:33197 I0301 23:03:40.322543 2029 webserver.cc:186] Document root disabled I0301 23:03:40.322659 2029 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:33197/ I0301 23:03:40.322785 2029 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:03:40.323429 2088 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: Bootstrap starting. I0301 23:03:40.328675 2088 log.cc:525] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: Log is configured to *not* fsync() on all Append() calls I0301 23:03:40.329187 2088 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:03:40.329356 2088 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: Bootstrap complete. I0301 23:03:40.331096 2088 raft_consensus.cc:340] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } I0301 23:03:40.331125 2088 raft_consensus.cc:705] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f83a99d85a4460094690664420c3578, State: Initialized, Role: FOLLOWER I0301 23:03:40.331173 2088 consensus_queue.cc:229] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } I0301 23:03:40.331195 2088 raft_consensus.cc:380] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0301 23:03:40.331204 2088 raft_consensus.cc:472] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0301 23:03:40.331212 2088 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 1 FOLLOWER]: Advancing to term 2 I0301 23:03:40.331833 2088 raft_consensus.cc:494] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } I0301 23:03:40.331866 2088 leader_election.cc:306] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f83a99d85a4460094690664420c3578; no voters: I0301 23:03:40.331936 2088 leader_election.cc:292] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [CANDIDATE]: Term 2 election: Requested vote from peers I0301 23:03:40.331972 2090 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 2 FOLLOWER]: Leader election won for term 2 I0301 23:03:40.332037 2090 raft_consensus.cc:667] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [term 2 LEADER]: Becoming Leader. State: Replica: 5f83a99d85a4460094690664420c3578, State: Running, Role: LEADER I0301 23:03:40.332078 2090 consensus_queue.cc:206] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } I0301 23:03:40.332216 2088 sys_catalog.cc:337] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "5f83a99d85a4460094690664420c3578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } } I0301 23:03:40.332227 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 2029 I0301 23:03:40.332234 2091 sys_catalog.cc:337] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f83a99d85a4460094690664420c3578. Latest consensus state: current_term: 2 leader_uuid: "5f83a99d85a4460094690664420c3578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } } I0301 23:03:40.332237 2088 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: This master's current role is: LEADER I0301 23:03:40.332345 2088 sys_catalog.cc:424] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:03:40.332259 2091 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: This master's current role is: LEADER I0301 23:03:40.332370 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:40207 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_port=37439 --webserver_interface=127.0.22.129 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:40.332552 2090 sys_catalog.cc:337] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "5f83a99d85a4460094690664420c3578" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f83a99d85a4460094690664420c3578" member_type: VOTER } } I0301 23:03:40.332682 2090 sys_catalog.cc:340] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578 [sys.catalog]: This master's current role is: LEADER I0301 23:03:40.332662 2029 master_main.cc:86] Master server successfully started. I0301 23:03:40.333578 2096 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: acquiring CA information for follower catalog manager: success I0301 23:03:40.333673 2096 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0301 23:03:40.333729 2094 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:03:40.333814 2094 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:03:40.333953 2094 catalog_manager.cc:1066] Loading token signing keys... I0301 23:03:40.334013 2094 catalog_manager.cc:4106] T 00000000000000000000000000000000 P 5f83a99d85a4460094690664420c3578: Loaded TSK: 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.344854 2098 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.344954 2098 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.345649 2098 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.345679 2098 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:03:40.346541 2098 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:40207 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=37439 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.2098 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.347327 2098 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.347481 2098 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.347558 2098 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.347594 2098 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.348363 2098 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.348510 2098 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.348572 2098 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.349092 2098 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.349231 2098 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal uuid: "3e08fb121ff24220ba9307068ac981c8" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.349261 2098 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.383754 2098 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.383966 2098 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.384027 2098 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.388733 2098 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:40207 I0301 23:03:40.388789 2098 webserver.cc:175] Starting webserver on 127.0.22.129:37439 I0301 23:03:40.388804 2098 webserver.cc:186] Document root disabled I0301 23:03:40.388957 2098 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:37439/ I0301 23:03:40.389099 2098 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:03:40.389523 2098 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.397652 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 2098 I0301 23:03:40.397824 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:36519 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_port=37165 --webserver_interface=127.0.22.130 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:40.398751 2217 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.398780 2217 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.398818 2217 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.424672 2221 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.424793 2221 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.425813 2221 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.425858 2221 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:03:40.427093 2221 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:36519 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=37165 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.2221 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.432374 2221 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.432591 2221 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.432684 2221 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.432723 2221 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.436375 2221 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s I0301 23:03:40.436524 2221 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.436599 2221 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.437104 2221 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.437253 2221 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal uuid: "538908ce65aa450b85fd88e4c6bc942c" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.437289 2221 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.449862 2055 ts_manager.cc:98] Registered new tserver with Master: 3e08fb121ff24220ba9307068ac981c8 (127.0.22.129:40207) I0301 23:03:40.451181 2055 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:49159 I0301 23:03:40.495087 2221 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.495272 2221 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.495319 2221 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.499408 2221 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:36519 I0301 23:03:40.499465 2221 webserver.cc:175] Starting webserver on 127.0.22.130:37165 I0301 23:03:40.499486 2221 webserver.cc:186] Document root disabled I0301 23:03:40.499601 2221 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:37165/ I0301 23:03:40.499708 2221 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:03:40.500005 2221 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.500805 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 2221 I0301 23:03:40.501003 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:42583 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_port=32847 --webserver_interface=127.0.22.131 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:40.502979 2341 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.503006 2341 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.503048 2341 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.515405 2344 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.515486 2344 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.516155 2344 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.520277 2344 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:03:40.521204 2344 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:42583 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=32847 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.2344 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.522001 2344 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.522150 2344 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.522213 2344 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.522245 2344 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.528359 2344 fs_manager.cc:399] Time spent opening directory manager: real 0.006s user 0.000s sys 0.001s I0301 23:03:40.528517 2344 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.528578 2344 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.529134 2344 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.529273 2344 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal uuid: "d0470e9320d544e39029971cf8be764d" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.529304 2344 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.537742 2055 ts_manager.cc:98] Registered new tserver with Master: 538908ce65aa450b85fd88e4c6bc942c (127.0.22.130:36519) I0301 23:03:40.538277 2055 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:56259 I0301 23:03:40.564612 2344 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.564813 2344 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.564877 2344 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.568893 2344 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:42583 I0301 23:03:40.568943 2344 webserver.cc:175] Starting webserver on 127.0.22.131:32847 I0301 23:03:40.568961 2344 webserver.cc:186] Document root disabled I0301 23:03:40.569082 2344 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:32847/ I0301 23:03:40.569197 2344 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:03:40.569689 2344 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.572413 2464 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.572437 2464 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.572476 2464 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:40.572999 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 2344 I0301 23:03:40.573148 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:35901 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_port=46829 --webserver_interface=127.0.22.132 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.591689 2467 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.591765 2467 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.596601 2467 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.596634 2467 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:03:40.597494 2467 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:35901 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=46829 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.2467 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.598273 2467 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.598451 2467 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.598531 2467 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.598562 2467 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.599217 2467 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:03:40.599359 2467 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.599449 2467 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.599959 2467 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.600098 2467 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal uuid: "2fd755e168eb4c93bdcf39efb7dad987" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.600142 2467 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.610800 2055 ts_manager.cc:98] Registered new tserver with Master: d0470e9320d544e39029971cf8be764d (127.0.22.131:42583) I0301 23:03:40.611340 2055 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:40737 I0301 23:03:40.664680 2467 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.664882 2467 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.664955 2467 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.668032 2467 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:35901 I0301 23:03:40.668087 2467 webserver.cc:175] Starting webserver on 127.0.22.132:46829 I0301 23:03:40.668100 2467 webserver.cc:186] Document root disabled I0301 23:03:40.668315 2467 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:46829/ I0301 23:03:40.668483 2467 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:03:40.669013 2467 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.671583 2587 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.671609 2587 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.671675 2587 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:40.675619 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 2467 I0301 23:03:40.675798 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:41583 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_port=33287 --webserver_interface=127.0.22.133 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.697728 2591 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.697808 2591 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.698495 2591 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.698523 2591 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:03:40.699337 2591 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:41583 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=33287 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.2591 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.700152 2591 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.704435 2591 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.704505 2591 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.704535 2591 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.705202 2591 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:03:40.705349 2591 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.705444 2591 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.706065 2591 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.706218 2591 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal uuid: "51f7d6d9c4524eceae8130f947d3b707" format_stamp: "Formatted at 2019-03-01 23:03:39 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.706254 2591 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.709782 2055 ts_manager.cc:98] Registered new tserver with Master: 2fd755e168eb4c93bdcf39efb7dad987 (127.0.22.132:35901) I0301 23:03:40.710314 2055 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.132:56813 I0301 23:03:40.728616 2591 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.728811 2591 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.728873 2591 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.733287 2591 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:41583 I0301 23:03:40.733347 2591 webserver.cc:175] Starting webserver on 127.0.22.133:33287 I0301 23:03:40.733364 2591 webserver.cc:186] Document root disabled I0301 23:03:40.733505 2591 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:33287/ I0301 23:03:40.733688 2591 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:03:40.734022 2591 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.736703 2710 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.736727 2710 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.736765 2710 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:40.741566 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 2591 I0301 23:03:40.741720 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:35415 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_port=38083 --webserver_interface=127.0.22.134 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.761209 2714 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.761296 2714 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.762004 2714 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.762035 2714 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:03:40.762895 2714 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:35415 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=38083 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.2714 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.763697 2714 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.763859 2714 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.763939 2714 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.763978 2714 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.768756 2714 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.768889 2714 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.768972 2714 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.769496 2714 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.769629 2714 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal uuid: "5944da6fde5e49d28e34981175f1be3d" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.769662 2714 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.773614 2055 ts_manager.cc:98] Registered new tserver with Master: 51f7d6d9c4524eceae8130f947d3b707 (127.0.22.133:41583) I0301 23:03:40.774457 2055 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.133:33247 I0301 23:03:40.792611 2714 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.792783 2714 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.792834 2714 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.796710 2714 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:35415 I0301 23:03:40.796751 2714 webserver.cc:175] Starting webserver on 127.0.22.134:38083 I0301 23:03:40.796756 2714 webserver.cc:186] Document root disabled I0301 23:03:40.796865 2714 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:38083/ I0301 23:03:40.797001 2714 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:03:40.797273 2714 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.800089 2833 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.800109 2833 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.800139 2833 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:40.805274 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 2714 I0301 23:03:40.805438 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:36965 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_port=40493 --webserver_interface=127.0.22.135 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.825680 2837 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.825769 2837 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.826468 2837 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.826500 2837 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:03:40.827335 2837 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:36965 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=40493 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.2837 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.828136 2837 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.832331 2837 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.832448 2837 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.832484 2837 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.833273 2837 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:03:40.833431 2837 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.833492 2837 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.834018 2837 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.834151 2837 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal uuid: "624ce36f411d47a4a4f651646ac49825" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.834188 2837 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.838765 2055 ts_manager.cc:98] Registered new tserver with Master: 5944da6fde5e49d28e34981175f1be3d (127.0.22.134:35415) I0301 23:03:40.839278 2055 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.134:46199 I0301 23:03:40.898537 2837 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.898741 2837 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.898799 2837 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.902693 2837 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:36965 I0301 23:03:40.902767 2837 webserver.cc:175] Starting webserver on 127.0.22.135:40493 I0301 23:03:40.902787 2837 webserver.cc:186] Document root disabled I0301 23:03:40.902911 2837 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:40493/ I0301 23:03:40.903057 2837 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:03:40.903296 2837 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.906246 2956 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.906270 2956 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.906301 2956 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:40.909981 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 2837 I0301 23:03:40.910200 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:34941 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_port=39531 --webserver_interface=127.0.22.136 --tserver_master_addrs=127.0.22.190:42411 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:40.929518 2960 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:40.929603 2960 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:40.930272 2960 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:40.930300 2960 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:03:40.931216 2960 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:34941 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=39531 --tserver_master_addrs=127.0.22.190:42411 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.2960 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:40.932088 2960 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:40.936277 2960 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0301 23:03:40.936347 2960 fs_manager.cc:263] Metadata directory not provided I0301 23:03:40.936374 2960 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:40.937119 2960 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:03:40.937255 2960 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:40.937328 2960 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:40.937914 2960 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:40.938061 2960 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal uuid: "757ea656e1f54eb2a59f045467b26be7" format_stamp: "Formatted at 2019-03-01 23:03:40 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:40.938096 2960 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:40.944365 2055 ts_manager.cc:98] Registered new tserver with Master: 624ce36f411d47a4a4f651646ac49825 (127.0.22.135:36965) I0301 23:03:40.945196 2055 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.135:52491 I0301 23:03:40.970996 2960 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:40.971169 2960 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:40.971215 2960 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:40.975062 2960 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:34941 I0301 23:03:40.975119 2960 webserver.cc:175] Starting webserver on 127.0.22.136:39531 I0301 23:03:40.975143 2960 webserver.cc:186] Document root disabled I0301 23:03:40.975270 2960 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:39531/ I0301 23:03:40.975414 2960 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_1.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:03:40.975788 2960 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:40.978368 3079 heartbeater.cc:345] Connected to a master server at 127.0.22.190:42411 I0301 23:03:40.978401 3079 heartbeater.cc:425] Registering TS with master... I0301 23:03:40.978451 3079 heartbeater.cc:474] Master 127.0.22.190:42411 requested a full tablet report, sending... I0301 23:03:40.983621 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 2960 I0301 23:03:41.005285 2055 ts_manager.cc:98] Registered new tserver with Master: 757ea656e1f54eb2a59f045467b26be7 (127.0.22.136:34941) I0301 23:03:41.005790 90 external_mini_cluster.cc:623] 8 TS(s) registered with all masters I0301 23:03:41.005980 2055 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.136:57153 I0301 23:03:41.006422 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 2098 W0301 23:03:41.009315 2039 connection.cc:647] server connection from 127.0.22.129:49159 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:49159): Connection reset by peer (error 104) I0301 23:03:41.009368 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 2221 W0301 23:03:41.011817 2037 connection.cc:647] server connection from 127.0.22.130:56259 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:56259): Connection reset by peer (error 104) I0301 23:03:41.011878 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 2344 W0301 23:03:41.014087 2037 connection.cc:647] server connection from 127.0.22.131:40737 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:40737): Connection reset by peer (error 104) I0301 23:03:41.014166 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 2467 W0301 23:03:41.016332 2038 connection.cc:647] server connection from 127.0.22.132:56813 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:56813): Connection reset by peer (error 104) I0301 23:03:41.016403 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 2591 W0301 23:03:41.018466 2038 connection.cc:647] server connection from 127.0.22.133:33247 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:33247): Connection reset by peer (error 104) I0301 23:03:41.018505 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 2714 W0301 23:03:41.020663 2037 connection.cc:647] server connection from 127.0.22.134:46199 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:46199): Connection reset by peer (error 104) I0301 23:03:41.020727 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 2837 W0301 23:03:41.023283 2037 connection.cc:647] server connection from 127.0.22.135:52491 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:52491): Connection reset by peer (error 104) I0301 23:03:41.023352 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 2960 W0301 23:03:41.025766 2039 connection.cc:647] server connection from 127.0.22.136:57153 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:57153): Connection reset by peer (error 104) I0301 23:03:41.025795 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 2029 W0301 23:03:41.028442 972 connection.cc:647] client connection to 127.0.22.190:42411 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:42411): Connection reset by peer (error 104) [ OK ] TsLocationAssignmentITest.Basic/1 (1334 ms) [ RUN ] TsLocationAssignmentITest.Basic/2 I0301 23:03:41.032780 90 test_util.cc:212] Using random seed: 1794764107 I0301 23:03:41.033175 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:41601 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:11 --map /L1:3 --map /L2:1 --map /L3:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.043181 3085 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.043260 3085 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.044029 3085 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:03:41.044049 3085 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.044054 3085 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:03:41.044057 3085 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:03:41.045075 3085 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:11 --map /L1:3 --map /L2:1 --map /L3:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:41601 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.3085 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.045837 3085 master_main.cc:80] Initializing master server... I0301 23:03:41.045961 3085 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.046036 3085 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.046056 3085 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.046083 3085 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.046095 3085 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.046622 3085 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/instance: uuid: "005ef592064548249fc4a9e2d86af113" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.046753 3085 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal/instance: uuid: "005ef592064548249fc4a9e2d86af113" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.047668 3085 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:41.047866 3085 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.047940 3085 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.048625 3085 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.048657 3085 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal uuid: "005ef592064548249fc4a9e2d86af113" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.048681 3085 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.069829 3085 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.069977 3085 master_main.cc:83] Starting Master server... I0301 23:03:41.071880 3085 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:41601 I0301 23:03:41.071936 3085 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:03:41.071945 3085 webserver.cc:186] Document root disabled I0301 23:03:41.072046 3085 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:32795/ I0301 23:03:41.072135 3085 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:03:41.072487 3144 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:03:41.073984 3144 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: Bootstrap starting. I0301 23:03:41.074213 3144 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: No blocks or log segments found. Creating new log. I0301 23:03:41.074345 3144 log.cc:525] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: Log is configured to *not* fsync() on all Append() calls I0301 23:03:41.074609 3144 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: No bootstrap required, opened a new log I0301 23:03:41.074729 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 3085 I0301 23:03:41.074940 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.075637 3144 raft_consensus.cc:340] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } I0301 23:03:41.075667 3144 raft_consensus.cc:366] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:03:41.075675 3144 raft_consensus.cc:705] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ef592064548249fc4a9e2d86af113, State: Initialized, Role: FOLLOWER I0301 23:03:41.075721 3144 consensus_queue.cc:229] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } I0301 23:03:41.075742 3144 raft_consensus.cc:380] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0301 23:03:41.075750 3144 raft_consensus.cc:472] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0301 23:03:41.075758 3144 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:03:41.076110 3144 raft_consensus.cc:494] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } I0301 23:03:41.076141 3144 leader_election.cc:306] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 005ef592064548249fc4a9e2d86af113; no voters: I0301 23:03:41.076225 3144 leader_election.cc:292] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [CANDIDATE]: Term 1 election: Requested vote from peers I0301 23:03:41.076304 3144 sys_catalog.cc:337] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } } I0301 23:03:41.076323 3144 sys_catalog.cc:340] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:03:41.076357 3144 sys_catalog.cc:424] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:03:41.076483 3147 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:03:41.076655 3085 master_main.cc:86] Master server successfully started. I0301 23:03:41.076740 3147 raft_consensus.cc:667] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 1 LEADER]: Becoming Leader. State: Replica: 005ef592064548249fc4a9e2d86af113, State: Running, Role: LEADER I0301 23:03:41.076773 3147 consensus_queue.cc:206] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } I0301 23:03:41.076885 3147 sys_catalog.cc:337] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 005ef592064548249fc4a9e2d86af113. Latest consensus state: current_term: 1 leader_uuid: "005ef592064548249fc4a9e2d86af113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } } I0301 23:03:41.076918 3147 sys_catalog.cc:340] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: This master's current role is: LEADER I0301 23:03:41.076896 3148 sys_catalog.cc:337] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "005ef592064548249fc4a9e2d86af113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } } I0301 23:03:41.076968 3148 sys_catalog.cc:340] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: This master's current role is: LEADER W0301 23:03:41.077172 3149 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:03:41.077199 3149 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:03:41.077241 3152 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:03:41.077358 3152 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.087600 3146 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.087702 3146 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.088708 3146 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.088739 3146 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:03:41.089928 3146 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.3146 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.091104 3146 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.091281 3146 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.091364 3146 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.091409 3146 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.091456 3146 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.091478 3146 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.092190 3146 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/instance: uuid: "85eeca9fe45e4e0c908a01ca1f4a7fdb" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.092366 3146 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal/instance: uuid: "85eeca9fe45e4e0c908a01ca1f4a7fdb" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.096379 3146 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.000s I0301 23:03:41.096633 3146 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.096704 3146 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.097373 3146 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.097421 3146 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal uuid: "85eeca9fe45e4e0c908a01ca1f4a7fdb" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.097450 3146 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.128314 3152 catalog_manager.cc:941] Generated new certificate authority record I0301 23:03:41.129191 3152 catalog_manager.cc:1066] Loading token signing keys... I0301 23:03:41.135468 3152 catalog_manager.cc:4095] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: Generated new TSK 0 I0301 23:03:41.142354 3146 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.142581 3146 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.142642 3146 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.145948 3146 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:35291 I0301 23:03:41.146008 3146 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:03:41.146021 3146 webserver.cc:186] Document root disabled I0301 23:03:41.146147 3146 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:45495/ I0301 23:03:41.146273 3146 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:03:41.146536 3146 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.146939 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 3146 I0301 23:03:41.147197 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:0 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.156198 3274 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.156222 3274 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.156261 3274 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.162194 3276 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.162299 3276 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.163295 3276 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.163338 3276 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:03:41.164682 3276 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.3276 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.165871 3276 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.166059 3276 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.166158 3276 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.166190 3276 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.166235 3276 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.166256 3276 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.166982 3276 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/instance: uuid: "bdc1b7c5df32480aa8441a9e67f8e050" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.167179 3276 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal/instance: uuid: "bdc1b7c5df32480aa8441a9e67f8e050" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.180842 3276 fs_manager.cc:503] Time spent creating directory manager: real 0.014s user 0.000s sys 0.003s I0301 23:03:41.181074 3276 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.181180 3276 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.181735 3276 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.181769 3276 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal uuid: "bdc1b7c5df32480aa8441a9e67f8e050" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.181800 3276 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.198523 3111 ts_manager.cc:98] Registered new tserver with Master: 85eeca9fe45e4e0c908a01ca1f4a7fdb (127.0.22.129:35291) I0301 23:03:41.199779 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:47925 I0301 23:03:41.214959 3276 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.215159 3276 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.215222 3276 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.218890 3276 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:43363 I0301 23:03:41.218952 3276 webserver.cc:175] Starting webserver on 127.0.22.130:0 I0301 23:03:41.218971 3276 webserver.cc:186] Document root disabled I0301 23:03:41.219117 3276 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:40263/ I0301 23:03:41.219216 3276 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:03:41.219298 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 3276 I0301 23:03:41.219463 3276 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.219545 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:0 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.224007 3398 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.224040 3398 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.224081 3398 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.233171 3400 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.233279 3400 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.234308 3400 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.234359 3400 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:03:41.235621 3400 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.3400 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.236821 3400 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.237035 3400 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.237141 3400 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.237181 3400 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.237227 3400 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.237252 3400 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.237969 3400 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/instance: uuid: "749f1ba3b001425fa05e2b26a2577901" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.238167 3400 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal/instance: uuid: "749f1ba3b001425fa05e2b26a2577901" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.240365 3400 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s I0301 23:03:41.240644 3400 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.240733 3400 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.241442 3400 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.241483 3400 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal uuid: "749f1ba3b001425fa05e2b26a2577901" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.241508 3400 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.259024 3111 ts_manager.cc:98] Registered new tserver with Master: bdc1b7c5df32480aa8441a9e67f8e050 (127.0.22.130:43363) I0301 23:03:41.259604 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:37685 I0301 23:03:41.265244 3400 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.265472 3400 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.265528 3400 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.269064 3400 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:36227 I0301 23:03:41.269109 3400 webserver.cc:175] Starting webserver on 127.0.22.131:0 I0301 23:03:41.269114 3400 webserver.cc:186] Document root disabled I0301 23:03:41.269223 3400 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:33185/ I0301 23:03:41.269335 3400 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:03:41.269654 3400 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.271628 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 3400 I0301 23:03:41.271858 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:0 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.272599 3521 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.272624 3521 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.272655 3521 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.287583 3524 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.287693 3524 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.288734 3524 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.288784 3524 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:03:41.290010 3524 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.3524 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.291226 3524 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.291453 3524 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.291551 3524 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.291585 3524 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.291631 3524 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.291652 3524 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.292376 3524 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/instance: uuid: "7f00a062fe41490abc7b6f20f8c832de" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.292596 3524 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal/instance: uuid: "7f00a062fe41490abc7b6f20f8c832de" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.296396 3524 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s I0301 23:03:41.296633 3524 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.296710 3524 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.297230 3524 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.297262 3524 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal uuid: "7f00a062fe41490abc7b6f20f8c832de" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.297289 3524 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.304836 3111 ts_manager.cc:98] Registered new tserver with Master: 749f1ba3b001425fa05e2b26a2577901 (127.0.22.131:36227) I0301 23:03:41.305342 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:49253 I0301 23:03:41.308357 3524 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.308581 3524 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.308645 3524 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.312119 3524 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:44907 I0301 23:03:41.312202 3524 webserver.cc:175] Starting webserver on 127.0.22.132:0 I0301 23:03:41.312227 3524 webserver.cc:186] Document root disabled I0301 23:03:41.312356 3524 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:33313/ I0301 23:03:41.312479 3524 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:03:41.312845 3524 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.313688 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 3524 I0301 23:03:41.313951 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:0 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.315733 3644 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.315758 3644 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.315786 3644 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.328161 3647 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.332312 3647 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.333082 3647 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.333117 3647 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:03:41.334009 3647 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.3647 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.334807 3647 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.334983 3647 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.335075 3647 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.335103 3647 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.335144 3647 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.335160 3647 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.335701 3647 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/instance: uuid: "620ce422346d437289bb63780c6e8f05" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.335878 3647 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal/instance: uuid: "620ce422346d437289bb63780c6e8f05" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.340952 3647 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.002s sys 0.000s I0301 23:03:41.341161 3647 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.341228 3647 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.341836 3647 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.341866 3647 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal uuid: "620ce422346d437289bb63780c6e8f05" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.341882 3647 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.351858 3111 ts_manager.cc:98] Registered new tserver with Master: 7f00a062fe41490abc7b6f20f8c832de (127.0.22.132:44907) I0301 23:03:41.352469 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.132:52385 I0301 23:03:41.359329 3647 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.359586 3647 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.359645 3647 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.363078 3647 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:34651 I0301 23:03:41.363126 3647 webserver.cc:175] Starting webserver on 127.0.22.133:0 I0301 23:03:41.363131 3647 webserver.cc:186] Document root disabled I0301 23:03:41.363240 3647 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:37085/ I0301 23:03:41.363335 3647 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:03:41.363631 3647 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.365983 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 3647 I0301 23:03:41.366241 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:0 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.366616 3767 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.366650 3767 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.366699 3767 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.381068 3770 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.381186 3770 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.382201 3770 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.382251 3770 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:03:41.383522 3770 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.3770 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.384747 3770 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.384944 3770 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.385044 3770 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.385084 3770 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.385129 3770 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.385149 3770 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.385874 3770 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/instance: uuid: "5f34d0105df9492584436c973dafa7a4" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.386070 3770 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal/instance: uuid: "5f34d0105df9492584436c973dafa7a4" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.388372 3770 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.001s sys 0.002s I0301 23:03:41.388664 3770 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.388749 3770 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.389439 3770 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.389480 3770 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal uuid: "5f34d0105df9492584436c973dafa7a4" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.389506 3770 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.401554 3111 ts_manager.cc:98] Registered new tserver with Master: 620ce422346d437289bb63780c6e8f05 (127.0.22.133:34651) I0301 23:03:41.402122 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.133:34065 I0301 23:03:41.463346 3770 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.463584 3770 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.463642 3770 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.468423 3770 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:43045 I0301 23:03:41.468487 3770 webserver.cc:175] Starting webserver on 127.0.22.134:0 I0301 23:03:41.468503 3770 webserver.cc:186] Document root disabled I0301 23:03:41.468643 3770 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:40975/ I0301 23:03:41.468767 3770 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:03:41.469154 3770 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.469616 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 3770 I0301 23:03:41.469830 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:0 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.472265 3890 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.472298 3890 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.472338 3890 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.480429 3893 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.480518 3893 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.481227 3893 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.481266 3893 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:03:41.482101 3893 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.3893 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.482939 3893 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.483103 3893 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.483176 3893 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.483203 3893 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.483234 3893 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.483237 3893 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.483745 3893 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/instance: uuid: "c531e40d89dd43bebfae2c15e133a584" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.483889 3893 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal/instance: uuid: "c531e40d89dd43bebfae2c15e133a584" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.484905 3893 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:03:41.485163 3893 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.485249 3893 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.485855 3893 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.485888 3893 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal uuid: "c531e40d89dd43bebfae2c15e133a584" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.485913 3893 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.498164 3111 ts_manager.cc:98] Registered new tserver with Master: 5f34d0105df9492584436c973dafa7a4 (127.0.22.134:43045) I0301 23:03:41.498731 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.134:51485 I0301 23:03:41.527534 3893 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.527751 3893 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.527817 3893 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.532344 3893 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:42975 I0301 23:03:41.532416 3893 webserver.cc:175] Starting webserver on 127.0.22.135:0 I0301 23:03:41.532443 3893 webserver.cc:186] Document root disabled I0301 23:03:41.532567 3893 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:40589/ I0301 23:03:41.532680 3893 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:03:41.533015 3893 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.536089 4013 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.536119 4013 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.536154 4013 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:41.542062 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 3893 I0301 23:03:41.542285 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:0 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.561856 4017 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.561944 4017 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.562623 4017 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.562656 4017 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:03:41.563511 4017 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.4017 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.568341 4017 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.568512 4017 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.568586 4017 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.568608 4017 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.568641 4017 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.568655 4017 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.569208 4017 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/instance: uuid: "8915b061c3a046b5ad4bbf1ec2d716bd" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.569360 4017 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal/instance: uuid: "8915b061c3a046b5ad4bbf1ec2d716bd" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.570384 4017 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:41.570662 4017 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.570753 4017 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.571293 4017 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.571331 4017 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal uuid: "8915b061c3a046b5ad4bbf1ec2d716bd" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.571359 4017 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.575065 3111 ts_manager.cc:98] Registered new tserver with Master: c531e40d89dd43bebfae2c15e133a584 (127.0.22.135:42975) I0301 23:03:41.575966 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.135:43405 I0301 23:03:41.640333 4017 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.640561 4017 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.640627 4017 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.644606 4017 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:36679 I0301 23:03:41.644678 4017 webserver.cc:175] Starting webserver on 127.0.22.136:0 I0301 23:03:41.644683 4017 webserver.cc:186] Document root disabled I0301 23:03:41.644832 4017 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:36833/ I0301 23:03:41.644974 4017 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:03:41.645396 4017 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.646090 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 4017 I0301 23:03:41.646273 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data --block_manager=log --rpc_bind_addresses=127.0.22.137:0 --local_ip_for_outbound_sockets=127.0.22.137 --webserver_interface=127.0.22.137 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.648645 4136 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.648679 4136 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.648708 4136 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.665215 4139 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.665300 4139 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.665977 4139 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.666012 4139 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.137 I0301 23:03:41.666900 4139 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.137:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/info.pb --webserver_interface=127.0.22.137 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.4139 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.137 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.667701 4139 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.667824 4139 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.667898 4139 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.667918 4139 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.667949 4139 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.667979 4139 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.668686 4139 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/instance: uuid: "1ee4a6ada6c84b069c8ff1175e36ac9d" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.668892 4139 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal/instance: uuid: "1ee4a6ada6c84b069c8ff1175e36ac9d" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.669931 4139 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s I0301 23:03:41.670136 4139 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.670209 4139 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.670963 4139 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.671001 4139 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal uuid: "1ee4a6ada6c84b069c8ff1175e36ac9d" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.671025 4139 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.685004 3111 ts_manager.cc:98] Registered new tserver with Master: 8915b061c3a046b5ad4bbf1ec2d716bd (127.0.22.136:36679) I0301 23:03:41.685672 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.136:36583 I0301 23:03:41.713268 4139 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.713503 4139 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.713578 4139 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.718425 4139 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.137:44657 I0301 23:03:41.718488 4139 webserver.cc:175] Starting webserver on 127.0.22.137:0 I0301 23:03:41.718494 4139 webserver.cc:186] Document root disabled I0301 23:03:41.718667 4139 webserver.cc:313] Webserver started. Bound to: http://127.0.22.137:46845/ I0301 23:03:41.718811 4139 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/info.pb I0301 23:03:41.719075 4139 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.722177 4259 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.722203 4259 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.722244 4259 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:41.728808 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 4139 I0301 23:03:41.729110 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data --block_manager=log --rpc_bind_addresses=127.0.22.138:0 --local_ip_for_outbound_sockets=127.0.22.138 --webserver_interface=127.0.22.138 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.745425 4263 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.745532 4263 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.746579 4263 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.746628 4263 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.138 I0301 23:03:41.747853 4263 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.138:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/info.pb --webserver_interface=127.0.22.138 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.4263 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.138 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.749125 4263 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.749297 4263 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.749419 4263 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.749459 4263 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.749503 4263 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.749529 4263 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.750244 4263 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/instance: uuid: "f9cbc7b5b35040a584293aa6a853dc66" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.750464 4263 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal/instance: uuid: "f9cbc7b5b35040a584293aa6a853dc66" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.751842 4263 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s I0301 23:03:41.752041 4263 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.752107 4263 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.752707 4263 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.752764 4263 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal uuid: "f9cbc7b5b35040a584293aa6a853dc66" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.752785 4263 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.756722 3111 ts_manager.cc:98] Registered new tserver with Master: 1ee4a6ada6c84b069c8ff1175e36ac9d (127.0.22.137:44657) I0301 23:03:41.757292 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.137:55717 I0301 23:03:41.793920 4263 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.794106 4263 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.794155 4263 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.798889 4263 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.138:38789 I0301 23:03:41.798955 4263 webserver.cc:175] Starting webserver on 127.0.22.138:0 I0301 23:03:41.798962 4263 webserver.cc:186] Document root disabled I0301 23:03:41.799119 4263 webserver.cc:313] Webserver started. Bound to: http://127.0.22.138:45715/ I0301 23:03:41.799273 4263 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/info.pb I0301 23:03:41.799921 4263 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.801579 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 4263 I0301 23:03:41.801812 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data --block_manager=log --rpc_bind_addresses=127.0.22.139:0 --local_ip_for_outbound_sockets=127.0.22.139 --webserver_interface=127.0.22.139 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:41.803119 4382 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.803143 4382 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.803174 4382 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.821710 4385 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.821801 4385 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.822474 4385 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.822504 4385 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.139 I0301 23:03:41.823348 4385 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.139:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/info.pb --webserver_interface=127.0.22.139 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.4385 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.139 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.824142 4385 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.828299 4385 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.828377 4385 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.828409 4385 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.828441 4385 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.828471 4385 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.828987 4385 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/instance: uuid: "2f6da60eaa86415a9d7beab4e1ccd60f" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.829125 4385 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal/instance: uuid: "2f6da60eaa86415a9d7beab4e1ccd60f" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.830077 4385 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:41.830287 4385 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.830361 4385 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.831019 4385 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.831055 4385 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal uuid: "2f6da60eaa86415a9d7beab4e1ccd60f" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.831079 4385 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.841998 3111 ts_manager.cc:98] Registered new tserver with Master: f9cbc7b5b35040a584293aa6a853dc66 (127.0.22.138:38789) I0301 23:03:41.842607 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.138:49905 I0301 23:03:41.892210 4385 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:41.892465 4385 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:41.892526 4385 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:41.898396 4385 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.139:41641 I0301 23:03:41.898458 4385 webserver.cc:175] Starting webserver on 127.0.22.139:0 I0301 23:03:41.898464 4385 webserver.cc:186] Document root disabled I0301 23:03:41.898586 4385 webserver.cc:313] Webserver started. Bound to: http://127.0.22.139:42173/ I0301 23:03:41.898700 4385 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/info.pb I0301 23:03:41.899394 4385 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:41.902369 4505 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:41.902410 4505 heartbeater.cc:425] Registering TS with master... I0301 23:03:41.902453 4505 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:41.905120 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 4385 I0301 23:03:41.905323 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data --block_manager=log --rpc_bind_addresses=127.0.22.140:0 --local_ip_for_outbound_sockets=127.0.22.140 --webserver_interface=127.0.22.140 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:41.927594 4509 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:41.927685 4509 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:41.932447 4509 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:41.932487 4509 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.140 I0301 23:03:41.933401 4509 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.140:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/info.pb --webserver_interface=127.0.22.140 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.4509 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.140 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:41.934201 4509 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:41.934343 4509 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0301 23:03:41.934494 4509 fs_manager.cc:263] Metadata directory not provided I0301 23:03:41.934525 4509 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:41.934571 4509 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:41.934587 4509 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:41.935153 4509 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/instance: uuid: "dfad632bf1b641f7924c7f00b90f47a9" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.935324 4509 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal/instance: uuid: "dfad632bf1b641f7924c7f00b90f47a9" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.940474 4509 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.000s sys 0.001s I0301 23:03:41.940665 4509 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:41.940729 4509 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:41.941313 4509 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:41.941362 4509 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal uuid: "dfad632bf1b641f7924c7f00b90f47a9" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:41.941409 4509 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:41.945781 3111 ts_manager.cc:98] Registered new tserver with Master: 2f6da60eaa86415a9d7beab4e1ccd60f (127.0.22.139:41641) I0301 23:03:41.946305 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.139:60383 I0301 23:03:42.000831 4509 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.001049 4509 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.001106 4509 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.005367 4509 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.140:36887 I0301 23:03:42.005425 4509 webserver.cc:175] Starting webserver on 127.0.22.140:0 I0301 23:03:42.005439 4509 webserver.cc:186] Document root disabled I0301 23:03:42.005597 4509 webserver.cc:313] Webserver started. Bound to: http://127.0.22.140:34237/ I0301 23:03:42.005743 4509 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/info.pb I0301 23:03:42.006093 4509 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.010586 4628 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.010607 4628 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.010645 4628 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:42.010854 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 4509 I0301 23:03:42.011075 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data --block_manager=log --rpc_bind_addresses=127.0.22.141:0 --local_ip_for_outbound_sockets=127.0.22.141 --webserver_interface=127.0.22.141 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.025662 4631 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.025753 4631 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.026412 4631 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.026446 4631 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.141 I0301 23:03:42.028128 4631 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.141:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/info.pb --webserver_interface=127.0.22.141 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.4631 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.141 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.028980 4631 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.029120 4631 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.029192 4631 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.029218 4631 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.029248 4631 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:42.029253 4631 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:42.029765 4631 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/instance: uuid: "bd37061b59444122a94027df2e49d387" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.029906 4631 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal/instance: uuid: "bd37061b59444122a94027df2e49d387" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.032441 4631 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s I0301 23:03:42.032620 4631 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.032678 4631 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.033202 4631 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.033233 4631 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal uuid: "bd37061b59444122a94027df2e49d387" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.033253 4631 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.044095 3111 ts_manager.cc:98] Registered new tserver with Master: dfad632bf1b641f7924c7f00b90f47a9 (127.0.22.140:36887) I0301 23:03:42.044750 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.140:55803 I0301 23:03:42.071094 4631 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.071279 4631 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.071432 4631 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.076637 4631 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.141:41907 I0301 23:03:42.076704 4631 webserver.cc:175] Starting webserver on 127.0.22.141:0 I0301 23:03:42.076737 4631 webserver.cc:186] Document root disabled I0301 23:03:42.076885 4631 webserver.cc:313] Webserver started. Bound to: http://127.0.22.141:40237/ I0301 23:03:42.077014 4631 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/info.pb I0301 23:03:42.077360 4631 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.080106 4751 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.080132 4751 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.080189 4751 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:42.083990 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 4631 I0301 23:03:42.084260 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data --block_manager=log --rpc_bind_addresses=127.0.22.142:0 --local_ip_for_outbound_sockets=127.0.22.142 --webserver_interface=127.0.22.142 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.105798 4755 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.105901 4755 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.106915 4755 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.106963 4755 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.142 I0301 23:03:42.109460 4755 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.142:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/info.pb --webserver_interface=127.0.22.142 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.4755 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.142 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.110671 4755 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.110862 4755 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.110965 4755 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.111006 4755 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.111052 4755 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:42.111091 4755 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:42.111815 4755 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/instance: uuid: "43687df4fc27498a86f32fc21eb80d71" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.112061 4755 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal/instance: uuid: "43687df4fc27498a86f32fc21eb80d71" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.113535 4755 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:42.113797 4755 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.113925 4755 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.114711 4755 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.114755 4755 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal uuid: "43687df4fc27498a86f32fc21eb80d71" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.114784 4755 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.119983 3111 ts_manager.cc:98] Registered new tserver with Master: bd37061b59444122a94027df2e49d387 (127.0.22.141:41907) I0301 23:03:42.120577 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.141:39801 I0301 23:03:42.151065 4755 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.151273 4755 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.151338 4755 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.156361 4755 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.142:34109 I0301 23:03:42.156437 4755 webserver.cc:175] Starting webserver on 127.0.22.142:0 I0301 23:03:42.156460 4755 webserver.cc:186] Document root disabled I0301 23:03:42.156579 4755 webserver.cc:313] Webserver started. Bound to: http://127.0.22.142:41751/ I0301 23:03:42.156689 4755 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/info.pb I0301 23:03:42.156960 4755 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.159495 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 4755 I0301 23:03:42.159684 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data --block_manager=log --rpc_bind_addresses=127.0.22.143:0 --local_ip_for_outbound_sockets=127.0.22.143 --webserver_interface=127.0.22.143 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:42.160706 4874 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.160732 4874 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.160771 4874 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.175182 4877 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.175266 4877 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.175940 4877 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.175976 4877 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.143 I0301 23:03:42.176854 4877 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.143:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/info.pb --webserver_interface=127.0.22.143 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.4877 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.143 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.177640 4877 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.177765 4877 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.177850 4877 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.177870 4877 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.177907 4877 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:42.177928 4877 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:42.178490 4877 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/instance: uuid: "b0f105f239bf40979372bcfe165b1988" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.178627 4877 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal/instance: uuid: "b0f105f239bf40979372bcfe165b1988" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.180094 4877 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:42.180953 4877 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.181041 4877 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.181833 4877 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.181879 4877 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal uuid: "b0f105f239bf40979372bcfe165b1988" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.181905 4877 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.199615 3111 ts_manager.cc:98] Registered new tserver with Master: 43687df4fc27498a86f32fc21eb80d71 (127.0.22.142:34109) I0301 23:03:42.200202 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.142:45829 I0301 23:03:42.200570 3274 heartbeater.cc:466] Master 127.0.22.190:41601 was elected leader, sending a full tablet report... I0301 23:03:42.221343 4877 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.221629 4877 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.221675 4877 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.226442 4877 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.143:38287 I0301 23:03:42.226516 4877 webserver.cc:175] Starting webserver on 127.0.22.143:0 I0301 23:03:42.226534 4877 webserver.cc:186] Document root disabled I0301 23:03:42.226651 4877 webserver.cc:313] Webserver started. Bound to: http://127.0.22.143:33649/ I0301 23:03:42.226752 4877 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/info.pb I0301 23:03:42.227030 4877 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.230221 4997 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.230250 4997 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.230283 4997 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:42.231674 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 4877 I0301 23:03:42.231891 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data --block_manager=log --rpc_bind_addresses=127.0.22.144:0 --local_ip_for_outbound_sockets=127.0.22.144 --webserver_interface=127.0.22.144 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.254065 5001 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.254153 5001 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.254849 5001 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.254884 5001 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.144 I0301 23:03:42.255784 5001 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.144:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/info.pb --webserver_interface=127.0.22.144 --webserver_port=0 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.5001 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.144 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.260257 3398 heartbeater.cc:466] Master 127.0.22.190:41601 was elected leader, sending a full tablet report... I0301 23:03:42.260776 5001 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.260915 5001 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.261004 5001 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.261044 5001 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.261085 5001 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:42.261090 5001 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:42.261773 5001 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/instance: uuid: "61b368dd839f491cbcaf1d0e1a168236" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.261953 5001 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal/instance: uuid: "61b368dd839f491cbcaf1d0e1a168236" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.263289 5001 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s I0301 23:03:42.263523 5001 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.263590 5001 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.264128 5001 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.264156 5001 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal uuid: "61b368dd839f491cbcaf1d0e1a168236" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.264199 5001 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.273196 3111 ts_manager.cc:98] Registered new tserver with Master: b0f105f239bf40979372bcfe165b1988 (127.0.22.143:38287) I0301 23:03:42.273833 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.143:45977 I0301 23:03:42.284512 5001 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.284693 5001 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.284790 5001 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.289494 5001 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.144:35203 I0301 23:03:42.289561 5001 webserver.cc:175] Starting webserver on 127.0.22.144:0 I0301 23:03:42.289566 5001 webserver.cc:186] Document root disabled I0301 23:03:42.289724 5001 webserver.cc:313] Webserver started. Bound to: http://127.0.22.144:34549/ I0301 23:03:42.289880 5001 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/info.pb I0301 23:03:42.290207 5001 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.293098 5120 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.293124 5120 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.293165 5120 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:42.297947 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 5001 I0301 23:03:42.306150 3521 heartbeater.cc:466] Master 127.0.22.190:41601 was elected leader, sending a full tablet report... I0301 23:03:42.318718 3111 ts_manager.cc:98] Registered new tserver with Master: 61b368dd839f491cbcaf1d0e1a168236 (127.0.22.144:35203) I0301 23:03:42.319249 90 external_mini_cluster.cc:623] 16 TS(s) registered with all masters I0301 23:03:42.319489 3111 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.144:43765 I0301 23:03:42.320068 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 3146 W0301 23:03:42.323016 3095 connection.cc:647] server connection from 127.0.22.129:47925 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:47925): Connection reset by peer (error 104) I0301 23:03:42.323089 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 3276 W0301 23:03:42.325573 3095 connection.cc:647] server connection from 127.0.22.130:37685 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:37685): Connection reset by peer (error 104) I0301 23:03:42.325682 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 3400 W0301 23:03:42.328646 3095 connection.cc:647] server connection from 127.0.22.131:49253 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:49253): Connection reset by peer (error 104) I0301 23:03:42.328737 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 3524 W0301 23:03:42.331429 3092 connection.cc:647] server connection from 127.0.22.132:52385 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:52385): Connection reset by peer (error 104) I0301 23:03:42.331470 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 3647 W0301 23:03:42.334086 3094 connection.cc:647] server connection from 127.0.22.133:34065 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:34065): Connection reset by peer (error 104) I0301 23:03:42.334147 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 3770 W0301 23:03:42.336495 3094 connection.cc:647] server connection from 127.0.22.134:51485 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:51485): Connection reset by peer (error 104) I0301 23:03:42.336567 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 3893 W0301 23:03:42.338989 3093 connection.cc:647] server connection from 127.0.22.135:43405 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:43405): Connection reset by peer (error 104) I0301 23:03:42.339052 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 4017 W0301 23:03:42.341526 3094 connection.cc:647] server connection from 127.0.22.136:36583 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:36583): Connection reset by peer (error 104) I0301 23:03:42.341565 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 4139 W0301 23:03:42.344071 3094 connection.cc:647] server connection from 127.0.22.137:55717 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:55717): Connection reset by peer (error 104) I0301 23:03:42.344159 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 4263 W0301 23:03:42.346514 3093 connection.cc:647] server connection from 127.0.22.138:49905 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:49905): Connection reset by peer (error 104) I0301 23:03:42.346565 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 4385 W0301 23:03:42.349206 3094 connection.cc:647] server connection from 127.0.22.139:60383 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:60383): Connection reset by peer (error 104) I0301 23:03:42.349288 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 4509 W0301 23:03:42.351414 3094 connection.cc:647] server connection from 127.0.22.140:55803 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:55803): Connection reset by peer (error 104) I0301 23:03:42.351505 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 4631 W0301 23:03:42.354770 3093 connection.cc:647] server connection from 127.0.22.141:39801 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:39801): Connection reset by peer (error 104) I0301 23:03:42.354820 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 4755 W0301 23:03:42.357242 3095 connection.cc:647] server connection from 127.0.22.142:45829 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:45829): Connection reset by peer (error 104) I0301 23:03:42.357316 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 4877 W0301 23:03:42.360687 3095 connection.cc:647] server connection from 127.0.22.143:45977 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:45977): Connection reset by peer (error 104) I0301 23:03:42.360808 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 5001 W0301 23:03:42.363358 3093 connection.cc:647] server connection from 127.0.22.144:43765 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:43765): Connection reset by peer (error 104) I0301 23:03:42.363415 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 3085 W0301 23:03:42.366502 3084 connection.cc:647] client connection to 127.0.22.190:41601 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:41601): Connection reset by peer (error 104) I0301 23:03:42.366721 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:41601 --webserver_interface=127.0.22.190 --webserver_port=32795 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:11 --map /L1:3 --map /L2:1 --map /L3:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.376935 5125 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.377020 5125 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.377795 5125 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:03:42.377820 5125 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.377825 5125 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:03:42.377828 5125 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:03:42.378918 5125 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:11 --map /L1:3 --map /L2:1 --map /L3:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:41601 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=32795 --never_fsync=true --heap_profile_path=/tmp/kudu-master.5125 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.379675 5125 master_main.cc:80] Initializing master server... I0301 23:03:42.379804 5125 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.379885 5125 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.379917 5125 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.380873 5125 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.381040 5125 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.381103 5125 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.381639 5125 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.381801 5125 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal uuid: "005ef592064548249fc4a9e2d86af113" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.381839 5125 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.399288 5125 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.399461 5125 master_main.cc:83] Starting Master server... I0301 23:03:42.401867 5125 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:41601 I0301 23:03:42.401931 5125 webserver.cc:175] Starting webserver on 127.0.22.190:32795 I0301 23:03:42.401937 5125 webserver.cc:186] Document root disabled I0301 23:03:42.402047 5125 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:32795/ I0301 23:03:42.402211 5125 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:03:42.402900 5184 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: Bootstrap starting. I0301 23:03:42.408157 5184 log.cc:525] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: Log is configured to *not* fsync() on all Append() calls I0301 23:03:42.408318 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 5125 I0301 23:03:42.408514 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:35291 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_port=45495 --webserver_interface=127.0.22.129 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:42.408803 5184 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:03:42.409014 5184 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: Bootstrap complete. I0301 23:03:42.410800 5184 raft_consensus.cc:340] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } I0301 23:03:42.410832 5184 raft_consensus.cc:705] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 005ef592064548249fc4a9e2d86af113, State: Initialized, Role: FOLLOWER I0301 23:03:42.410877 5184 consensus_queue.cc:229] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } I0301 23:03:42.410912 5184 raft_consensus.cc:380] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0301 23:03:42.410920 5184 raft_consensus.cc:472] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0301 23:03:42.410926 5184 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 1 FOLLOWER]: Advancing to term 2 I0301 23:03:42.411547 5184 raft_consensus.cc:494] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } I0301 23:03:42.411583 5184 leader_election.cc:306] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 005ef592064548249fc4a9e2d86af113; no voters: I0301 23:03:42.411634 5184 leader_election.cc:292] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [CANDIDATE]: Term 2 election: Requested vote from peers I0301 23:03:42.411679 5184 sys_catalog.cc:337] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } } I0301 23:03:42.411711 5184 sys_catalog.cc:340] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:03:42.411736 5184 sys_catalog.cc:424] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:03:42.411995 5125 master_main.cc:86] Master server successfully started. I0301 23:03:42.416235 5187 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 2 FOLLOWER]: Leader election won for term 2 I0301 23:03:42.416306 5187 raft_consensus.cc:667] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [term 2 LEADER]: Becoming Leader. State: Replica: 005ef592064548249fc4a9e2d86af113, State: Running, Role: LEADER I0301 23:03:42.416362 5187 consensus_queue.cc:206] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } I0301 23:03:42.416445 5187 sys_catalog.cc:337] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "005ef592064548249fc4a9e2d86af113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } } I0301 23:03:42.416471 5187 sys_catalog.cc:340] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: This master's current role is: LEADER I0301 23:03:42.416522 5187 sys_catalog.cc:337] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 005ef592064548249fc4a9e2d86af113. Latest consensus state: current_term: 2 leader_uuid: "005ef592064548249fc4a9e2d86af113" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "005ef592064548249fc4a9e2d86af113" member_type: VOTER } } I0301 23:03:42.416541 5187 sys_catalog.cc:340] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113 [sys.catalog]: This master's current role is: LEADER I0301 23:03:42.417446 5189 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: acquiring CA information for follower catalog manager: success I0301 23:03:42.417548 5189 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0301 23:03:42.420308 5192 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:03:42.420583 5192 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:03:42.420779 5192 catalog_manager.cc:1066] Loading token signing keys... I0301 23:03:42.420835 5192 catalog_manager.cc:4106] T 00000000000000000000000000000000 P 005ef592064548249fc4a9e2d86af113: Loaded TSK: 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.428881 5186 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.428967 5186 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.429685 5186 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.429720 5186 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:03:42.430578 5186 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:35291 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=45495 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.5186 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.431355 5186 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.431519 5186 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.431608 5186 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.431646 5186 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.436436 5186 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.000s sys 0.001s I0301 23:03:42.436584 5186 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.436666 5186 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.437240 5186 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.437407 5186 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal uuid: "85eeca9fe45e4e0c908a01ca1f4a7fdb" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.437446 5186 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.450747 5186 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.450929 5186 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.450990 5186 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.455513 5186 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:35291 I0301 23:03:42.455570 5186 webserver.cc:175] Starting webserver on 127.0.22.129:45495 I0301 23:03:42.455576 5186 webserver.cc:186] Document root disabled I0301 23:03:42.455701 5186 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:45495/ I0301 23:03:42.455832 5186 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:03:42.456131 5186 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.463158 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 5186 I0301 23:03:42.463287 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:43363 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_port=40263 --webserver_interface=127.0.22.130 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:42.464284 5313 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.464319 5313 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.464365 5313 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.489435 5317 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.489528 5317 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.490197 5317 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.490229 5317 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:03:42.491117 5317 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:43363 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=40263 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.5317 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.491890 5317 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.492049 5317 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.492120 5317 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.500234 5317 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.500973 5317 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:03:42.501130 5317 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.501221 5317 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.501828 5317 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.501991 5317 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal uuid: "bdc1b7c5df32480aa8441a9e67f8e050" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.502034 5317 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.518491 5317 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.518707 5317 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.518796 5317 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.522001 5317 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:43363 I0301 23:03:42.522051 5317 webserver.cc:175] Starting webserver on 127.0.22.130:40263 I0301 23:03:42.522055 5317 webserver.cc:186] Document root disabled I0301 23:03:42.522173 5317 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:40263/ I0301 23:03:42.522298 5317 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:03:42.522583 5317 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.525595 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 5317 I0301 23:03:42.525715 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:36227 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_port=33185 --webserver_interface=127.0.22.131 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:42.525813 5437 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.525832 5437 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.525871 5437 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:42.526044 5151 ts_manager.cc:98] Registered new tserver with Master: 85eeca9fe45e4e0c908a01ca1f4a7fdb (127.0.22.129:35291) I0301 23:03:42.528036 5151 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:49413 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.548303 5440 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.548413 5440 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.549108 5440 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.549146 5440 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:03:42.550045 5440 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:36227 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=33185 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.5440 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.550873 5440 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.551033 5440 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.551107 5440 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.551143 5440 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.551858 5440 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:03:42.551982 5440 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.552052 5440 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.552588 5440 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.552736 5440 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal uuid: "749f1ba3b001425fa05e2b26a2577901" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.552774 5440 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.563421 5147 ts_manager.cc:98] Registered new tserver with Master: bdc1b7c5df32480aa8441a9e67f8e050 (127.0.22.130:43363) I0301 23:03:42.564126 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:44317 I0301 23:03:42.610285 5440 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.610512 5440 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.610569 5440 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.614955 5440 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:36227 I0301 23:03:42.615025 5440 webserver.cc:175] Starting webserver on 127.0.22.131:33185 I0301 23:03:42.615029 5440 webserver.cc:186] Document root disabled I0301 23:03:42.615172 5440 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:33185/ I0301 23:03:42.615331 5440 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:03:42.616343 5440 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.618099 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 5440 I0301 23:03:42.618238 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:44907 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_port=33313 --webserver_interface=127.0.22.132 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:42.618594 5560 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.618616 5560 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.618654 5560 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.636868 5563 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.636963 5563 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.637634 5563 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.637667 5563 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:03:42.638548 5563 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:44907 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=33313 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.5563 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.639348 5563 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.639515 5563 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.639590 5563 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.639623 5563 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.640338 5563 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:03:42.640478 5563 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.640544 5563 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.641090 5563 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.641225 5563 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal uuid: "7f00a062fe41490abc7b6f20f8c832de" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.641258 5563 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.655524 5147 ts_manager.cc:98] Registered new tserver with Master: 749f1ba3b001425fa05e2b26a2577901 (127.0.22.131:36227) I0301 23:03:42.656103 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:34095 I0301 23:03:42.666466 5563 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.666667 5563 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.666723 5563 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.670053 5563 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:44907 I0301 23:03:42.670109 5563 webserver.cc:175] Starting webserver on 127.0.22.132:33313 I0301 23:03:42.670114 5563 webserver.cc:186] Document root disabled I0301 23:03:42.670223 5563 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:33313/ I0301 23:03:42.670349 5563 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:03:42.670709 5563 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.673774 5683 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.673808 5683 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.673854 5683 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:42.680291 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 5563 I0301 23:03:42.680454 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:34651 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_port=37085 --webserver_interface=127.0.22.133 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.690482 5687 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.690585 5687 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.691246 5687 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.691282 5687 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:03:42.692133 5687 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:34651 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=37085 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.5687 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.692970 5687 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.693126 5687 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.693198 5687 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.693233 5687 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.693929 5687 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:03:42.694141 5687 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.694218 5687 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.694772 5687 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.694929 5687 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal uuid: "620ce422346d437289bb63780c6e8f05" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.695041 5687 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.698701 5147 ts_manager.cc:98] Registered new tserver with Master: 7f00a062fe41490abc7b6f20f8c832de (127.0.22.132:44907) I0301 23:03:42.699237 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.132:56601 I0301 23:03:42.725888 5687 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.726104 5687 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.726167 5687 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.730350 5687 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:34651 I0301 23:03:42.730417 5687 webserver.cc:175] Starting webserver on 127.0.22.133:37085 I0301 23:03:42.730422 5687 webserver.cc:186] Document root disabled I0301 23:03:42.730546 5687 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:37085/ I0301 23:03:42.730654 5687 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:03:42.730937 5687 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.732133 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 5687 I0301 23:03:42.732288 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:43045 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_port=40975 --webserver_interface=127.0.22.134 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:42.734210 5806 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.734246 5806 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.734287 5806 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.746377 5809 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.746477 5809 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.747146 5809 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.747180 5809 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:03:42.748009 5809 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:43045 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=40975 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.5809 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.752856 5809 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.753017 5809 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.753088 5809 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.753119 5809 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.756434 5809 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s I0301 23:03:42.756577 5809 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.756649 5809 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.757262 5809 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.757428 5809 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal uuid: "5f34d0105df9492584436c973dafa7a4" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.757467 5809 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.768568 5147 ts_manager.cc:98] Registered new tserver with Master: 620ce422346d437289bb63780c6e8f05 (127.0.22.133:34651) I0301 23:03:42.769181 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.133:37993 I0301 23:03:42.791702 5809 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.791924 5809 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.791980 5809 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.796043 5809 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:43045 I0301 23:03:42.796093 5809 webserver.cc:175] Starting webserver on 127.0.22.134:40975 I0301 23:03:42.796098 5809 webserver.cc:186] Document root disabled I0301 23:03:42.796250 5809 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:40975/ I0301 23:03:42.796375 5809 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:03:42.796780 5809 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.799659 5929 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.799692 5929 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.799726 5929 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:42.804288 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 5809 I0301 23:03:42.804451 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:42975 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_port=40589 --webserver_interface=127.0.22.135 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.825712 5933 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.825805 5933 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.826470 5933 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.826504 5933 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:03:42.827345 5933 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:42975 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=40589 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.5933 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.828143 5933 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.832335 5933 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.832428 5933 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.832463 5933 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.833200 5933 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:03:42.833326 5933 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.833415 5933 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.833919 5933 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.834049 5933 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal uuid: "c531e40d89dd43bebfae2c15e133a584" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.834084 5933 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.837062 5147 ts_manager.cc:98] Registered new tserver with Master: 5f34d0105df9492584436c973dafa7a4 (127.0.22.134:43045) I0301 23:03:42.837673 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.134:60173 I0301 23:03:42.851850 5933 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.852056 5933 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.852113 5933 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.855952 5933 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:42975 I0301 23:03:42.856001 5933 webserver.cc:175] Starting webserver on 127.0.22.135:40589 I0301 23:03:42.856007 5933 webserver.cc:186] Document root disabled I0301 23:03:42.856134 5933 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:40589/ I0301 23:03:42.856317 5933 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:03:42.856907 5933 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.859297 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 5933 I0301 23:03:42.859494 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:36679 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_port=36833 --webserver_interface=127.0.22.136 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:42.859556 6052 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.859568 6052 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.859604 6052 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.878041 6055 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.878125 6055 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.878818 6055 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.878851 6055 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:03:42.879740 6055 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:36679 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=36833 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.6055 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.884577 6055 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.884727 6055 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.884799 6055 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.884829 6055 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.885525 6055 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:03:42.885679 6055 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.885782 6055 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.886299 6055 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.886469 6055 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal uuid: "8915b061c3a046b5ad4bbf1ec2d716bd" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.886510 6055 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.896339 5147 ts_manager.cc:98] Registered new tserver with Master: c531e40d89dd43bebfae2c15e133a584 (127.0.22.135:42975) I0301 23:03:42.896878 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.135:48753 I0301 23:03:42.929798 6055 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:42.930022 6055 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:42.930083 6055 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:42.935200 6055 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:36679 I0301 23:03:42.935257 6055 webserver.cc:175] Starting webserver on 127.0.22.136:36833 I0301 23:03:42.935266 6055 webserver.cc:186] Document root disabled I0301 23:03:42.935416 6055 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:36833/ I0301 23:03:42.935546 6055 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:03:42.935921 6055 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:42.938827 6175 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:42.938853 6175 heartbeater.cc:425] Registering TS with master... I0301 23:03:42.938882 6175 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:42.942215 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 6055 I0301 23:03:42.942363 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data --block_manager=log --rpc_bind_addresses=127.0.22.137:44657 --local_ip_for_outbound_sockets=127.0.22.137 --webserver_port=46845 --webserver_interface=127.0.22.137 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:42.961725 6179 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:42.961810 6179 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:42.962515 6179 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:42.962549 6179 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.137 I0301 23:03:42.963424 6179 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.137:44657 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/info.pb --webserver_interface=127.0.22.137 --webserver_port=46845 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.6179 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.137 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:42.968323 6179 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:42.968497 6179 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0301 23:03:42.968581 6179 fs_manager.cc:263] Metadata directory not provided I0301 23:03:42.968622 6179 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:42.969367 6179 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:03:42.969524 6179 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:42.969596 6179 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:42.970137 6179 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:42.970294 6179 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal uuid: "1ee4a6ada6c84b069c8ff1175e36ac9d" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:42.970331 6179 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:42.976101 5147 ts_manager.cc:98] Registered new tserver with Master: 8915b061c3a046b5ad4bbf1ec2d716bd (127.0.22.136:36679) I0301 23:03:42.976683 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.136:47391 I0301 23:03:43.019220 6179 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.019457 6179 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.019515 6179 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.023162 6179 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.137:44657 I0301 23:03:43.023221 6179 webserver.cc:175] Starting webserver on 127.0.22.137:46845 I0301 23:03:43.023226 6179 webserver.cc:186] Document root disabled I0301 23:03:43.023358 6179 webserver.cc:313] Webserver started. Bound to: http://127.0.22.137:46845/ I0301 23:03:43.023514 6179 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-8/data/info.pb I0301 23:03:43.023870 6179 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.025754 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 6179 I0301 23:03:43.025893 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data --block_manager=log --rpc_bind_addresses=127.0.22.138:38789 --local_ip_for_outbound_sockets=127.0.22.138 --webserver_port=45715 --webserver_interface=127.0.22.138 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:43.027180 6298 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:43.027209 6298 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.027243 6298 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:43.054280 5147 ts_manager.cc:98] Registered new tserver with Master: 1ee4a6ada6c84b069c8ff1175e36ac9d (127.0.22.137:44657) I0301 23:03:43.054913 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.137:47117 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.162413 6301 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.162526 6301 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.163225 6301 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.163261 6301 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.138 I0301 23:03:43.164193 6301 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.138:38789 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/info.pb --webserver_interface=127.0.22.138 --webserver_port=45715 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.6301 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.138 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.165045 6301 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.165221 6301 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.165314 6301 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.165356 6301 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.166085 6301 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.166254 6301 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.166359 6301 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.166929 6301 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.167086 6301 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal uuid: "f9cbc7b5b35040a584293aa6a853dc66" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.167136 6301 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.185498 6301 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.185705 6301 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.185757 6301 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.189687 6301 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.138:38789 I0301 23:03:43.189762 6301 webserver.cc:175] Starting webserver on 127.0.22.138:45715 I0301 23:03:43.189780 6301 webserver.cc:186] Document root disabled I0301 23:03:43.189944 6301 webserver.cc:313] Webserver started. Bound to: http://127.0.22.138:45715/ I0301 23:03:43.190078 6301 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-9/data/info.pb I0301 23:03:43.190347 6301 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.193419 6421 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:43.193446 6421 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.193476 6421 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:43.199218 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 6301 I0301 23:03:43.199430 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data --block_manager=log --rpc_bind_addresses=127.0.22.139:41641 --local_ip_for_outbound_sockets=127.0.22.139 --webserver_port=42173 --webserver_interface=127.0.22.139 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.216711 6425 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.216819 6425 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.217841 6425 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.217905 6425 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.139 I0301 23:03:43.219209 6425 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.139:41641 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/info.pb --webserver_interface=127.0.22.139 --webserver_port=42173 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.6425 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.139 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.220454 6425 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.220646 6425 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.220749 6425 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.220796 6425 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.224406 6425 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s I0301 23:03:43.224597 6425 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.224679 6425 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.225450 6425 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.225620 6425 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal uuid: "2f6da60eaa86415a9d7beab4e1ccd60f" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.225667 6425 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.226193 5147 ts_manager.cc:98] Registered new tserver with Master: f9cbc7b5b35040a584293aa6a853dc66 (127.0.22.138:38789) I0301 23:03:43.226743 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.138:49797 I0301 23:03:43.245481 6425 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.245693 6425 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.245749 6425 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.250218 6425 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.139:41641 I0301 23:03:43.250272 6425 webserver.cc:175] Starting webserver on 127.0.22.139:42173 I0301 23:03:43.250277 6425 webserver.cc:186] Document root disabled I0301 23:03:43.250416 6425 webserver.cc:313] Webserver started. Bound to: http://127.0.22.139:42173/ I0301 23:03:43.250556 6425 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-10/data/info.pb I0301 23:03:43.250845 6425 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.253629 6544 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:43.253657 6544 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.253688 6544 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:43.255194 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 6425 I0301 23:03:43.255336 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data --block_manager=log --rpc_bind_addresses=127.0.22.140:36887 --local_ip_for_outbound_sockets=127.0.22.140 --webserver_port=34237 --webserver_interface=127.0.22.140 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.273567 6548 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.273653 6548 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.274422 6548 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.274458 6548 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.140 I0301 23:03:43.275352 6548 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.140:36887 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/info.pb --webserver_interface=127.0.22.140 --webserver_port=34237 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.6548 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.140 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.280287 6548 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.280455 6548 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.280529 6548 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.280587 6548 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.281278 6548 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:03:43.281412 6548 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.281491 6548 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.282059 6548 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.282194 6548 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal uuid: "dfad632bf1b641f7924c7f00b90f47a9" format_stamp: "Formatted at 2019-03-01 23:03:41 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.282232 6548 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.291908 5147 ts_manager.cc:98] Registered new tserver with Master: 2f6da60eaa86415a9d7beab4e1ccd60f (127.0.22.139:41641) I0301 23:03:43.292654 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.139:45937 I0301 23:03:43.294795 6548 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.294979 6548 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.295032 6548 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.299147 6548 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.140:36887 I0301 23:03:43.299196 6548 webserver.cc:175] Starting webserver on 127.0.22.140:34237 I0301 23:03:43.299201 6548 webserver.cc:186] Document root disabled I0301 23:03:43.299311 6548 webserver.cc:313] Webserver started. Bound to: http://127.0.22.140:34237/ I0301 23:03:43.299437 6548 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-11/data/info.pb I0301 23:03:43.300297 6548 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.302448 6667 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:43.302485 6667 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.302512 6667 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:43.307276 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 6548 I0301 23:03:43.307474 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data --block_manager=log --rpc_bind_addresses=127.0.22.141:41907 --local_ip_for_outbound_sockets=127.0.22.141 --webserver_port=40237 --webserver_interface=127.0.22.141 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.329682 6671 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.329774 6671 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.330497 6671 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.330531 6671 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.141 I0301 23:03:43.331431 6671 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.141:41907 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/info.pb --webserver_interface=127.0.22.141 --webserver_port=40237 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.6671 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.141 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.332296 6671 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.332480 6671 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.332566 6671 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.332612 6671 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.333338 6671 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:03:43.333497 6671 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.333580 6671 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.334138 6671 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.334472 6671 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal uuid: "bd37061b59444122a94027df2e49d387" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.334516 6671 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.340955 5147 ts_manager.cc:98] Registered new tserver with Master: dfad632bf1b641f7924c7f00b90f47a9 (127.0.22.140:36887) I0301 23:03:43.341697 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.140:36311 I0301 23:03:43.353773 6671 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.353996 6671 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.354053 6671 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.358270 6671 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.141:41907 I0301 23:03:43.358332 6671 webserver.cc:175] Starting webserver on 127.0.22.141:40237 I0301 23:03:43.358338 6671 webserver.cc:186] Document root disabled I0301 23:03:43.358480 6671 webserver.cc:313] Webserver started. Bound to: http://127.0.22.141:40237/ I0301 23:03:43.358615 6671 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-12/data/info.pb I0301 23:03:43.358971 6671 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.361837 6790 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:43.361867 6790 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.361897 6790 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:43.363265 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 6671 I0301 23:03:43.363430 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data --block_manager=log --rpc_bind_addresses=127.0.22.142:34109 --local_ip_for_outbound_sockets=127.0.22.142 --webserver_port=41751 --webserver_interface=127.0.22.142 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.381644 6794 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.381731 6794 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.382377 6794 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.382423 6794 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.142 I0301 23:03:43.383252 6794 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.142:34109 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/info.pb --webserver_interface=127.0.22.142 --webserver_port=41751 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.6794 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.142 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.384085 6794 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.388322 6794 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.388415 6794 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.388453 6794 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.392374 6794 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.000s sys 0.001s I0301 23:03:43.392506 6794 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.392585 6794 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.393126 6794 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.393255 6794 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal uuid: "43687df4fc27498a86f32fc21eb80d71" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.393291 6794 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.399513 5147 ts_manager.cc:98] Registered new tserver with Master: bd37061b59444122a94027df2e49d387 (127.0.22.141:41907) I0301 23:03:43.400085 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.141:60817 I0301 23:03:43.441309 6794 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.441529 6794 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.441606 6794 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.445513 6794 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.142:34109 I0301 23:03:43.445567 6794 webserver.cc:175] Starting webserver on 127.0.22.142:41751 I0301 23:03:43.445572 6794 webserver.cc:186] Document root disabled I0301 23:03:43.445698 6794 webserver.cc:313] Webserver started. Bound to: http://127.0.22.142:41751/ I0301 23:03:43.445814 6794 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-13/data/info.pb I0301 23:03:43.446162 6794 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.449213 6913 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:43.449244 6913 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.449280 6913 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:43.455854 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 6794 I0301 23:03:43.456027 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data --block_manager=log --rpc_bind_addresses=127.0.22.143:38287 --local_ip_for_outbound_sockets=127.0.22.143 --webserver_port=33649 --webserver_interface=127.0.22.143 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:43.474341 5147 ts_manager.cc:98] Registered new tserver with Master: 43687df4fc27498a86f32fc21eb80d71 (127.0.22.142:34109) I0301 23:03:43.474933 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.142:44809 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.520778 6917 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.520874 6917 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.521541 6917 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.521571 6917 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.143 I0301 23:03:43.522403 6917 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.143:38287 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/info.pb --webserver_interface=127.0.22.143 --webserver_port=33649 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.6917 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.143 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.523181 6917 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.523334 6917 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.523420 6917 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.523463 6917 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.524155 6917 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:03:43.524319 6917 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.524427 6917 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.524979 6917 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.525123 6917 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal uuid: "b0f105f239bf40979372bcfe165b1988" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.525164 6917 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.529004 5313 heartbeater.cc:466] Master 127.0.22.190:41601 was elected leader, sending a full tablet report... I0301 23:03:43.554087 6917 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.554294 6917 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.554364 6917 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.558709 6917 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.143:38287 I0301 23:03:43.558774 6917 webserver.cc:175] Starting webserver on 127.0.22.143:33649 I0301 23:03:43.558804 6917 webserver.cc:186] Document root disabled I0301 23:03:43.558940 6917 webserver.cc:313] Webserver started. Bound to: http://127.0.22.143:33649/ I0301 23:03:43.559065 6917 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-14/data/info.pb I0301 23:03:43.559414 6917 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.562618 7036 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:43.562644 7036 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.562676 7036 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:43.562729 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 6917 I0301 23:03:43.562885 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data --block_manager=log --rpc_bind_addresses=127.0.22.144:35203 --local_ip_for_outbound_sockets=127.0.22.144 --webserver_port=34549 --webserver_interface=127.0.22.144 --tserver_master_addrs=127.0.22.190:41601 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:43.564909 5437 heartbeater.cc:466] Master 127.0.22.190:41601 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.581544 7039 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.581629 7039 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.582305 7039 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.582340 7039 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.144 I0301 23:03:43.583220 7039 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.144:35203 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/info.pb --webserver_interface=127.0.22.144 --webserver_port=34549 --tserver_master_addrs=127.0.22.190:41601 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.7039 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.144 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.584035 7039 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.588296 7039 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.588376 7039 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.588428 7039 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.589148 7039 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:03:43.589285 7039 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.589404 7039 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.589994 7039 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.590134 7039 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal uuid: "61b368dd839f491cbcaf1d0e1a168236" format_stamp: "Formatted at 2019-03-01 23:03:42 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.590173 7039 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.600666 5147 ts_manager.cc:98] Registered new tserver with Master: b0f105f239bf40979372bcfe165b1988 (127.0.22.143:38287) I0301 23:03:43.601235 5147 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.143:33727 I0301 23:03:43.627915 7039 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.628202 7039 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.628260 7039 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.632376 7039 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.144:35203 I0301 23:03:43.632506 7039 webserver.cc:175] Starting webserver on 127.0.22.144:34549 I0301 23:03:43.632539 7039 webserver.cc:186] Document root disabled I0301 23:03:43.632688 7039 webserver.cc:313] Webserver started. Bound to: http://127.0.22.144:34549/ I0301 23:03:43.632834 7039 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_2.1551481418399944-90/minicluster-data/ts-15/data/info.pb I0301 23:03:43.633189 7039 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.635071 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 7039 I0301 23:03:43.636335 7159 heartbeater.cc:345] Connected to a master server at 127.0.22.190:41601 I0301 23:03:43.636368 7159 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.636415 7159 heartbeater.cc:474] Master 127.0.22.190:41601 requested a full tablet report, sending... I0301 23:03:43.656829 5560 heartbeater.cc:466] Master 127.0.22.190:41601 was elected leader, sending a full tablet report... I0301 23:03:43.662868 5151 ts_manager.cc:98] Registered new tserver with Master: 61b368dd839f491cbcaf1d0e1a168236 (127.0.22.144:35203) I0301 23:03:43.663303 90 external_mini_cluster.cc:623] 16 TS(s) registered with all masters I0301 23:03:43.663383 5151 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.144:42307 I0301 23:03:43.664005 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 5186 W0301 23:03:43.666745 5135 connection.cc:647] server connection from 127.0.22.129:49413 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:49413): Connection reset by peer (error 104) I0301 23:03:43.666775 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 5317 W0301 23:03:43.669657 5134 connection.cc:647] server connection from 127.0.22.130:44317 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:44317): Connection reset by peer (error 104) I0301 23:03:43.669718 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 5440 W0301 23:03:43.672785 5133 connection.cc:647] server connection from 127.0.22.131:34095 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:34095): Connection reset by peer (error 104) I0301 23:03:43.672847 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 5563 W0301 23:03:43.675323 5135 connection.cc:647] server connection from 127.0.22.132:56601 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:56601): Connection reset by peer (error 104) I0301 23:03:43.675415 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 5687 W0301 23:03:43.677675 5133 connection.cc:647] server connection from 127.0.22.133:37993 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:37993): Connection reset by peer (error 104) I0301 23:03:43.677740 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 5809 W0301 23:03:43.680366 5133 connection.cc:647] server connection from 127.0.22.134:60173 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:60173): Connection reset by peer (error 104) I0301 23:03:43.680428 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 5933 I0301 23:03:43.685704 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 6055 W0301 23:03:43.685657 5134 connection.cc:647] server connection from 127.0.22.135:48753 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:48753): Connection reset by peer (error 104) W0301 23:03:43.688828 5135 connection.cc:647] server connection from 127.0.22.136:47391 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:47391): Connection reset by peer (error 104) I0301 23:03:43.688896 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 6179 W0301 23:03:43.691532 5132 connection.cc:647] server connection from 127.0.22.137:47117 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:47117): Connection reset by peer (error 104) I0301 23:03:43.691588 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 6301 W0301 23:03:43.694447 5134 connection.cc:647] server connection from 127.0.22.138:49797 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:49797): Connection reset by peer (error 104) I0301 23:03:43.694471 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 6425 W0301 23:03:43.697023 5134 connection.cc:647] server connection from 127.0.22.139:45937 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:45937): Connection reset by peer (error 104) I0301 23:03:43.697098 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 6548 W0301 23:03:43.699546 5134 connection.cc:647] server connection from 127.0.22.140:36311 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:36311): Connection reset by peer (error 104) I0301 23:03:43.699560 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 6671 W0301 23:03:43.702667 5134 connection.cc:647] server connection from 127.0.22.141:60817 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:60817): Connection reset by peer (error 104) I0301 23:03:43.702700 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 6794 W0301 23:03:43.705412 5133 connection.cc:647] server connection from 127.0.22.142:44809 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:44809): Connection reset by peer (error 104) I0301 23:03:43.705485 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 6917 W0301 23:03:43.708194 5132 connection.cc:647] server connection from 127.0.22.143:33727 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:33727): Connection reset by peer (error 104) I0301 23:03:43.708238 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 7039 W0301 23:03:43.710855 5133 connection.cc:647] server connection from 127.0.22.144:42307 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:42307): Connection reset by peer (error 104) I0301 23:03:43.710917 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 5125 W0301 23:03:43.714138 3084 connection.cc:647] client connection to 127.0.22.190:41601 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:41601): Connection reset by peer (error 104) [ OK ] TsLocationAssignmentITest.Basic/2 (2689 ms) [ RUN ] TsLocationAssignmentITest.Basic/3 I0301 23:03:43.722293 90 test_util.cc:212] Using random seed: 1797453620 I0301 23:03:43.722754 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:34129 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:31 --map /L1:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.733425 7166 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.733520 7166 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.734275 7166 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:03:43.734300 7166 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.734305 7166 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:03:43.734308 7166 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:03:43.735317 7166 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:31 --map /L1:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:34129 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.7166 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.736085 7166 master_main.cc:80] Initializing master server... I0301 23:03:43.736239 7166 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.736326 7166 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.736353 7166 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.736398 7166 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:43.736413 7166 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:43.736964 7166 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/data/instance: uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.737109 7166 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/wal/instance: uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.738168 7166 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:43.738354 7166 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.738435 7166 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.738970 7166 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.738999 7166 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/wal uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.739017 7166 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.763975 7166 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.764118 7166 master_main.cc:83] Starting Master server... I0301 23:03:43.765650 7166 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:34129 I0301 23:03:43.765698 7166 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:03:43.765703 7166 webserver.cc:186] Document root disabled I0301 23:03:43.765810 7166 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:46167/ I0301 23:03:43.765913 7166 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:03:43.766438 7225 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:03:43.768024 7225 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11: Bootstrap starting. I0301 23:03:43.768296 7225 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11: No blocks or log segments found. Creating new log. I0301 23:03:43.768460 7225 log.cc:525] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11: Log is configured to *not* fsync() on all Append() calls I0301 23:03:43.768805 7225 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11: No bootstrap required, opened a new log I0301 23:03:43.769798 7225 raft_consensus.cc:340] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" member_type: VOTER } I0301 23:03:43.769830 7225 raft_consensus.cc:366] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:03:43.769835 7225 raft_consensus.cc:705] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11, State: Initialized, Role: FOLLOWER I0301 23:03:43.769878 7225 consensus_queue.cc:229] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" member_type: VOTER } I0301 23:03:43.769901 7225 raft_consensus.cc:380] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0301 23:03:43.769906 7225 raft_consensus.cc:472] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0301 23:03:43.769912 7225 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:03:43.774734 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 7166 I0301 23:03:43.774993 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.785998 7227 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.786099 7227 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.786782 7227 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.786826 7227 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:03:43.787710 7227 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.7227 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.788594 7227 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.788753 7227 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.788839 7227 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.788867 7227 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.788902 7227 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:43.788905 7227 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:43.789479 7227 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/data/instance: uuid: "8e285acf7e684b698e9bccab0771b863" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.789623 7227 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/wal/instance: uuid: "8e285acf7e684b698e9bccab0771b863" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.790695 7227 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:43.790915 7227 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.790990 7227 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.791576 7227 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.791612 7227 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/wal uuid: "8e285acf7e684b698e9bccab0771b863" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.791633 7227 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.813315 7227 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.813558 7227 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.813622 7227 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.817487 7227 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:39383 I0301 23:03:43.817548 7227 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:03:43.817555 7227 webserver.cc:186] Document root disabled I0301 23:03:43.817699 7227 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:35897/ I0301 23:03:43.817836 7227 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:03:43.818168 7227 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.821940 7346 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:43.821969 7346 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.822005 7346 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... W0301 23:03:43.822438 7346 heartbeater.cc:586] Failed to heartbeat to 127.0.22.190:34129 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting I0301 23:03:43.822463 7346 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.822484 7346 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:43.822870 7346 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.822916 7346 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... W0301 23:03:43.823343 7346 heartbeater.cc:379] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. I0301 23:03:43.826910 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 7227 I0301 23:03:43.827112 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:0 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.837952 7350 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.838047 7350 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.838757 7350 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.839005 7350 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:03:43.839929 7350 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.7350 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.840780 7350 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.840973 7350 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.841060 7350 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.841097 7350 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.841131 7350 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:43.841135 7350 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:43.841712 7350 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/data/instance: uuid: "7c81bd87d89841688f6be6d2fb95e247" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.841902 7350 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/wal/instance: uuid: "7c81bd87d89841688f6be6d2fb95e247" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.842973 7350 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s I0301 23:03:43.843189 7350 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.843262 7350 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.843843 7350 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.843876 7350 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/wal uuid: "7c81bd87d89841688f6be6d2fb95e247" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.843897 7350 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.845276 7225 raft_consensus.cc:494] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" member_type: VOTER } I0301 23:03:43.845316 7225 leader_election.cc:306] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11; no voters: I0301 23:03:43.845381 7225 leader_election.cc:292] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [CANDIDATE]: Term 1 election: Requested vote from peers I0301 23:03:43.845501 7225 sys_catalog.cc:337] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" member_type: VOTER } } I0301 23:03:43.845523 7225 sys_catalog.cc:340] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:03:43.845557 7225 sys_catalog.cc:424] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:03:43.845798 7166 master_main.cc:86] Master server successfully started. I0301 23:03:43.845644 7357 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:03:43.845930 7357 raft_consensus.cc:667] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [term 1 LEADER]: Becoming Leader. State: Replica: 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11, State: Running, Role: LEADER I0301 23:03:43.845986 7357 consensus_queue.cc:206] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" member_type: VOTER } I0301 23:03:43.846124 7358 sys_catalog.cc:337] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" member_type: VOTER } } I0301 23:03:43.846146 7358 sys_catalog.cc:340] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [sys.catalog]: This master's current role is: LEADER W0301 23:03:43.846330 7359 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:03:43.846349 7359 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:03:43.846380 7360 sys_catalog.cc:337] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11. Latest consensus state: current_term: 1 leader_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "49b0fa7c7e4d4fb0bcbb88f9bc4b7e11" member_type: VOTER } } I0301 23:03:43.846410 7360 sys_catalog.cc:340] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11 [sys.catalog]: This master's current role is: LEADER I0301 23:03:43.846465 7362 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:03:43.846562 7362 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:03:43.878176 7362 catalog_manager.cc:941] Generated new certificate authority record I0301 23:03:43.878780 7362 catalog_manager.cc:1066] Loading token signing keys... I0301 23:03:43.881759 7350 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.882009 7350 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.882076 7350 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.882650 7362 catalog_manager.cc:4095] T 00000000000000000000000000000000 P 49b0fa7c7e4d4fb0bcbb88f9bc4b7e11: Generated new TSK 0 I0301 23:03:43.886050 7350 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:37317 I0301 23:03:43.886104 7350 webserver.cc:175] Starting webserver on 127.0.22.130:0 I0301 23:03:43.886121 7350 webserver.cc:186] Document root disabled I0301 23:03:43.886281 7350 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:34797/ I0301 23:03:43.886449 7350 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:03:43.886759 7350 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.889097 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 7350 I0301 23:03:43.889334 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:0 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:43.895331 7478 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:43.895364 7478 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.895426 7478 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:43.910707 7481 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:43.910797 7481 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:43.911497 7481 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:43.911536 7481 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:03:43.920441 7481 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.7481 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:43.921212 7481 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:43.921368 7481 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0301 23:03:43.921460 7481 fs_manager.cc:263] Metadata directory not provided I0301 23:03:43.921489 7481 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:43.921521 7481 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:43.921535 7481 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:43.922062 7481 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/data/instance: uuid: "ccc467f413e14cfd90325adb1e710b4f" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.922201 7481 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/wal/instance: uuid: "ccc467f413e14cfd90325adb1e710b4f" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.932421 7481 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.002s sys 0.000s I0301 23:03:43.932700 7481 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:43.932802 7481 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:43.933396 7481 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:43.933434 7481 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/wal uuid: "ccc467f413e14cfd90325adb1e710b4f" format_stamp: "Formatted at 2019-03-01 23:03:43 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:43.933462 7481 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:43.945916 7192 ts_manager.cc:98] Registered new tserver with Master: 7c81bd87d89841688f6be6d2fb95e247 (127.0.22.130:37317) I0301 23:03:43.946718 7192 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:54155 I0301 23:03:43.969676 7481 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:43.969995 7481 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:43.970072 7481 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:43.975348 7481 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:33433 I0301 23:03:43.975432 7481 webserver.cc:175] Starting webserver on 127.0.22.131:0 I0301 23:03:43.975462 7481 webserver.cc:186] Document root disabled I0301 23:03:43.975625 7481 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:43833/ I0301 23:03:43.975772 7481 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:03:43.976114 7481 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:43.979831 7601 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:43.979862 7601 heartbeater.cc:425] Registering TS with master... I0301 23:03:43.979904 7601 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:43.985759 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 7481 I0301 23:03:43.985954 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:0 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.014580 7605 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.014695 7605 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.015413 7605 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.015449 7605 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:03:44.024477 7605 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.7605 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.025334 7605 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.025537 7605 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.025632 7605 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.025662 7605 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.025718 7605 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.025738 7605 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.026535 7605 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/data/instance: uuid: "15277a9450ca44768dd94625010374fe" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.026702 7605 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/wal/instance: uuid: "15277a9450ca44768dd94625010374fe" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.035302 7605 fs_manager.cc:503] Time spent creating directory manager: real 0.008s user 0.002s sys 0.001s I0301 23:03:44.035615 7605 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.035701 7605 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.036255 7605 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.036298 7605 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/wal uuid: "15277a9450ca44768dd94625010374fe" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.036325 7605 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.053938 7605 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.054159 7605 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.054224 7605 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.058274 7605 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:40221 I0301 23:03:44.058342 7605 webserver.cc:175] Starting webserver on 127.0.22.132:0 I0301 23:03:44.058359 7605 webserver.cc:186] Document root disabled I0301 23:03:44.058526 7605 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:35915/ I0301 23:03:44.058663 7605 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:03:44.058967 7605 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.059849 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 7605 I0301 23:03:44.060060 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:0 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.062628 7724 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.062666 7724 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.062712 7724 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.071267 7727 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.071357 7727 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.072338 7727 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.072382 7727 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:03:44.073614 7727 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.7727 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.074820 7727 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.075014 7727 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.075114 7727 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.075146 7727 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.075191 7727 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.075215 7727 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.075942 7727 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/data/instance: uuid: "e2d67f68b2bb4e9695988b61bc1b4c1a" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.076128 7727 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/wal/instance: uuid: "e2d67f68b2bb4e9695988b61bc1b4c1a" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.077334 7727 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:44.077541 7727 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.077616 7727 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.078150 7727 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.078183 7727 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/wal uuid: "e2d67f68b2bb4e9695988b61bc1b4c1a" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.078203 7727 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.096009 7727 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.096241 7727 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.096300 7727 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.101038 7727 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:42559 I0301 23:03:44.101099 7727 webserver.cc:175] Starting webserver on 127.0.22.133:0 I0301 23:03:44.101114 7727 webserver.cc:186] Document root disabled I0301 23:03:44.101245 7727 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:46863/ I0301 23:03:44.101403 7727 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:03:44.101763 7727 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.102275 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 7727 I0301 23:03:44.102596 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:0 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.105674 7846 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.105695 7846 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.105737 7846 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.116883 7849 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.116977 7849 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.118011 7849 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.118054 7849 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:03:44.119298 7849 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.7849 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.120509 7849 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.120703 7849 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.120805 7849 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.120838 7849 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.120916 7849 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.120937 7849 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.121861 7849 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/data/instance: uuid: "e1dc3d5e96234ee28cea8a69ff8ad4a0" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.122045 7849 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/wal/instance: uuid: "e1dc3d5e96234ee28cea8a69ff8ad4a0" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.123462 7849 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s I0301 23:03:44.123579 7192 ts_manager.cc:98] Registered new tserver with Master: ccc467f413e14cfd90325adb1e710b4f (127.0.22.131:33433) I0301 23:03:44.123703 7849 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.123785 7849 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.124411 7849 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.124444 7849 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/wal uuid: "e1dc3d5e96234ee28cea8a69ff8ad4a0" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.124474 7849 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.125785 7192 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:32809 I0301 23:03:44.189018 7849 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.189296 7849 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.189359 7849 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.194034 7849 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:35069 I0301 23:03:44.194098 7849 webserver.cc:175] Starting webserver on 127.0.22.134:0 I0301 23:03:44.194602 7849 webserver.cc:186] Document root disabled I0301 23:03:44.194777 7849 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:41125/ I0301 23:03:44.194911 7849 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:03:44.195488 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 7849 I0301 23:03:44.195731 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:0 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.196911 7849 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.203550 7969 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.203591 7969 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.203629 7969 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.207715 7972 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.207803 7972 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.208494 7972 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.208523 7972 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:03:44.209362 7972 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.7972 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.210151 7972 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.210301 7972 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.210372 7972 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.210407 7972 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.210441 7972 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.210454 7972 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.210983 7972 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/data/instance: uuid: "e28d100dbd9049bc99ecb4697b472701" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.211118 7972 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/wal/instance: uuid: "e28d100dbd9049bc99ecb4697b472701" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.212194 7972 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:03:44.212374 7972 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.212445 7972 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.212872 7972 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.212887 7972 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/wal uuid: "e28d100dbd9049bc99ecb4697b472701" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.212903 7972 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.218123 7190 ts_manager.cc:98] Registered new tserver with Master: e2d67f68b2bb4e9695988b61bc1b4c1a (127.0.22.133:42559) I0301 23:03:44.220484 7190 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.133:34799 I0301 23:03:44.276732 7972 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.276957 7972 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.277016 7972 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.281436 7972 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:43555 I0301 23:03:44.281497 7972 webserver.cc:175] Starting webserver on 127.0.22.135:0 I0301 23:03:44.281513 7972 webserver.cc:186] Document root disabled I0301 23:03:44.281668 7972 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:45717/ I0301 23:03:44.281782 7972 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:03:44.282066 7972 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.285670 8092 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.285694 8092 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.285733 8092 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:44.289506 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 7972 I0301 23:03:44.289780 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:0 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.300506 7192 ts_manager.cc:98] Registered new tserver with Master: e1dc3d5e96234ee28cea8a69ff8ad4a0 (127.0.22.134:35069) I0301 23:03:44.302148 7192 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.134:54849 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.303484 8095 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.303616 8095 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.308544 8095 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.308584 8095 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:03:44.309502 8095 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.8095 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.310756 8095 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.310958 8095 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.311056 8095 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.312247 8095 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.312316 8095 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.312340 8095 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.313136 8095 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/data/instance: uuid: "0eccb9038f4e471189f6519e7ae89bd6" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.313316 8095 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/wal/instance: uuid: "0eccb9038f4e471189f6519e7ae89bd6" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.316365 8095 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.001s sys 0.001s I0301 23:03:44.316591 8095 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.316648 8095 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.317179 8095 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.317205 8095 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/wal uuid: "0eccb9038f4e471189f6519e7ae89bd6" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.317227 8095 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.336298 8095 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.336520 8095 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.336583 8095 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.341656 8095 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:35717 I0301 23:03:44.341733 8095 webserver.cc:175] Starting webserver on 127.0.22.136:0 I0301 23:03:44.341753 8095 webserver.cc:186] Document root disabled I0301 23:03:44.341922 8095 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:35505/ I0301 23:03:44.342072 8095 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:03:44.342445 8095 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.343096 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 8095 I0301 23:03:44.343492 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/data --block_manager=log --rpc_bind_addresses=127.0.22.137:0 --local_ip_for_outbound_sockets=127.0.22.137 --webserver_interface=127.0.22.137 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.346213 8215 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.346256 8215 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.346330 8215 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.357431 8218 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.357519 8218 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.358211 8218 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.358242 8218 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.137 I0301 23:03:44.359485 8218 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.137:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/data/info.pb --webserver_interface=127.0.22.137 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.8218 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.137 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.360750 8218 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.360954 8218 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.361048 8218 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.361078 8218 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.361125 8218 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.361142 8218 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.361907 8218 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/data/instance: uuid: "e2e3d68952ae449cbbdd43ae6b5b9225" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.362099 8218 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/wal/instance: uuid: "e2e3d68952ae449cbbdd43ae6b5b9225" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.363535 8218 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s I0301 23:03:44.363786 8218 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.363875 8218 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.364609 8218 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.364635 8218 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/wal uuid: "e2e3d68952ae449cbbdd43ae6b5b9225" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.364660 8218 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.383642 7191 ts_manager.cc:98] Registered new tserver with Master: 15277a9450ca44768dd94625010374fe (127.0.22.132:40221) I0301 23:03:44.386044 7191 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.132:52427 I0301 23:03:44.397955 8218 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.398159 8218 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.398211 8218 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.401986 8218 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.137:42833 I0301 23:03:44.402050 8218 webserver.cc:175] Starting webserver on 127.0.22.137:0 I0301 23:03:44.402065 8218 webserver.cc:186] Document root disabled I0301 23:03:44.402209 8218 webserver.cc:313] Webserver started. Bound to: http://127.0.22.137:40829/ I0301 23:03:44.402346 8218 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-8/data/info.pb I0301 23:03:44.402578 8218 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.406273 8338 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.406298 8338 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.406338 8338 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:44.406673 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 8218 I0301 23:03:44.406920 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/data --block_manager=log --rpc_bind_addresses=127.0.22.138:0 --local_ip_for_outbound_sockets=127.0.22.138 --webserver_interface=127.0.22.138 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.418381 8341 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.418475 8341 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.419188 8341 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.419240 8341 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.138 I0301 23:03:44.420526 8341 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.138:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/data/info.pb --webserver_interface=127.0.22.138 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.8341 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.138 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.421684 8341 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.421866 8341 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.421963 8341 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.421991 8341 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.422034 8341 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.422051 8341 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.422746 8341 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/data/instance: uuid: "0f973760f42047d881190ef209acade8" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.422919 8341 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/wal/instance: uuid: "0f973760f42047d881190ef209acade8" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.424216 8341 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:03:44.424480 8341 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.424564 8341 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.425287 8341 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.425319 8341 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/wal uuid: "0f973760f42047d881190ef209acade8" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.425345 8341 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.460345 8341 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.460621 8341 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.460700 8341 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.465009 8341 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.138:37971 I0301 23:03:44.465060 8341 webserver.cc:175] Starting webserver on 127.0.22.138:0 I0301 23:03:44.465065 8341 webserver.cc:186] Document root disabled I0301 23:03:44.465196 8341 webserver.cc:313] Webserver started. Bound to: http://127.0.22.138:40553/ I0301 23:03:44.465304 8341 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-9/data/info.pb I0301 23:03:44.465600 8341 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.468835 8460 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.468858 8460 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.468889 8460 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:44.469650 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 8341 I0301 23:03:44.469929 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/data --block_manager=log --rpc_bind_addresses=127.0.22.139:0 --local_ip_for_outbound_sockets=127.0.22.139 --webserver_interface=127.0.22.139 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.479110 7190 ts_manager.cc:98] Registered new tserver with Master: e28d100dbd9049bc99ecb4697b472701 (127.0.22.135:43555) I0301 23:03:44.481520 7190 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.135:46637 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.484068 8463 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.488237 8463 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.488962 8463 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.488999 8463 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.139 I0301 23:03:44.489922 8463 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.139:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/data/info.pb --webserver_interface=127.0.22.139 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.8463 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.139 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.491106 8463 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.491312 8463 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.491421 8463 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.491461 8463 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.491509 8463 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.491533 8463 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.492127 8463 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/data/instance: uuid: "70044639b725414b8fa984aa2d5a49c8" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.496328 8463 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/wal/instance: uuid: "70044639b725414b8fa984aa2d5a49c8" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.497382 8463 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:44.497629 8463 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.497701 8463 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.498203 8463 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.498251 8463 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/wal uuid: "70044639b725414b8fa984aa2d5a49c8" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.498280 8463 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.538285 8463 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.538563 8463 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.538625 8463 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.543938 8463 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.139:37255 I0301 23:03:44.543983 8463 webserver.cc:175] Starting webserver on 127.0.22.139:0 I0301 23:03:44.543990 8463 webserver.cc:186] Document root disabled I0301 23:03:44.544142 8463 webserver.cc:313] Webserver started. Bound to: http://127.0.22.139:39387/ I0301 23:03:44.544374 8463 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-10/data/info.pb I0301 23:03:44.544677 8463 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.547860 8583 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.547886 8583 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.547925 8583 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:44.552274 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 8463 I0301 23:03:44.552572 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/data --block_manager=log --rpc_bind_addresses=127.0.22.140:0 --local_ip_for_outbound_sockets=127.0.22.140 --webserver_interface=127.0.22.140 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.559113 7189 ts_manager.cc:98] Registered new tserver with Master: 0f973760f42047d881190ef209acade8 (127.0.22.138:37971) I0301 23:03:44.561584 7189 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.138:39531 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.566040 8586 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.566129 8586 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.566797 8586 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.566841 8586 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.140 I0301 23:03:44.567737 8586 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.140:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/data/info.pb --webserver_interface=127.0.22.140 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.8586 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.140 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.572585 8586 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.572734 8586 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.572818 8586 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.572845 8586 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.572882 8586 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.572896 8586 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.573490 8586 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/data/instance: uuid: "f25a322b2b1e49dd87993eddd117f69b" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.573626 8586 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/wal/instance: uuid: "f25a322b2b1e49dd87993eddd117f69b" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.574774 8586 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:44.574997 8586 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.575079 8586 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.575640 8586 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.575672 8586 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/wal uuid: "f25a322b2b1e49dd87993eddd117f69b" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.575731 8586 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.592424 8586 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.592671 8586 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.592749 8586 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.597249 8586 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.140:42937 I0301 23:03:44.597321 8586 webserver.cc:175] Starting webserver on 127.0.22.140:0 I0301 23:03:44.597339 8586 webserver.cc:186] Document root disabled I0301 23:03:44.597513 8586 webserver.cc:313] Webserver started. Bound to: http://127.0.22.140:36003/ I0301 23:03:44.597638 8586 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-11/data/info.pb I0301 23:03:44.597936 8586 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.601323 8706 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.601351 8706 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.601413 8706 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:44.604674 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 8586 I0301 23:03:44.604933 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/data --block_manager=log --rpc_bind_addresses=127.0.22.141:0 --local_ip_for_outbound_sockets=127.0.22.141 --webserver_interface=127.0.22.141 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.618738 8709 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.618841 8709 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.619832 8709 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.619864 8709 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.141 I0301 23:03:44.621130 8709 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.141:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/data/info.pb --webserver_interface=127.0.22.141 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.8709 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.141 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.622328 8709 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.622524 8709 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.622614 8709 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.622639 8709 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.622685 8709 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.622702 8709 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.623432 8709 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/data/instance: uuid: "3e17653ff92f4d1ca32ac37ee135c7b0" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.623618 8709 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/wal/instance: uuid: "3e17653ff92f4d1ca32ac37ee135c7b0" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.624965 8709 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s I0301 23:03:44.625170 8709 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.625232 8709 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.625715 8709 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.625739 8709 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/wal uuid: "3e17653ff92f4d1ca32ac37ee135c7b0" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.625783 8709 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.643626 7192 ts_manager.cc:98] Registered new tserver with Master: 0eccb9038f4e471189f6519e7ae89bd6 (127.0.22.136:35717) I0301 23:03:44.645706 7192 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.136:52711 I0301 23:03:44.659358 8709 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.659564 8709 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.659613 8709 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.662250 8709 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.141:34951 I0301 23:03:44.662294 8709 webserver.cc:175] Starting webserver on 127.0.22.141:0 I0301 23:03:44.662300 8709 webserver.cc:186] Document root disabled I0301 23:03:44.662422 8709 webserver.cc:313] Webserver started. Bound to: http://127.0.22.141:41219/ I0301 23:03:44.662528 8709 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-12/data/info.pb I0301 23:03:44.662765 8709 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.667132 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 8709 I0301 23:03:44.667327 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/data --block_manager=log --rpc_bind_addresses=127.0.22.142:0 --local_ip_for_outbound_sockets=127.0.22.142 --webserver_interface=127.0.22.142 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.675341 8829 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.675369 8829 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.675423 8829 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.678591 8831 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.678689 8831 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.679356 8831 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.679397 8831 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.142 I0301 23:03:44.680270 8831 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.142:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/data/info.pb --webserver_interface=127.0.22.142 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.8831 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.142 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.681069 8831 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.681215 8831 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.681286 8831 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.681308 8831 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.681340 8831 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.681356 8831 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.681917 8831 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/data/instance: uuid: "27b136967a0c44f49db8f0e85a99832c" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.682054 8831 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/wal/instance: uuid: "27b136967a0c44f49db8f0e85a99832c" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.683027 8831 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s I0301 23:03:44.683287 8831 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.683367 8831 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.684099 8831 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.684134 8831 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/wal uuid: "27b136967a0c44f49db8f0e85a99832c" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.684156 8831 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.691824 8831 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.692003 8831 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.692057 8831 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.696266 8831 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.142:34483 I0301 23:03:44.696327 8831 webserver.cc:175] Starting webserver on 127.0.22.142:0 I0301 23:03:44.696342 8831 webserver.cc:186] Document root disabled I0301 23:03:44.696491 8831 webserver.cc:313] Webserver started. Bound to: http://127.0.22.142:43281/ I0301 23:03:44.696629 8831 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-13/data/info.pb I0301 23:03:44.696954 8831 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.699036 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 8831 I0301 23:03:44.699225 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/data --block_manager=log --rpc_bind_addresses=127.0.22.143:0 --local_ip_for_outbound_sockets=127.0.22.143 --webserver_interface=127.0.22.143 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.700057 8951 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.700080 8951 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.700114 8951 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.709708 8954 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.709831 8954 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.710508 8954 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.710537 8954 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.143 I0301 23:03:44.711403 8954 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.143:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/data/info.pb --webserver_interface=127.0.22.143 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.8954 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.143 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.712215 8954 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.712361 8954 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.712440 8954 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.712460 8954 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.712493 8954 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.712507 8954 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.713060 8954 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/data/instance: uuid: "7b26270a4029425dbe34f67b40ffda8c" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.713196 8954 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/wal/instance: uuid: "7b26270a4029425dbe34f67b40ffda8c" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.714159 8954 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s I0301 23:03:44.714340 8954 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.714417 8954 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.714970 8954 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.715045 8954 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/wal uuid: "7b26270a4029425dbe34f67b40ffda8c" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.715111 8954 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.719650 7189 ts_manager.cc:98] Registered new tserver with Master: f25a322b2b1e49dd87993eddd117f69b (127.0.22.140:42937) I0301 23:03:44.721829 7189 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.140:56875 I0301 23:03:44.733896 8954 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.734086 8954 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.734143 8954 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.738540 8954 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.143:39647 I0301 23:03:44.738586 8954 webserver.cc:175] Starting webserver on 127.0.22.143:0 I0301 23:03:44.738600 8954 webserver.cc:186] Document root disabled I0301 23:03:44.738853 8954 webserver.cc:313] Webserver started. Bound to: http://127.0.22.143:43505/ I0301 23:03:44.739075 8954 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-14/data/info.pb I0301 23:03:44.739429 8954 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.741086 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 8954 I0301 23:03:44.741322 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/data --block_manager=log --rpc_bind_addresses=127.0.22.144:0 --local_ip_for_outbound_sockets=127.0.22.144 --webserver_interface=127.0.22.144 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.743551 9074 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.743587 9074 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.743623 9074 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.759246 9077 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.759326 9077 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.760004 9077 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.760035 9077 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.144 I0301 23:03:44.760959 9077 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.144:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/data/info.pb --webserver_interface=127.0.22.144 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.9077 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.144 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.761761 9077 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.761931 9077 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.762024 9077 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.762038 9077 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.762069 9077 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.762080 9077 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.762634 9077 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/data/instance: uuid: "252f393b01e040aab6a3e79c8196fc03" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.762765 9077 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/wal/instance: uuid: "252f393b01e040aab6a3e79c8196fc03" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.763829 9077 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:03:44.763998 9077 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.764056 9077 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.764590 9077 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.764634 9077 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/wal uuid: "252f393b01e040aab6a3e79c8196fc03" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.764662 9077 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.788353 9077 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.788554 9077 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.788605 9077 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.792943 9077 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.144:35001 I0301 23:03:44.792989 9077 webserver.cc:175] Starting webserver on 127.0.22.144:0 I0301 23:03:44.793004 9077 webserver.cc:186] Document root disabled I0301 23:03:44.793123 9077 webserver.cc:313] Webserver started. Bound to: http://127.0.22.144:34601/ I0301 23:03:44.793222 9077 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-15/data/info.pb I0301 23:03:44.793527 9077 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.795130 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 9077 I0301 23:03:44.795323 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/data --block_manager=log --rpc_bind_addresses=127.0.22.145:0 --local_ip_for_outbound_sockets=127.0.22.145 --webserver_interface=127.0.22.145 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.796777 9196 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.796803 9196 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.796867 9196 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.806622 9199 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.806700 9199 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.807371 9199 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.807410 9199 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.145 I0301 23:03:44.808293 9199 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.145:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/data/info.pb --webserver_interface=127.0.22.145 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.9199 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.145 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.809079 9199 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.809264 9199 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.809331 9199 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.809352 9199 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.809382 9199 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.809412 9199 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.809928 9199 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/data/instance: uuid: "53032e4eb8ef46adaa6286f30df63c4d" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.810062 9199 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/wal/instance: uuid: "53032e4eb8ef46adaa6286f30df63c4d" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.811020 9199 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:03:44.811183 9199 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.811239 9199 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.811695 9199 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.811739 9199 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/wal uuid: "53032e4eb8ef46adaa6286f30df63c4d" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.811767 9199 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.823874 7346 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.823917 7346 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.823961 7346 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:44.825472 9199 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.825647 9199 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.825695 9199 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.831997 9199 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.145:46601 I0301 23:03:44.832046 9199 webserver.cc:175] Starting webserver on 127.0.22.145:0 I0301 23:03:44.832051 9199 webserver.cc:186] Document root disabled I0301 23:03:44.832151 9199 webserver.cc:313] Webserver started. Bound to: http://127.0.22.145:35847/ I0301 23:03:44.832324 9199 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-16/data/info.pb I0301 23:03:44.832804 9199 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.836207 9318 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.836230 9318 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.836293 9318 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:44.837139 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 9199 I0301 23:03:44.837360 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/data --block_manager=log --rpc_bind_addresses=127.0.22.146:0 --local_ip_for_outbound_sockets=127.0.22.146 --webserver_interface=127.0.22.146 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.848731 9321 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.848842 9321 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.849517 9321 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.849545 9321 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.146 I0301 23:03:44.850404 9321 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.146:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/data/info.pb --webserver_interface=127.0.22.146 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.9321 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.146 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.851177 9321 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.851302 9321 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.851370 9321 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.851403 9321 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.851438 9321 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.851451 9321 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.852000 9321 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/data/instance: uuid: "a3f3fc2dd7ef4229ae7e61d1c3520303" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.852139 9321 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/wal/instance: uuid: "a3f3fc2dd7ef4229ae7e61d1c3520303" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.853214 9321 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:44.853407 9321 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.853462 9321 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.853966 9321 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.853991 9321 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/wal uuid: "a3f3fc2dd7ef4229ae7e61d1c3520303" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.854041 9321 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.879528 9321 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.879746 9321 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.879793 9321 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.885936 9321 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.146:45221 I0301 23:03:44.885987 9321 webserver.cc:175] Starting webserver on 127.0.22.146:0 I0301 23:03:44.886001 9321 webserver.cc:186] Document root disabled I0301 23:03:44.886118 9321 webserver.cc:313] Webserver started. Bound to: http://127.0.22.146:37769/ I0301 23:03:44.886217 9321 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-17/data/info.pb I0301 23:03:44.886498 9321 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.889092 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 9321 I0301 23:03:44.889295 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/data --block_manager=log --rpc_bind_addresses=127.0.22.147:0 --local_ip_for_outbound_sockets=127.0.22.147 --webserver_interface=127.0.22.147 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.889564 9440 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.889586 9440 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.889652 9440 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.900897 9443 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.900981 9443 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.901706 9443 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.901728 9443 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.147 I0301 23:03:44.902601 9443 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.147:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/data/info.pb --webserver_interface=127.0.22.147 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.9443 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.147 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.903379 9443 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.903509 9443 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.903571 9443 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.903595 9443 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.903625 9443 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.903640 9443 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.904152 9443 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/data/instance: uuid: "f77933c3bd084de3b3e89d31940f3be2" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.904325 9443 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/wal/instance: uuid: "f77933c3bd084de3b3e89d31940f3be2" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.905344 9443 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:44.905617 9443 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.905683 9443 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.906178 9443 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.906222 9443 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/wal uuid: "f77933c3bd084de3b3e89d31940f3be2" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.906247 9443 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.925846 9443 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.926019 9443 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.926069 9443 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.931617 9443 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.147:38223 I0301 23:03:44.931664 9443 webserver.cc:175] Starting webserver on 127.0.22.147:0 I0301 23:03:44.931679 9443 webserver.cc:186] Document root disabled I0301 23:03:44.931807 9443 webserver.cc:313] Webserver started. Bound to: http://127.0.22.147:34019/ I0301 23:03:44.931901 9443 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-18/data/info.pb I0301 23:03:44.932307 9443 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:44.935979 9562 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:44.936031 9562 heartbeater.cc:425] Registering TS with master... I0301 23:03:44.936071 9562 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:44.941098 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 9443 I0301 23:03:44.941308 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/data --block_manager=log --rpc_bind_addresses=127.0.22.148:0 --local_ip_for_outbound_sockets=127.0.22.148 --webserver_interface=127.0.22.148 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:44.947410 7478 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:44.952741 9565 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:44.952838 9565 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:44.953495 9565 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:44.953526 9565 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.148 I0301 23:03:44.954345 9565 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.148:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/data/info.pb --webserver_interface=127.0.22.148 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.9565 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.148 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:44.955127 9565 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:44.955250 9565 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28016us I0301 23:03:44.955317 9565 fs_manager.cc:263] Metadata directory not provided I0301 23:03:44.955338 9565 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:44.955381 9565 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:44.955407 9565 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:44.955924 9565 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/data/instance: uuid: "9667dc8b3e6e4c4797f76e781c44f26d" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.956055 9565 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/wal/instance: uuid: "9667dc8b3e6e4c4797f76e781c44f26d" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.956972 9565 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s I0301 23:03:44.957139 9565 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:44.957199 9565 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:44.957679 9565 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:44.957721 9565 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/wal uuid: "9667dc8b3e6e4c4797f76e781c44f26d" format_stamp: "Formatted at 2019-03-01 23:03:44 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:44.957742 9565 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:44.992614 9565 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:44.992830 9565 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:44.992882 9565 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:44.997288 9565 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.148:34713 I0301 23:03:44.997339 9565 webserver.cc:175] Starting webserver on 127.0.22.148:0 I0301 23:03:44.997354 9565 webserver.cc:186] Document root disabled I0301 23:03:44.997476 9565 webserver.cc:313] Webserver started. Bound to: http://127.0.22.148:46323/ I0301 23:03:44.997573 9565 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-19/data/info.pb I0301 23:03:44.998018 9565 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.003008 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 9565 I0301 23:03:45.003206 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/data --block_manager=log --rpc_bind_addresses=127.0.22.149:0 --local_ip_for_outbound_sockets=127.0.22.149 --webserver_interface=127.0.22.149 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.016110 9687 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.016234 9687 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.016911 9687 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.016935 9687 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.149 I0301 23:03:45.017768 9687 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.149:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/data/info.pb --webserver_interface=127.0.22.149 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.9687 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.149 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.018550 9687 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.018693 9687 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.018766 9687 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.018785 9687 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.018815 9687 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.018829 9687 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.019316 9687 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/data/instance: uuid: "e1c3761c147a48d9adce3b892bfdb792" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.019475 9687 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/wal/instance: uuid: "e1c3761c147a48d9adce3b892bfdb792" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.020359 9687 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:45.020555 9687 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.020612 9687 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.021088 9687 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.021131 9687 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/wal uuid: "e1c3761c147a48d9adce3b892bfdb792" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.021147 9687 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.042403 9687 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.042620 9687 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.042665 9687 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.049223 9687 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.149:46403 I0301 23:03:45.049291 9687 webserver.cc:175] Starting webserver on 127.0.22.149:0 I0301 23:03:45.049305 9687 webserver.cc:186] Document root disabled I0301 23:03:45.049437 9687 webserver.cc:313] Webserver started. Bound to: http://127.0.22.149:43611/ I0301 23:03:45.049551 9687 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-20/data/info.pb I0301 23:03:45.049913 9687 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.056360 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 9687 I0301 23:03:45.056605 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/data --block_manager=log --rpc_bind_addresses=127.0.22.150:0 --local_ip_for_outbound_sockets=127.0.22.150 --webserver_interface=127.0.22.150 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.071926 9809 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.072023 9809 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.073031 9809 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.073060 9809 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.150 I0301 23:03:45.074265 9809 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.150:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/data/info.pb --webserver_interface=127.0.22.150 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.9809 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.150 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.075438 9809 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.075589 9809 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.075675 9809 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.075703 9809 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.075747 9809 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.075765 9809 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.076484 9809 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/data/instance: uuid: "b7e44fcb267b426089d9b4efda345b15" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.076658 9809 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/wal/instance: uuid: "b7e44fcb267b426089d9b4efda345b15" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.077985 9809 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:03:45.078240 9809 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.078310 9809 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.078999 9809 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.079028 9809 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/wal uuid: "b7e44fcb267b426089d9b4efda345b15" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.079046 9809 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.097517 9809 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.097729 9809 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.097784 9809 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.103899 9809 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.150:36785 I0301 23:03:45.103956 9809 webserver.cc:175] Starting webserver on 127.0.22.150:0 I0301 23:03:45.103974 9809 webserver.cc:186] Document root disabled I0301 23:03:45.104094 9809 webserver.cc:313] Webserver started. Bound to: http://127.0.22.150:38761/ I0301 23:03:45.104249 9809 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-21/data/info.pb I0301 23:03:45.104741 9809 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.108523 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 9809 I0301 23:03:45.108783 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/data --block_manager=log --rpc_bind_addresses=127.0.22.151:0 --local_ip_for_outbound_sockets=127.0.22.151 --webserver_interface=127.0.22.151 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:45.114045 7191 ts_manager.cc:98] Registered new tserver with Master: e2e3d68952ae449cbbdd43ae6b5b9225 (127.0.22.137:42833) I0301 23:03:45.117209 7191 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.137:39043 I0301 23:03:45.126691 7601 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.140667 9931 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.140769 9931 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.141754 9931 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.141782 9931 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.151 I0301 23:03:45.143007 9931 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.151:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/data/info.pb --webserver_interface=127.0.22.151 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.9931 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.151 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.144122 9931 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.148319 9931 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.148432 9931 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.148464 9931 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.148531 9931 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.148547 9931 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.149281 9931 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/data/instance: uuid: "312e9c007dac4a3980f7054b30e66ef6" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.149473 9931 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/wal/instance: uuid: "312e9c007dac4a3980f7054b30e66ef6" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.156430 9931 fs_manager.cc:503] Time spent creating directory manager: real 0.007s user 0.002s sys 0.000s I0301 23:03:45.156693 9931 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.156767 9931 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.157455 9931 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.157502 9931 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/wal uuid: "312e9c007dac4a3980f7054b30e66ef6" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.157537 9931 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.221616 7846 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:45.221629 9931 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.221834 9931 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.221895 9931 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.229365 9931 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.151:40371 I0301 23:03:45.229437 9931 webserver.cc:175] Starting webserver on 127.0.22.151:0 I0301 23:03:45.229446 9931 webserver.cc:186] Document root disabled I0301 23:03:45.229596 9931 webserver.cc:313] Webserver started. Bound to: http://127.0.22.151:36993/ I0301 23:03:45.229712 9931 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-22/data/info.pb I0301 23:03:45.230321 9931 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.231360 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 9931 I0301 23:03:45.231623 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/data --block_manager=log --rpc_bind_addresses=127.0.22.152:0 --local_ip_for_outbound_sockets=127.0.22.152 --webserver_interface=127.0.22.152 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.247546 10054 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.247661 10054 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.248917 10054 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.248961 10054 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.152 I0301 23:03:45.250499 10054 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.152:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/data/info.pb --webserver_interface=127.0.22.152 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.10054 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.152 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.251910 10054 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.252089 10054 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.252209 10054 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.252238 10054 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.252343 10054 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.252362 10054 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.253207 10054 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/data/instance: uuid: "b91f1aba247e4eff8720d100218f9595" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.253453 10054 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/wal/instance: uuid: "b91f1aba247e4eff8720d100218f9595" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.255187 10054 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.003s sys 0.000s I0301 23:03:45.255467 10054 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.255530 10054 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.256271 10054 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.256327 10054 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/wal uuid: "b91f1aba247e4eff8720d100218f9595" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.256361 10054 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.276723 10054 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.276947 10054 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.277024 10054 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.283556 10054 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.152:42333 I0301 23:03:45.283614 10054 webserver.cc:175] Starting webserver on 127.0.22.152:0 I0301 23:03:45.283627 10054 webserver.cc:186] Document root disabled I0301 23:03:45.283749 10054 webserver.cc:313] Webserver started. Bound to: http://127.0.22.152:39067/ I0301 23:03:45.283870 10054 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-23/data/info.pb I0301 23:03:45.284395 10054 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.284415 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 10054 I0301 23:03:45.284627 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/data --block_manager=log --rpc_bind_addresses=127.0.22.153:0 --local_ip_for_outbound_sockets=127.0.22.153 --webserver_interface=127.0.22.153 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.300585 10176 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.300674 10176 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.301663 10176 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.301698 10176 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.153 I0301 23:03:45.302901 7969 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:45.302927 10176 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.153:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/data/info.pb --webserver_interface=127.0.22.153 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.10176 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.153 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.304075 10176 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.304271 10176 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.304380 10176 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.304424 10176 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.304467 10176 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.304483 10176 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.305168 10176 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/data/instance: uuid: "7e55d4458a7e4b79a6e89b49a942d25e" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.305333 10176 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/wal/instance: uuid: "7e55d4458a7e4b79a6e89b49a942d25e" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.306614 10176 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:45.306851 10176 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.306922 10176 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.307651 10176 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.307700 10176 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/wal uuid: "7e55d4458a7e4b79a6e89b49a942d25e" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.307754 10176 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.332139 10176 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.332420 10176 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.332494 10176 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.339941 10176 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.153:35735 I0301 23:03:45.340013 10176 webserver.cc:175] Starting webserver on 127.0.22.153:0 I0301 23:03:45.340029 10176 webserver.cc:186] Document root disabled I0301 23:03:45.340199 10176 webserver.cc:313] Webserver started. Bound to: http://127.0.22.153:42377/ I0301 23:03:45.340317 10176 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-24/data/info.pb I0301 23:03:45.340759 10176 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.346595 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 10176 I0301 23:03:45.346822 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/data --block_manager=log --rpc_bind_addresses=127.0.22.154:0 --local_ip_for_outbound_sockets=127.0.22.154 --webserver_interface=127.0.22.154 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.360831 10298 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.360925 10298 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.361903 10298 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.361985 10298 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.154 I0301 23:03:45.363191 10298 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.154:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/data/info.pb --webserver_interface=127.0.22.154 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.10298 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.154 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.364361 10298 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.364534 10298 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.364624 10298 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.364672 10298 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.364727 10298 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.364734 10298 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.365437 10298 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/data/instance: uuid: "2c2d190c87e449b0aba6f3660ee9092f" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.365638 10298 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/wal/instance: uuid: "2c2d190c87e449b0aba6f3660ee9092f" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.366914 10298 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:45.367177 10298 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.367251 10298 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.367969 10298 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.368000 10298 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/wal uuid: "2c2d190c87e449b0aba6f3660ee9092f" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.368086 10298 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.387027 7724 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:45.393971 10298 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.394179 10298 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.394228 10298 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.401201 10298 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.154:45213 I0301 23:03:45.401259 10298 webserver.cc:175] Starting webserver on 127.0.22.154:0 I0301 23:03:45.401288 10298 webserver.cc:186] Document root disabled I0301 23:03:45.401445 10298 webserver.cc:313] Webserver started. Bound to: http://127.0.22.154:36711/ I0301 23:03:45.401558 10298 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-25/data/info.pb I0301 23:03:45.402211 10298 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.408836 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 10298 I0301 23:03:45.409090 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/data --block_manager=log --rpc_bind_addresses=127.0.22.155:0 --local_ip_for_outbound_sockets=127.0.22.155 --webserver_interface=127.0.22.155 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.424948 10420 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.425045 10420 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.426059 10420 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.426095 10420 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.155 I0301 23:03:45.427309 10420 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.155:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/data/info.pb --webserver_interface=127.0.22.155 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.10420 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.155 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.428524 10420 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.428683 10420 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.428771 10420 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.428794 10420 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.428866 10420 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.428884 10420 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.429613 10420 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/data/instance: uuid: "32278a153b474faba25ca8579636e784" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.429790 10420 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/wal/instance: uuid: "32278a153b474faba25ca8579636e784" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.431107 10420 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:03:45.431347 10420 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.431434 10420 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.432078 10420 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.432129 10420 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/wal uuid: "32278a153b474faba25ca8579636e784" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.432152 10420 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.455821 10420 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.456100 10420 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.456158 10420 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.463182 10420 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.155:45467 I0301 23:03:45.463239 10420 webserver.cc:175] Starting webserver on 127.0.22.155:0 I0301 23:03:45.464133 10420 webserver.cc:186] Document root disabled I0301 23:03:45.464296 10420 webserver.cc:313] Webserver started. Bound to: http://127.0.22.155:42383/ I0301 23:03:45.464452 10420 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-26/data/info.pb I0301 23:03:45.464861 10420 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.472370 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 10420 I0301 23:03:45.472792 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/data --block_manager=log --rpc_bind_addresses=127.0.22.156:0 --local_ip_for_outbound_sockets=127.0.22.156 --webserver_interface=127.0.22.156 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:03:45.482506 8092 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.487382 10542 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.487512 10542 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.488574 10542 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.488608 10542 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.156 I0301 23:03:45.489867 10542 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.156:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/data/info.pb --webserver_interface=127.0.22.156 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.10542 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.156 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.491024 10542 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.492010 10542 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.492103 10542 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.492131 10542 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.492197 10542 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.492214 10542 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.492923 10542 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/data/instance: uuid: "1bdd2308bb6449c9b837bc4a2e90d00a" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.493104 10542 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/wal/instance: uuid: "1bdd2308bb6449c9b837bc4a2e90d00a" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.494467 10542 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.002s I0301 23:03:45.494642 10542 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.494700 10542 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.495195 10542 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.495239 10542 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/wal uuid: "1bdd2308bb6449c9b837bc4a2e90d00a" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.495265 10542 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.507714 10542 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.507902 10542 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.507939 10542 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.513635 10542 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.156:34091 I0301 23:03:45.513680 10542 webserver.cc:175] Starting webserver on 127.0.22.156:0 I0301 23:03:45.513695 10542 webserver.cc:186] Document root disabled I0301 23:03:45.513799 10542 webserver.cc:313] Webserver started. Bound to: http://127.0.22.156:45549/ I0301 23:03:45.513886 10542 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-27/data/info.pb I0301 23:03:45.514331 10542 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.514345 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 10542 I0301 23:03:45.514515 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/data --block_manager=log --rpc_bind_addresses=127.0.22.157:0 --local_ip_for_outbound_sockets=127.0.22.157 --webserver_interface=127.0.22.157 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.526244 10664 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.526331 10664 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.527058 10664 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.527109 10664 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.157 I0301 23:03:45.527951 10664 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.157:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/data/info.pb --webserver_interface=127.0.22.157 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.10664 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.157 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.528774 10664 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.528889 10664 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.528980 10664 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.529000 10664 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.529031 10664 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.529038 10664 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.529579 10664 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/data/instance: uuid: "3068a970556f4f989c97b702afde125b" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.529714 10664 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/wal/instance: uuid: "3068a970556f4f989c97b702afde125b" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.530704 10664 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:03:45.530864 10664 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.530921 10664 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.531340 10664 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.531436 10664 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/wal uuid: "3068a970556f4f989c97b702afde125b" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.531471 10664 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.562654 8460 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:45.587910 10664 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.588142 10664 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.588228 10664 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.594918 10664 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.157:34101 I0301 23:03:45.594998 10664 webserver.cc:175] Starting webserver on 127.0.22.157:0 I0301 23:03:45.595032 10664 webserver.cc:186] Document root disabled I0301 23:03:45.595172 10664 webserver.cc:313] Webserver started. Bound to: http://127.0.22.157:38253/ I0301 23:03:45.595314 10664 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-28/data/info.pb I0301 23:03:45.595690 10664 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.597045 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 10664 I0301 23:03:45.597280 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/data --block_manager=log --rpc_bind_addresses=127.0.22.158:0 --local_ip_for_outbound_sockets=127.0.22.158 --webserver_interface=127.0.22.158 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.612951 10786 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.613046 10786 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.614070 10786 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.614127 10786 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.158 I0301 23:03:45.615329 10786 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.158:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/data/info.pb --webserver_interface=127.0.22.158 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.10786 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.158 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.616529 10786 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.616683 10786 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.616770 10786 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.616798 10786 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.616858 10786 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.616876 10786 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.617563 10786 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/data/instance: uuid: "e24101d44ae64313b3d9f2c8879ff19c" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.617735 10786 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/wal/instance: uuid: "e24101d44ae64313b3d9f2c8879ff19c" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.620038 10786 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s I0301 23:03:45.620349 10786 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.620466 10786 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.621260 10786 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.621312 10786 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/wal uuid: "e24101d44ae64313b3d9f2c8879ff19c" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.621345 10786 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.646369 8215 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:45.669710 10786 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.669921 10786 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.669987 10786 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.676759 10786 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.158:36931 I0301 23:03:45.676834 10786 webserver.cc:175] Starting webserver on 127.0.22.158:0 I0301 23:03:45.676872 10786 webserver.cc:186] Document root disabled I0301 23:03:45.677014 10786 webserver.cc:313] Webserver started. Bound to: http://127.0.22.158:36663/ I0301 23:03:45.677176 10786 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-29/data/info.pb I0301 23:03:45.677461 10786 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.679438 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 10786 I0301 23:03:45.679668 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/data --block_manager=log --rpc_bind_addresses=127.0.22.159:0 --local_ip_for_outbound_sockets=127.0.22.159 --webserver_interface=127.0.22.159 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.694593 10908 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.694684 10908 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.695677 10908 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.695708 10908 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.159 I0301 23:03:45.696929 10908 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.159:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/data/info.pb --webserver_interface=127.0.22.159 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.10908 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.159 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.699034 10908 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.699187 10908 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.699275 10908 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.699302 10908 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.699345 10908 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.699379 10908 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.700096 10908 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/data/instance: uuid: "7b5150f497164e51a18846f2f4cec0d5" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.700297 10908 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/wal/instance: uuid: "7b5150f497164e51a18846f2f4cec0d5" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.701843 10908 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:45.702153 10908 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.702224 10908 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.703116 10908 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.703198 10908 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/wal uuid: "7b5150f497164e51a18846f2f4cec0d5" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.703265 10908 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.722753 8706 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:45.755216 10908 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.755472 10908 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.755569 10908 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.762238 10908 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.159:40313 I0301 23:03:45.762287 10908 webserver.cc:175] Starting webserver on 127.0.22.159:0 I0301 23:03:45.762331 10908 webserver.cc:186] Document root disabled I0301 23:03:45.762491 10908 webserver.cc:313] Webserver started. Bound to: http://127.0.22.159:32873/ I0301 23:03:45.762677 10908 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-30/data/info.pb I0301 23:03:45.763018 10908 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.772295 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 10908 I0301 23:03:45.772557 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/data --block_manager=log --rpc_bind_addresses=127.0.22.160:0 --local_ip_for_outbound_sockets=127.0.22.160 --webserver_interface=127.0.22.160 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:03:45.787361 11030 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:03:45.787457 11030 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:03:45.788156 11030 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:03:45.788228 11030 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.160 I0301 23:03:45.789106 11030 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.160:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/data/info.pb --webserver_interface=127.0.22.160 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34129 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.11030 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.160 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:03:45.789922 11030 tablet_server_main.cc:85] Initializing tablet server... I0301 23:03:45.790062 11030 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 28516us I0301 23:03:45.790130 11030 fs_manager.cc:263] Metadata directory not provided I0301 23:03:45.790151 11030 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:03:45.790208 11030 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:03:45.790222 11030 server_base.cc:433] Attempting to create new FS layout instead I0301 23:03:45.790735 11030 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/data/instance: uuid: "c7ddb923174146d3ab21d783617af6b4" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.790865 11030 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/wal/instance: uuid: "c7ddb923174146d3ab21d783617af6b4" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.792040 11030 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:03:45.792239 11030 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:03:45.792297 11030 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:03:45.792798 11030 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:03:45.792834 11030 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/wal uuid: "c7ddb923174146d3ab21d783617af6b4" format_stamp: "Formatted at 2019-03-01 23:03:45 on dist-test-slave-dist-test-slave-04f2" I0301 23:03:45.792860 11030 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:03:45.824138 11030 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:03:45.824355 11030 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:03:45.824447 11030 tablet_server_main.cc:90] Starting tablet server... I0301 23:03:45.830766 11030 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.160:37051 I0301 23:03:45.830864 11030 webserver.cc:175] Starting webserver on 127.0.22.160:0 I0301 23:03:45.830905 11030 webserver.cc:186] Document root disabled I0301 23:03:45.831043 11030 webserver.cc:313] Webserver started. Bound to: http://127.0.22.160:32875/ I0301 23:03:45.831171 11030 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90/minicluster-data/ts-31/data/info.pb I0301 23:03:45.832314 11030 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:03:45.835508 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 11030 I0301 23:03:45.954085 7190 ts_manager.cc:98] Registered new tserver with Master: 70044639b725414b8fa984aa2d5a49c8 (127.0.22.139:37255) I0301 23:03:45.954978 7190 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.139:52249 I0301 23:03:45.955052 7190 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.139:52249 (request call id 2) took 1406ms. Request Metrics: {"reported_tablets":0} I0301 23:03:45.955363 9928 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:45.955363 9806 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:45.955404 9928 heartbeater.cc:425] Registering TS with master... I0301 23:03:45.955404 9806 heartbeater.cc:425] Registering TS with master... I0301 23:03:45.955459 9928 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:45.955462 9806 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:45.955890 9684 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:45.955922 9684 heartbeater.cc:425] Registering TS with master... I0301 23:03:45.955977 9684 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:46.118078 8338 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:46.699810 7185 ts_manager.cc:98] Registered new tserver with Master: 53032e4eb8ef46adaa6286f30df63c4d (127.0.22.145:46601) I0301 23:03:46.701158 7190 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:32809 (request call id 3) took 1573ms. Request Metrics: {"reported_tablets":0} I0301 23:03:46.702805 7185 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.145:43783 I0301 23:03:46.702926 7185 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.145:43783 (request call id 2) took 1866ms. Request Metrics: {"reported_tablets":0} I0301 23:03:46.702996 7185 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.151:42785 (request call id 1) took 1468ms. Request Metrics: {} I0301 23:03:46.703042 7185 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.152:48223 (request call id 1) took 1411ms. Request Metrics: {} I0301 23:03:46.703352 10051 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:46.703399 10051 heartbeater.cc:425] Registering TS with master... I0301 23:03:46.703415 10173 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:46.703435 10173 heartbeater.cc:425] Registering TS with master... I0301 23:03:46.703466 10051 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:46.703490 10173 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:46.955936 8583 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:47.499428 7189 ts_manager.cc:98] Registered new tserver with Master: 7b26270a4029425dbe34f67b40ffda8c (127.0.22.143:39647) I0301 23:03:47.499608 7190 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:34799 (request call id 3) took 2277ms. Request Metrics: {"reported_tablets":0} I0301 23:03:47.501756 7190 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.153:33709 (request call id 1) took 2157ms. Request Metrics: {} I0301 23:03:47.502249 7189 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.143:34067 I0301 23:03:47.502295 10295 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:47.502315 7189 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.143:34067 (request call id 2) took 2758ms. Request Metrics: {"reported_tablets":0} I0301 23:03:47.502329 10295 heartbeater.cc:425] Registering TS with master... I0301 23:03:47.502357 7189 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.154:38395 (request call id 1) took 2097ms. Request Metrics: {} I0301 23:03:47.502420 7189 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.155:39187 (request call id 1) took 2034ms. Request Metrics: {} I0301 23:03:47.502421 10295 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:47.502789 10417 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:47.502810 10417 heartbeater.cc:425] Registering TS with master... I0301 23:03:47.502853 10417 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:47.502912 10539 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:47.502928 10539 heartbeater.cc:425] Registering TS with master... I0301 23:03:47.502971 10539 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:47.703773 9318 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:48.465015 7186 ts_manager.cc:98] Registered new tserver with Master: 8e285acf7e684b698e9bccab0771b863 (127.0.22.129:39383) I0301 23:03:48.467674 7186 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:48737 I0301 23:03:48.467759 7186 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:48737 (request call id 6) took 3643ms. Request Metrics: {"reported_tablets":0} I0301 23:03:48.467835 7186 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.156:32849 (request call id 1) took 2950ms. Request Metrics: {} I0301 23:03:48.468261 10661 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:48.468288 10661 heartbeater.cc:425] Registering TS with master... I0301 23:03:48.468343 10661 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:48.503238 9074 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:49.454704 7192 ts_manager.cc:98] Registered new tserver with Master: 3e17653ff92f4d1ca32ac37ee135c7b0 (127.0.22.141:34951) I0301 23:03:49.457509 7192 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.141:51387 I0301 23:03:49.457752 7192 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.141:51387 (request call id 2) took 4782ms. Request Metrics: {"reported_tablets":0} I0301 23:03:49.458014 7192 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.157:39635 (request call id 1) took 3858ms. Request Metrics: {} I0301 23:03:49.458775 10783 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:49.458807 10783 heartbeater.cc:425] Registering TS with master... I0301 23:03:49.458864 10783 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:49.468735 7346 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:49.528033 7188 ts_manager.cc:98] Registered new tserver with Master: 27b136967a0c44f49db8f0e85a99832c (127.0.22.142:34483) I0301 23:03:49.528127 7186 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.138:39531 (request call id 3) took 3965ms. Request Metrics: {"reported_tablets":0} I0301 23:03:49.528129 7191 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:54155 (request call id 3) took 4580ms. Request Metrics: {"reported_tablets":0} I0301 23:03:49.528252 7189 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.135:46637 (request call id 3) took 4045ms. Request Metrics: {"reported_tablets":0} I0301 23:03:49.528331 7189 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.158:55559 (request call id 1) took 3847ms. Request Metrics: {} I0301 23:03:49.530304 7189 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.160:44025 (request call id 1) took 3694ms. Request Metrics: {} I0301 23:03:49.530648 10905 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:49.530678 10905 heartbeater.cc:425] Registering TS with master... I0301 23:03:49.530732 10905 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:49.530800 11149 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:49.530797 7186 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.159:54325 (request call id 1) took 3764ms. Request Metrics: {} I0301 23:03:49.530822 11149 heartbeater.cc:425] Registering TS with master... I0301 23:03:49.530867 11149 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:49.531075 11027 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34129 I0301 23:03:49.531101 11027 heartbeater.cc:425] Registering TS with master... I0301 23:03:49.531148 11027 heartbeater.cc:474] Master 127.0.22.190:34129 requested a full tablet report, sending... I0301 23:03:49.531823 7188 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.142:56229 I0301 23:03:49.531922 7188 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.142:56229 (request call id 2) took 4831ms. Request Metrics: {"reported_tablets":0} I0301 23:03:49.601563 7184 ts_manager.cc:98] Registered new tserver with Master: a3f3fc2dd7ef4229ae7e61d1c3520303 (127.0.22.146:45221) I0301 23:03:49.604249 7184 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.146:50321 I0301 23:03:49.604321 7184 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.146:50321 (request call id 2) took 4714ms. Request Metrics: {"reported_tablets":0} I0301 23:03:50.459174 8829 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:50.532747 8951 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:50.591620 7187 ts_manager.cc:98] Registered new tserver with Master: 252f393b01e040aab6a3e79c8196fc03 (127.0.22.144:35001) I0301 23:03:50.591862 7192 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:52711 (request call id 3) took 4945ms. Request Metrics: {"reported_tablets":0} I0301 23:03:50.592051 7192 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.137:39043 (request call id 3) took 4473ms. Request Metrics: {"reported_tablets":0} I0301 23:03:50.592200 7185 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:54849 (request call id 3) took 5289ms. Request Metrics: {"reported_tablets":0} I0301 23:03:50.591960 7190 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:52427 (request call id 3) took 5204ms. Request Metrics: {"reported_tablets":0} I0301 23:03:50.594851 7187 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.144:55247 I0301 23:03:50.595119 7187 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.144:55247 (request call id 2) took 5797ms. Request Metrics: {"reported_tablets":0} I0301 23:03:50.605176 9440 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:51.593183 7190 ts_manager.cc:98] Registered new tserver with Master: b91f1aba247e4eff8720d100218f9595 (127.0.22.152:42333) I0301 23:03:51.596227 9196 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:51.596433 7190 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.152:48223 I0301 23:03:51.596505 7190 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.152:48223 (request call id 2) took 4892ms. Request Metrics: {"reported_tablets":0} I0301 23:03:52.582707 7183 ts_manager.cc:98] Registered new tserver with Master: f77933c3bd084de3b3e89d31940f3be2 (127.0.22.147:38223) I0301 23:03:52.585428 7183 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.147:42085 I0301 23:03:52.585520 7183 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.147:42085 (request call id 2) took 7649ms. Request Metrics: {"reported_tablets":0} I0301 23:03:52.597285 10173 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:53.572319 7190 ts_manager.cc:98] Registered new tserver with Master: 32278a153b474faba25ca8579636e784 (127.0.22.155:45467) I0301 23:03:53.575333 7190 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.155:39187 I0301 23:03:53.575518 7190 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.155:39187 (request call id 2) took 6072ms. Request Metrics: {"reported_tablets":0} I0301 23:03:53.586424 9562 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:54.563494 7188 ts_manager.cc:98] Registered new tserver with Master: b7e44fcb267b426089d9b4efda345b15 (127.0.22.150:36785) I0301 23:03:54.566406 7188 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.150:44507 I0301 23:03:54.566543 7188 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.150:44507 (request call id 2) took 8610ms. Request Metrics: {"reported_tablets":0} I0301 23:03:54.576748 10539 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:55.567625 9928 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:55.766542 7185 ts_manager.cc:98] Registered new tserver with Master: 312e9c007dac4a3980f7054b30e66ef6 (127.0.22.151:40371) I0301 23:03:55.766741 7190 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:32809 (request call id 4) took 8064ms. Request Metrics: {"reported_tablets":0} I0301 23:03:55.767870 7192 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.139:52249 (request call id 3) took 8810ms. Request Metrics: {"reported_tablets":0} I0301 23:03:55.769667 7185 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.151:42785 I0301 23:03:55.769726 7185 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.151:42785 (request call id 2) took 9065ms. Request Metrics: {"reported_tablets":0} I0301 23:03:56.745693 7184 ts_manager.cc:98] Registered new tserver with Master: 9667dc8b3e6e4c4797f76e781c44f26d (127.0.22.148:34713) I0301 23:03:56.748302 7184 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.148:34925 I0301 23:03:56.748373 7184 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.148:34925 (request call id 2) took 10792ms. Request Metrics: {"reported_tablets":0} I0301 23:03:56.770432 10051 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:57.735749 7190 ts_manager.cc:98] Registered new tserver with Master: 1bdd2308bb6449c9b837bc4a2e90d00a (127.0.22.156:34091) I0301 23:03:57.738261 7190 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.156:32849 I0301 23:03:57.738342 7190 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.156:32849 (request call id 2) took 9269ms. Request Metrics: {"reported_tablets":0} I0301 23:03:57.749197 9684 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:58.725000 7187 ts_manager.cc:98] Registered new tserver with Master: 7e55d4458a7e4b79a6e89b49a942d25e (127.0.22.153:35735) I0301 23:03:58.725179 7192 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:34799 (request call id 4) took 10223ms. Request Metrics: {"reported_tablets":0} I0301 23:03:58.727669 7187 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.153:33709 I0301 23:03:58.727883 7187 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.153:33709 (request call id 2) took 11225ms. Request Metrics: {"reported_tablets":0} I0301 23:03:58.739250 10661 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:03:59.714834 7183 ts_manager.cc:98] Registered new tserver with Master: 2c2d190c87e449b0aba6f3660ee9092f (127.0.22.154:45213) I0301 23:03:59.717571 7183 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.154:38395 W0301 23:03:59.717634 7183 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.154:38395 (request call id 2) took 12214 ms (12.2 s). Client timeout 15000 ms (15 s) W0301 23:03:59.717694 7183 rpcz_store.cc:259] Trace: 0301 23:03:47.503210 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:03:52.585586 (+5082376us) service_pool.cc:221] Handling call 0301 23:03:58.725297 (+6139711us) ts_descriptor.cc:229] tablet server 2c2d190c87e449b0aba6f3660ee9092f: assigning location 0301 23:03:59.714798 (+989501us) ts_descriptor.cc:235] tablet server 2c2d190c87e449b0aba6f3660ee9092f: assigned location '/L0' 0301 23:03:59.717616 (+ 2818us) inbound_call.cc:162] Queueing success response Metrics: {"reported_tablets":0} I0301 23:03:59.728979 10295 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... I0301 23:04:00.718519 10417 heartbeater.cc:466] Master 127.0.22.190:34129 was elected leader, sending a full tablet report... W0301 23:04:00.723772 8706 heartbeater.cc:586] Failed to heartbeat to 127.0.22.190:34129 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.0.22.190:34129 timed out after 15.000s (SENT) I0301 23:04:00.752889 7186 ts_manager.cc:98] Registered new tserver with Master: e1c3761c147a48d9adce3b892bfdb792 (127.0.22.149:46403) I0301 23:04:00.755715 7186 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.149:41719 W0301 23:04:00.755897 7186 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.149:41719 (request call id 2) took 14800 ms (14.8 s). Client timeout 15000 ms (15 s) W0301 23:04:00.755973 7186 rpcz_store.cc:259] Trace: 0301 23:03:45.955687 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:03:49.530850 (+3575163us) service_pool.cc:221] Handling call 0301 23:03:59.714938 (+10184088us) ts_descriptor.cc:229] tablet server e1c3761c147a48d9adce3b892bfdb792: assigning location 0301 23:04:00.752874 (+1037936us) ts_descriptor.cc:235] tablet server e1c3761c147a48d9adce3b892bfdb792: assigned location '/L0' 0301 23:04:00.755853 (+ 2979us) inbound_call.cc:162] Queueing success response Metrics: {"reported_tablets":0} /data/1/hao/kudu/src/kudu/integration-tests/location_assignment-itest.cc:185: Failure Failed Bad status: Timed out: ListTabletServers RPC failed: ListTabletServers RPC to 127.0.22.190:34129 timed out after 15.000s (SENT) /data/1/hao/kudu/src/kudu/integration-tests/location_assignment-itest.cc:217: Failure Expected: StartCluster() doesn't generate new fatal failures in the current thread. Actual: it does. I0301 23:04:00.836277 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 7227 W0301 23:04:00.840106 7174 connection.cc:647] server connection from 127.0.22.129:48737 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:48737): Connection reset by peer (error 104) I0301 23:04:00.840119 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 7350 W0301 23:04:00.842751 7176 connection.cc:647] server connection from 127.0.22.130:54155 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:54155): Connection reset by peer (error 104) I0301 23:04:00.842802 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 7481 W0301 23:04:00.845772 7174 connection.cc:647] server connection from 127.0.22.131:32809 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:32809): Connection reset by peer (error 104) I0301 23:04:00.845777 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 7605 W0301 23:04:00.848553 7176 connection.cc:647] server connection from 127.0.22.132:52427 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:52427): Connection reset by peer (error 104) I0301 23:04:00.848634 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 7727 W0301 23:04:00.852542 7173 connection.cc:647] server connection from 127.0.22.133:34799 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:34799): Connection reset by peer (error 104) I0301 23:04:00.852566 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 7849 W0301 23:04:00.856925 7175 connection.cc:647] server connection from 127.0.22.134:54849 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:54849): Connection reset by peer (error 104) I0301 23:04:00.857034 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 7972 W0301 23:04:00.859971 7174 connection.cc:647] server connection from 127.0.22.135:46637 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:46637): Connection reset by peer (error 104) I0301 23:04:00.860067 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 8095 W0301 23:04:00.862830 7173 connection.cc:647] server connection from 127.0.22.136:52711 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:52711): Connection reset by peer (error 104) I0301 23:04:00.862885 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 8218 W0301 23:04:00.866657 7173 connection.cc:647] server connection from 127.0.22.137:39043 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:39043): Connection reset by peer (error 104) I0301 23:04:00.866766 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 8341 W0301 23:04:00.869519 7176 connection.cc:647] server connection from 127.0.22.138:39531 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:39531): Connection reset by peer (error 104) I0301 23:04:00.869575 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 8463 W0301 23:04:00.872624 7174 connection.cc:647] server connection from 127.0.22.139:52249 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:52249): Connection reset by peer (error 104) I0301 23:04:00.872673 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 8586 W0301 23:04:00.876296 7174 connection.cc:647] server connection from 127.0.22.140:56875 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:56875): Connection reset by peer (error 104) I0301 23:04:00.876413 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 8709 W0301 23:04:00.879359 7173 connection.cc:647] server connection from 127.0.22.141:51387 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:51387): Connection reset by peer (error 104) I0301 23:04:00.879439 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 8831 W0301 23:04:00.882675 7173 connection.cc:647] server connection from 127.0.22.142:56229 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:56229): Connection reset by peer (error 104) I0301 23:04:00.882751 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 8954 W0301 23:04:00.886011 7174 connection.cc:647] server connection from 127.0.22.143:34067 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:34067): Connection reset by peer (error 104) I0301 23:04:00.886162 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 9077 W0301 23:04:00.889933 7176 connection.cc:647] server connection from 127.0.22.144:55247 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:55247): Connection reset by peer (error 104) I0301 23:04:00.889994 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 9199 W0301 23:04:00.893890 7175 connection.cc:647] server connection from 127.0.22.145:43783 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.145:43783): Connection reset by peer (error 104) I0301 23:04:00.893945 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 9321 W0301 23:04:00.897891 7176 connection.cc:647] server connection from 127.0.22.146:50321 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.146:50321): Connection reset by peer (error 104) I0301 23:04:00.897982 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 9443 W0301 23:04:00.902035 7173 connection.cc:647] server connection from 127.0.22.147:42085 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.147:42085): Connection reset by peer (error 104) I0301 23:04:00.902101 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 9565 W0301 23:04:00.905629 7173 connection.cc:647] server connection from 127.0.22.148:34925 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.148:34925): Connection reset by peer (error 104) I0301 23:04:00.905709 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 9687 W0301 23:04:00.910298 7176 connection.cc:647] server connection from 127.0.22.149:41719 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.149:41719): Connection reset by peer (error 104) I0301 23:04:00.910354 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 9809 W0301 23:04:00.914317 7175 connection.cc:647] server connection from 127.0.22.150:44507 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.150:44507): Connection reset by peer (error 104) I0301 23:04:00.914350 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 9931 W0301 23:04:00.919317 7176 connection.cc:647] server connection from 127.0.22.151:42785 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.151:42785): Connection reset by peer (error 104) I0301 23:04:00.919360 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 10054 W0301 23:04:00.922960 7176 connection.cc:647] server connection from 127.0.22.152:48223 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.152:48223): Connection reset by peer (error 104) I0301 23:04:00.923012 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 10176 W0301 23:04:00.926870 7176 connection.cc:647] server connection from 127.0.22.153:33709 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.153:33709): Connection reset by peer (error 104) I0301 23:04:00.926952 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 10298 W0301 23:04:00.930555 7176 connection.cc:647] server connection from 127.0.22.154:38395 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.154:38395): Connection reset by peer (error 104) I0301 23:04:00.930603 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 10420 W0301 23:04:00.935127 7175 connection.cc:647] server connection from 127.0.22.155:39187 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.155:39187): Connection reset by peer (error 104) I0301 23:04:00.935178 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 10542 W0301 23:04:00.938597 7174 connection.cc:647] server connection from 127.0.22.156:32849 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.156:32849): Connection reset by peer (error 104) I0301 23:04:00.938752 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 10664 W0301 23:04:00.942116 7175 connection.cc:647] server connection from 127.0.22.157:39635 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.157:39635): Connection reset by peer (error 104) I0301 23:04:00.942167 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 10786 W0301 23:04:00.945134 7176 connection.cc:647] server connection from 127.0.22.158:55559 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.158:55559): Connection reset by peer (error 104) I0301 23:04:00.945185 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 10908 W0301 23:04:00.947963 7176 connection.cc:647] server connection from 127.0.22.159:54325 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.159:54325): Connection reset by peer (error 104) I0301 23:04:00.948005 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 11030 W0301 23:04:00.950888 7176 connection.cc:647] server connection from 127.0.22.160:44025 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.160:44025): Connection reset by peer (error 104) I0301 23:04:00.950934 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 7166 W0301 23:04:00.954061 7165 connection.cc:647] client connection to 127.0.22.190:34129 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:34129): Connection reset by peer (error 104) I0301 23:04:00.954537 90 test_util.cc:135] ----------------------------------------------- I0301 23:04:00.954557 90 test_util.cc:136] Had fatal failures, leaving test files at /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_3.1551481418399944-90 [ FAILED ] TsLocationAssignmentITest.Basic/3, where GetParam() = (1, 32) (17233 ms) [ RUN ] TsLocationAssignmentITest.Basic/4 I0301 23:04:00.954807 90 test_util.cc:212] Using random seed: 1814686135 I0301 23:04:00.955209 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:34569 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:00.965853 11172 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:00.965943 11172 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:00.966727 11172 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:00.966747 11172 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:00.966751 11172 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:00.966755 11172 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:00.967787 11172 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:34569 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11172 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:00.968890 11172 master_main.cc:80] Initializing master server... I0301 23:04:00.969024 11172 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 36016us I0301 23:04:00.969121 11172 fs_manager.cc:263] Metadata directory not provided I0301 23:04:00.969146 11172 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:00.969182 11172 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:00.969208 11172 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:00.969761 11172 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/instance: uuid: "f49fa64b2d5949899171ac0bc1fa28fb" format_stamp: "Formatted at 2019-03-01 23:04:00 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:00.969913 11172 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal/instance: uuid: "f49fa64b2d5949899171ac0bc1fa28fb" format_stamp: "Formatted at 2019-03-01 23:04:00 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:00.971019 11172 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:00.971361 11172 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:00.971513 11172 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:00.972048 11172 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:00.972075 11172 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal uuid: "f49fa64b2d5949899171ac0bc1fa28fb" format_stamp: "Formatted at 2019-03-01 23:04:00 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:00.972092 11172 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:01.029309 11172 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:01.029484 11172 master_main.cc:83] Starting Master server... I0301 23:04:01.031913 11172 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:34569 I0301 23:04:01.031965 11172 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:04:01.031972 11172 webserver.cc:186] Document root disabled I0301 23:04:01.032097 11172 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:43825/ I0301 23:04:01.032464 11172 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:04:01.032671 11231 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:01.033998 11231 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:01.036923 11231 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:01.037142 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11172 W0301 23:04:01.037176 11231 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.189:33957: Network error: Client connection negotiation failed: client connection to 127.0.22.189:33957: connect: Connection refused (error 111) I0301 23:04:01.037330 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:33957 --webserver_interface=127.0.22.189 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:01.047638 11234 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:01.047724 11234 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:01.048542 11234 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:01.048566 11234 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:01.048573 11234 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:01.048578 11234 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:01.049571 11234 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:33957 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/info.pb --webserver_interface=127.0.22.189 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11234 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:01.050328 11234 master_main.cc:80] Initializing master server... I0301 23:04:01.050487 11234 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 36516us I0301 23:04:01.050581 11234 fs_manager.cc:263] Metadata directory not provided I0301 23:04:01.050608 11234 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:01.050647 11234 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:01.050662 11234 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:01.051151 11234 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/instance: uuid: "cc9637f299ca45958fc4317323142730" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.051306 11234 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal/instance: uuid: "cc9637f299ca45958fc4317323142730" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.052330 11234 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:04:01.052563 11234 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:01.052693 11234 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:01.053236 11234 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:01.053264 11234 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal uuid: "cc9637f299ca45958fc4317323142730" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.053283 11234 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:01.056301 11231 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } attempt: 1 W0301 23:04:01.056571 11231 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.189:33957: Network error: Client connection negotiation failed: client connection to 127.0.22.189:33957: connect: Connection refused (error 111) I0301 23:04:01.069232 11234 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:01.069375 11234 master_main.cc:83] Starting Master server... I0301 23:04:01.071179 11234 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.189:33957 I0301 23:04:01.071229 11234 webserver.cc:175] Starting webserver on 127.0.22.189:0 I0301 23:04:01.071241 11234 webserver.cc:186] Document root disabled I0301 23:04:01.071424 11234 webserver.cc:313] Webserver started. Bound to: http://127.0.22.189:36949/ I0301 23:04:01.071564 11234 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/info.pb I0301 23:04:01.071799 11293 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:01.073102 11293 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:01.075626 11293 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:01.077886 11293 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:01.078133 11293 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:44827: Network error: Client connection negotiation failed: client connection to 127.0.22.188:44827: connect: Connection refused (error 111) I0301 23:04:01.079003 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11234 I0301 23:04:01.079188 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:44827 --webserver_interface=127.0.22.188 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:01.089018 11296 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:01.089098 11296 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:01.089879 11296 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:01.089903 11296 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:01.089910 11296 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:01.089915 11296 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:01.090904 11296 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:44827 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/info.pb --webserver_interface=127.0.22.188 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11296 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:01.091666 11296 master_main.cc:80] Initializing master server... I0301 23:04:01.091804 11296 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 36516us I0301 23:04:01.091895 11296 fs_manager.cc:263] Metadata directory not provided I0301 23:04:01.091922 11296 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:01.091961 11296 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:01.091976 11296 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:01.092540 11296 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/instance: uuid: "d4350a9ed48a4cac976b095ded564010" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.092698 11296 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal/instance: uuid: "d4350a9ed48a4cac976b095ded564010" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.093668 11296 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:04:01.093861 11296 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:01.093978 11296 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:01.094579 11296 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:01.094609 11296 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal uuid: "d4350a9ed48a4cac976b095ded564010" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.094631 11296 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:01.097250 11293 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } attempt: 1 W0301 23:04:01.097512 11293 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:44827: Network error: Client connection negotiation failed: client connection to 127.0.22.188:44827: connect: Connection refused (error 111) I0301 23:04:01.104686 11231 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } attempt: 2 I0301 23:04:01.106866 11231 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:01.107086 11231 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:44827: Network error: Client connection negotiation failed: client connection to 127.0.22.188:44827: connect: Connection refused (error 111) I0301 23:04:01.126940 11296 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:01.127087 11296 master_main.cc:83] Starting Master server... I0301 23:04:01.129201 11296 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.188:44827 I0301 23:04:01.129247 11296 webserver.cc:175] Starting webserver on 127.0.22.188:0 I0301 23:04:01.129261 11296 webserver.cc:186] Document root disabled I0301 23:04:01.129364 11296 webserver.cc:313] Webserver started. Bound to: http://127.0.22.188:36503/ I0301 23:04:01.129467 11296 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/info.pb I0301 23:04:01.129662 11355 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:01.130864 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11296 I0301 23:04:01.130995 11355 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:01.131078 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:01.133780 11355 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:01.135905 11355 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:01.139070 11355 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: Bootstrap starting. I0301 23:04:01.139305 11355 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: No blocks or log segments found. Creating new log. I0301 23:04:01.139472 11355 log.cc:525] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: Log is configured to *not* fsync() on all Append() calls I0301 23:04:01.139755 11355 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: No bootstrap required, opened a new log I0301 23:04:01.140640 11355 raft_consensus.cc:340] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.140667 11355 raft_consensus.cc:366] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:01.140676 11355 raft_consensus.cc:705] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4350a9ed48a4cac976b095ded564010, State: Initialized, Role: FOLLOWER I0301 23:04:01.140734 11355 consensus_queue.cc:229] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.140827 11355 sys_catalog.cc:337] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.140848 11355 sys_catalog.cc:340] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.140884 11355 sys_catalog.cc:424] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:01.140888 11360 sys_catalog.cc:337] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.140941 11360 sys_catalog.cc:340] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.141105 11296 master_main.cc:86] Master server successfully started. W0301 23:04:01.141161 11361 catalog_manager.cc:1104] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:01.141191 11361 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:01.144198 11357 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:01.144301 11357 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:01.145329 11357 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:01.145375 11357 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:04:01.145638 11293 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } attempt: 2 I0301 23:04:01.146641 11357 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.11357 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:01.147871 11357 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:01.147882 11293 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Bootstrap starting. I0301 23:04:01.148078 11357 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 36516us I0301 23:04:01.148118 11293 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: No blocks or log segments found. Creating new log. I0301 23:04:01.148221 11357 fs_manager.cc:263] Metadata directory not provided I0301 23:04:01.148257 11357 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:01.148298 11293 log.cc:525] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Log is configured to *not* fsync() on all Append() calls I0301 23:04:01.148304 11357 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:01.148317 11357 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:01.149068 11357 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/instance: uuid: "d5f2f84537774779a4dc220b87941f9e" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.149260 11357 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal/instance: uuid: "d5f2f84537774779a4dc220b87941f9e" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.152369 11293 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: No bootstrap required, opened a new log I0301 23:04:01.152477 11357 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.000s sys 0.002s I0301 23:04:01.152743 11357 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:01.152822 11357 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:01.153352 11293 raft_consensus.cc:340] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.153378 11293 raft_consensus.cc:366] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:01.153401 11293 raft_consensus.cc:705] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9637f299ca45958fc4317323142730, State: Initialized, Role: FOLLOWER I0301 23:04:01.153455 11293 consensus_queue.cc:229] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.153517 11357 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:01.153554 11293 sys_catalog.cc:337] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.153563 11293 sys_catalog.cc:340] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.153558 11357 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal uuid: "d5f2f84537774779a4dc220b87941f9e" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.153581 11357 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:01.153595 11293 sys_catalog.cc:424] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:01.153793 11234 master_main.cc:86] Master server successfully started. I0301 23:04:01.156297 11370 sys_catalog.cc:337] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.156325 11370 sys_catalog.cc:340] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: This master's current role is: FOLLOWER W0301 23:04:01.156527 11371 catalog_manager.cc:1104] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:01.156553 11371 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:01.170217 11231 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } attempt: 1 I0301 23:04:01.172583 11231 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: Bootstrap starting. I0301 23:04:01.172816 11231 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: No blocks or log segments found. Creating new log. I0301 23:04:01.172981 11231 log.cc:525] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: Log is configured to *not* fsync() on all Append() calls I0301 23:04:01.176419 11231 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: No bootstrap required, opened a new log I0301 23:04:01.177322 11231 raft_consensus.cc:340] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.177350 11231 raft_consensus.cc:366] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:01.177357 11231 raft_consensus.cc:705] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49fa64b2d5949899171ac0bc1fa28fb, State: Initialized, Role: FOLLOWER I0301 23:04:01.177428 11231 consensus_queue.cc:229] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.177531 11231 sys_catalog.cc:337] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.177551 11231 sys_catalog.cc:340] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.177585 11231 sys_catalog.cc:424] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:01.177824 11172 master_main.cc:86] Master server successfully started. I0301 23:04:01.184273 11378 sys_catalog.cc:337] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.184300 11378 sys_catalog.cc:340] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: This master's current role is: FOLLOWER W0301 23:04:01.184499 11379 catalog_manager.cc:1104] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:01.184523 11379 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:01.193172 11357 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:01.193434 11357 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:01.193501 11357 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:01.198051 11357 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:39659 I0301 23:04:01.198117 11357 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:04:01.198141 11357 webserver.cc:186] Document root disabled I0301 23:04:01.198267 11357 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:35183/ I0301 23:04:01.198410 11357 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:04:01.198745 11357 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:01.202426 11491 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34569 I0301 23:04:01.202455 11491 heartbeater.cc:425] Registering TS with master... I0301 23:04:01.202500 11491 heartbeater.cc:474] Master 127.0.22.190:34569 requested a full tablet report, sending... I0301 23:04:01.202894 11489 heartbeater.cc:345] Connected to a master server at 127.0.22.188:44827 I0301 23:04:01.202927 11489 heartbeater.cc:425] Registering TS with master... I0301 23:04:01.202961 11489 heartbeater.cc:474] Master 127.0.22.188:44827 requested a full tablet report, sending... I0301 23:04:01.203707 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 11357 I0301 23:04:01.206575 11490 heartbeater.cc:345] Connected to a master server at 127.0.22.189:33957 I0301 23:04:01.206605 11490 heartbeater.cc:425] Registering TS with master... I0301 23:04:01.206638 11490 heartbeater.cc:474] Master 127.0.22.189:33957 requested a full tablet report, sending... I0301 23:04:01.245275 11322 ts_manager.cc:98] Registered new tserver with Master: d5f2f84537774779a4dc220b87941f9e (127.0.22.129:39659) I0301 23:04:01.272465 11198 ts_manager.cc:98] Registered new tserver with Master: d5f2f84537774779a4dc220b87941f9e (127.0.22.129:39659) W0301 23:04:01.279731 11187 tablet.cc:1786] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: Can't schedule compaction. Clean time has not been advanced past its initial value. W0301 23:04:01.319684 11249 tablet.cc:1786] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:04:01.354913 11360 raft_consensus.cc:472] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0301 23:04:01.355036 11360 raft_consensus.cc:494] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.355125 11360 leader_election.cc:292] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49fa64b2d5949899171ac0bc1fa28fb (127.0.22.190:34569), cc9637f299ca45958fc4317323142730 (127.0.22.189:33957) I0301 23:04:01.355473 11270 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d4350a9ed48a4cac976b095ded564010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc9637f299ca45958fc4317323142730" is_pre_election: true I0301 23:04:01.355478 11208 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d4350a9ed48a4cac976b095ded564010" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" is_pre_election: true I0301 23:04:01.355509 11270 raft_consensus.cc:2346] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4350a9ed48a4cac976b095ded564010 in term 0. I0301 23:04:01.355510 11208 raft_consensus.cc:2346] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4350a9ed48a4cac976b095ded564010 in term 0. I0301 23:04:01.355689 11306 leader_election.cc:306] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4350a9ed48a4cac976b095ded564010, f49fa64b2d5949899171ac0bc1fa28fb; no voters: I0301 23:04:01.355748 11360 raft_consensus.cc:2640] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0301 23:04:01.355777 11360 raft_consensus.cc:472] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0301 23:04:01.355784 11360 raft_consensus.cc:2886] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:01.357440 11255 ts_manager.cc:98] Registered new tserver with Master: d5f2f84537774779a4dc220b87941f9e (127.0.22.129:39659) I0301 23:04:01.360397 90 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0301 23:04:01.360860 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 11357 W0301 23:04:01.363803 11181 connection.cc:647] server connection from 127.0.22.129:47611 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:47611): Connection reset by peer (error 104) W0301 23:04:01.363822 11242 connection.cc:647] server connection from 127.0.22.129:39625 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:39625): Connection reset by peer (error 104) W0301 23:04:01.363822 11303 connection.cc:647] server connection from 127.0.22.129:58583 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:58583): Connection reset by peer (error 104) I0301 23:04:01.364050 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11172 W0301 23:04:01.367617 11171 connection.cc:647] client connection to 127.0.22.190:34569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:34569): Connection reset by peer (error 104) W0301 23:04:01.367635 11303 connection.cc:647] server connection from 127.0.0.1:56720 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:56720): Connection reset by peer (error 104) W0301 23:04:01.367650 11242 connection.cc:647] server connection from 127.0.0.1:34712 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:34712): Connection reset by peer (error 104) W0301 23:04:01.367815 11306 connection.cc:647] client connection to 127.0.22.190:34569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:34569): Connection reset by peer (error 104) W0301 23:04:01.367841 11244 connection.cc:647] client connection to 127.0.22.190:34569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:34569): Connection reset by peer (error 104) I0301 23:04:01.368202 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11234 W0301 23:04:01.371088 11171 connection.cc:647] client connection to 127.0.22.189:33957 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:33957): Connection reset by peer (error 104) W0301 23:04:01.371098 11304 connection.cc:647] server connection from 127.0.0.1:56718 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:56718): Connection reset by peer (error 104) W0301 23:04:01.371193 11305 connection.cc:647] client connection to 127.0.22.189:33957 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:33957): Connection reset by peer (error 104) I0301 23:04:01.371273 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11296 W0301 23:04:01.741096 11171 connection.cc:647] client connection to 127.0.22.188:44827 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.188:44827): Connection reset by peer (error 104) I0301 23:04:01.741322 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:34569 --webserver_interface=127.0.22.190 --webserver_port=43825 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:01.751603 11500 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:01.751684 11500 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:01.752514 11500 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:01.752535 11500 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:01.752539 11500 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:01.752543 11500 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:01.753545 11500 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:34569 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=43825 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11500 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:01.754326 11500 master_main.cc:80] Initializing master server... I0301 23:04:01.754499 11500 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 36516us I0301 23:04:01.754598 11500 fs_manager.cc:263] Metadata directory not provided I0301 23:04:01.754629 11500 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:01.755321 11500 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:04:01.755620 11500 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:01.755686 11500 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:01.756196 11500 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:01.756340 11500 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal uuid: "f49fa64b2d5949899171ac0bc1fa28fb" format_stamp: "Formatted at 2019-03-01 23:04:00 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.756371 11500 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:01.808122 11500 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:01.808298 11500 master_main.cc:83] Starting Master server... I0301 23:04:01.810565 11500 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:34569 I0301 23:04:01.810624 11500 webserver.cc:175] Starting webserver on 127.0.22.190:43825 I0301 23:04:01.810644 11500 webserver.cc:186] Document root disabled I0301 23:04:01.810778 11500 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:43825/ I0301 23:04:01.810905 11500 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:04:01.811377 11559 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:01.811617 11559 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: Bootstrap starting. I0301 23:04:01.813336 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11500 I0301 23:04:01.813496 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:33957 --webserver_interface=127.0.22.189 --webserver_port=36949 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 with env {} I0301 23:04:01.821002 11559 log.cc:525] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: Log is configured to *not* fsync() on all Append() calls I0301 23:04:01.821274 11559 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:01.821431 11559 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: Bootstrap complete. I0301 23:04:01.823652 11559 raft_consensus.cc:340] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.823679 11559 raft_consensus.cc:366] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:01.823685 11559 raft_consensus.cc:705] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f49fa64b2d5949899171ac0bc1fa28fb, State: Initialized, Role: FOLLOWER I0301 23:04:01.823743 11559 consensus_queue.cc:229] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.823842 11559 sys_catalog.cc:337] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.823865 11559 sys_catalog.cc:340] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.823876 11562 sys_catalog.cc:337] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.823884 11562 sys_catalog.cc:340] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.823901 11559 sys_catalog.cc:424] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:01.824270 11500 master_main.cc:86] Master server successfully started. W0301 23:04:01.824368 11563 catalog_manager.cc:1104] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:01.824403 11563 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:01.830729 11560 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:01.830812 11560 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:01.831604 11560 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:01.831624 11560 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:01.831629 11560 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:01.831632 11560 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:01.833937 11560 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:33957 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/info.pb --webserver_interface=127.0.22.189 --webserver_port=36949 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11560 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:01.834708 11560 master_main.cc:80] Initializing master server... I0301 23:04:01.834832 11560 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 36516us I0301 23:04:01.834941 11560 fs_manager.cc:263] Metadata directory not provided I0301 23:04:01.834970 11560 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:01.840371 11560 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s I0301 23:04:01.840569 11560 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:01.840634 11560 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:01.841167 11560 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:01.841300 11560 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal uuid: "cc9637f299ca45958fc4317323142730" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.841332 11560 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:01.915719 11560 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:01.915868 11560 master_main.cc:83] Starting Master server... I0301 23:04:01.918279 11560 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.189:33957 I0301 23:04:01.918345 11560 webserver.cc:175] Starting webserver on 127.0.22.189:36949 I0301 23:04:01.918365 11560 webserver.cc:186] Document root disabled I0301 23:04:01.918542 11560 webserver.cc:313] Webserver started. Bound to: http://127.0.22.189:36949/ I0301 23:04:01.918689 11560 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-1/data/info.pb I0301 23:04:01.919178 11623 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:01.919417 11623 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Bootstrap starting. I0301 23:04:01.924571 11623 log.cc:525] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Log is configured to *not* fsync() on all Append() calls I0301 23:04:01.924834 11623 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:01.924955 11623 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Bootstrap complete. I0301 23:04:01.927003 11623 raft_consensus.cc:340] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.927028 11623 raft_consensus.cc:366] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:01.927034 11623 raft_consensus.cc:705] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc9637f299ca45958fc4317323142730, State: Initialized, Role: FOLLOWER I0301 23:04:01.927098 11623 consensus_queue.cc:229] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.927181 11623 sys_catalog.cc:337] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.927199 11623 sys_catalog.cc:340] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.927219 11625 sys_catalog.cc:337] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.927227 11623 sys_catalog.cc:424] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:01.927248 11625 sys_catalog.cc:340] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.927522 11560 master_main.cc:86] Master server successfully started. W0301 23:04:01.927491 11626 catalog_manager.cc:1104] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:01.927551 11626 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:01.927870 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11560 I0301 23:04:01.928025 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:44827 --webserver_interface=127.0.22.188 --webserver_port=36503 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:01.941722 11628 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:01.941808 11628 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:01.942600 11628 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:01.942622 11628 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:01.942628 11628 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:01.942634 11628 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:01.943615 11628 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:44827 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/info.pb --webserver_interface=127.0.22.188 --webserver_port=36503 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11628 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:01.944483 11628 master_main.cc:80] Initializing master server... I0301 23:04:01.944622 11628 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 36516us I0301 23:04:01.944718 11628 fs_manager.cc:263] Metadata directory not provided I0301 23:04:01.944754 11628 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:01.948372 11628 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s I0301 23:04:01.948559 11628 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:01.948634 11628 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:01.949141 11628 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:01.949271 11628 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal uuid: "d4350a9ed48a4cac976b095ded564010" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:01.949306 11628 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:01.970290 11628 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:01.970451 11628 master_main.cc:83] Starting Master server... I0301 23:04:01.971988 11628 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.188:44827 I0301 23:04:01.972036 11628 webserver.cc:175] Starting webserver on 127.0.22.188:36503 I0301 23:04:01.972044 11628 webserver.cc:186] Document root disabled I0301 23:04:01.972148 11628 webserver.cc:313] Webserver started. Bound to: http://127.0.22.188:36503/ I0301 23:04:01.972705 11628 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/master-2/data/info.pb I0301 23:04:01.973479 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11628 I0301 23:04:01.973664 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:39659 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_port=35183 --webserver_interface=127.0.22.129 --tserver_master_addrs=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:01.976622 11687 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:01.976848 11687 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: Bootstrap starting. I0301 23:04:01.986017 11687 log.cc:525] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: Log is configured to *not* fsync() on all Append() calls I0301 23:04:01.986341 11687 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:01.986533 11687 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: Bootstrap complete. I0301 23:04:01.989742 11687 raft_consensus.cc:340] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.989801 11687 raft_consensus.cc:705] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4350a9ed48a4cac976b095ded564010, State: Initialized, Role: FOLLOWER I0301 23:04:01.989893 11687 consensus_queue.cc:229] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:01.990000 11687 sys_catalog.cc:337] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.990023 11687 sys_catalog.cc:340] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:01.990058 11687 sys_catalog.cc:424] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:01.990345 11628 master_main.cc:86] Master server successfully started. WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:01.991149 11688 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:01.991243 11688 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:01.991947 11688 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:01.991976 11688 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:04:01.992251 11690 sys_catalog.cc:337] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:01.992277 11690 sys_catalog.cc:340] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [sys.catalog]: This master's current role is: FOLLOWER W0301 23:04:01.992470 11691 catalog_manager.cc:1104] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:01.992492 11691 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:01.992930 11688 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:39659 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=35183 --tserver_master_addrs=127.0.22.190:34569,127.0.22.189:33957,127.0.22.188:44827 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.11688 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:01.993734 11688 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:01.993885 11688 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 36516us I0301 23:04:01.993973 11688 fs_manager.cc:263] Metadata directory not provided I0301 23:04:01.994009 11688 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:02.016369 11688 fs_manager.cc:399] Time spent opening directory manager: real 0.022s user 0.000s sys 0.001s I0301 23:04:02.016515 11688 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:02.016588 11688 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:02.017104 11688 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:02.017249 11688 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal uuid: "d5f2f84537774779a4dc220b87941f9e" format_stamp: "Formatted at 2019-03-01 23:04:01 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:02.017282 11688 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:02.049670 11625 raft_consensus.cc:472] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0301 23:04:02.049764 11625 raft_consensus.cc:494] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:02.049860 11625 leader_election.cc:292] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f49fa64b2d5949899171ac0bc1fa28fb (127.0.22.190:34569), d4350a9ed48a4cac976b095ded564010 (127.0.22.188:44827) I0301 23:04:02.052913 11688 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:02.053162 11688 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:02.053227 11688 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:02.055564 11664 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc9637f299ca45958fc4317323142730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4350a9ed48a4cac976b095ded564010" is_pre_election: true I0301 23:04:02.055601 11664 raft_consensus.cc:2276] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc9637f299ca45958fc4317323142730 in current term 1: Already voted for candidate d4350a9ed48a4cac976b095ded564010 in this term. I0301 23:04:02.055665 11536 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc9637f299ca45958fc4317323142730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" is_pre_election: true I0301 23:04:02.055693 11536 raft_consensus.cc:2346] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cc9637f299ca45958fc4317323142730 in term 0. I0301 23:04:02.055860 11574 leader_election.cc:306] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9637f299ca45958fc4317323142730, f49fa64b2d5949899171ac0bc1fa28fb; no voters: d4350a9ed48a4cac976b095ded564010 I0301 23:04:02.055912 11625 raft_consensus.cc:2640] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0301 23:04:02.055922 11625 raft_consensus.cc:472] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0301 23:04:02.055927 11625 raft_consensus.cc:2886] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:02.057981 11688 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:39659 I0301 23:04:02.058022 11688 webserver.cc:175] Starting webserver on 127.0.22.129:35183 I0301 23:04:02.058027 11688 webserver.cc:186] Document root disabled I0301 23:04:02.058152 11688 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:35183/ I0301 23:04:02.058270 11688 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_4.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:04:02.058637 11688 tablet_server_main.cc:93] Tablet server successfully started. W0301 23:04:02.059197 11515 tablet.cc:1786] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:04:02.061810 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 11688 I0301 23:04:02.062288 11815 heartbeater.cc:345] Connected to a master server at 127.0.22.188:44827 I0301 23:04:02.062335 11815 heartbeater.cc:425] Registering TS with master... I0301 23:04:02.062430 11815 heartbeater.cc:474] Master 127.0.22.188:44827 requested a full tablet report, sending... I0301 23:04:02.062772 11817 heartbeater.cc:345] Connected to a master server at 127.0.22.190:34569 I0301 23:04:02.062788 11817 heartbeater.cc:425] Registering TS with master... I0301 23:04:02.062825 11817 heartbeater.cc:474] Master 127.0.22.190:34569 requested a full tablet report, sending... I0301 23:04:02.063324 11816 heartbeater.cc:345] Connected to a master server at 127.0.22.189:33957 I0301 23:04:02.063336 11816 heartbeater.cc:425] Registering TS with master... I0301 23:04:02.063369 11816 heartbeater.cc:474] Master 127.0.22.189:33957 requested a full tablet report, sending... I0301 23:04:02.107986 11654 ts_manager.cc:98] Registered new tserver with Master: d5f2f84537774779a4dc220b87941f9e (127.0.22.129:39659) I0301 23:04:02.110930 11526 ts_manager.cc:98] Registered new tserver with Master: d5f2f84537774779a4dc220b87941f9e (127.0.22.129:39659) W0301 23:04:02.166357 11579 tablet.cc:1786] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Can't schedule compaction. Clean time has not been advanced past its initial value. W0301 23:04:02.222404 11643 tablet.cc:1786] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010: Can't schedule compaction. Clean time has not been advanced past its initial value. W0301 23:04:02.708554 11625 consensus_meta.cc:220] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730: Time spent flushing consensus metadata: real 0.653s user 0.001s sys 0.000s I0301 23:04:02.708642 11625 raft_consensus.cc:494] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:02.708734 11625 leader_election.cc:292] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [CANDIDATE]: Term 1 election: Requested vote from peers f49fa64b2d5949899171ac0bc1fa28fb (127.0.22.190:34569), d4350a9ed48a4cac976b095ded564010 (127.0.22.188:44827) I0301 23:04:02.709012 11664 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc9637f299ca45958fc4317323142730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4350a9ed48a4cac976b095ded564010" I0301 23:04:02.709041 11664 raft_consensus.cc:2276] T 00000000000000000000000000000000 P d4350a9ed48a4cac976b095ded564010 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate cc9637f299ca45958fc4317323142730 in current term 1: Already voted for candidate d4350a9ed48a4cac976b095ded564010 in this term. I0301 23:04:02.709102 11536 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cc9637f299ca45958fc4317323142730" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" I0301 23:04:02.709136 11536 raft_consensus.cc:2886] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:02.709877 11536 raft_consensus.cc:2346] T 00000000000000000000000000000000 P f49fa64b2d5949899171ac0bc1fa28fb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cc9637f299ca45958fc4317323142730 in term 1. I0301 23:04:02.711052 11574 leader_election.cc:306] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc9637f299ca45958fc4317323142730, f49fa64b2d5949899171ac0bc1fa28fb; no voters: d4350a9ed48a4cac976b095ded564010 I0301 23:04:02.711355 11625 raft_consensus.cc:2640] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:04:02.711504 11625 raft_consensus.cc:667] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [term 1 LEADER]: Becoming Leader. State: Replica: cc9637f299ca45958fc4317323142730, State: Running, Role: LEADER I0301 23:04:02.711640 11625 consensus_queue.cc:206] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } I0301 23:04:02.711983 11625 sys_catalog.cc:337] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: SysCatalogTable state changed. Reason: New leader cc9637f299ca45958fc4317323142730. Latest consensus state: current_term: 1 leader_uuid: "cc9637f299ca45958fc4317323142730" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f49fa64b2d5949899171ac0bc1fa28fb" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 34569 } } peers { permanent_uuid: "cc9637f299ca45958fc4317323142730" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 33957 } } peers { permanent_uuid: "d4350a9ed48a4cac976b095ded564010" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 44827 } } } I0301 23:04:02.712007 11625 sys_catalog.cc:340] T 00000000000000000000000000000000 P cc9637f299ca45958fc4317323142730 [sys.catalog]: This master's current role is: LEADER I0301 23:04:02.739179 11590 ts_manager.cc:98] Registered new tserver with Master: d5f2f84537774779a4dc220b87941f9e (127.0.22.129:39659) I0301 23:04:02.739277 11829 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:04:02.739437 11829 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:04:02.739468 90 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0301 23:04:02.739935 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 11688 W0301 23:04:02.744246 11573 connection.cc:647] server connection from 127.0.22.129:60591 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:60591): Connection reset by peer (error 104) W0301 23:04:02.744253 11507 connection.cc:647] server connection from 127.0.22.129:48267 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:48267): Connection reset by peer (error 104) W0301 23:04:02.744482 11636 connection.cc:647] server connection from 127.0.22.129:54573 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:54573): Connection reset by peer (error 104) I0301 23:04:02.744577 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11500 W0301 23:04:02.747354 11171 connection.cc:647] client connection to 127.0.22.190:34569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:34569): Connection reset by peer (error 104) W0301 23:04:02.747488 11574 connection.cc:647] client connection to 127.0.22.190:34569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:34569): Connection reset by peer (error 104) I0301 23:04:02.747548 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11560 W0301 23:04:02.749917 11171 connection.cc:647] client connection to 127.0.22.189:33957 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:33957): Connection reset by peer (error 104) W0301 23:04:02.749930 11637 connection.cc:647] server connection from 127.0.0.1:56730 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:56730): Connection reset by peer (error 104) I0301 23:04:02.750018 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11628 W0301 23:04:02.752457 11171 connection.cc:647] client connection to 127.0.22.188:44827 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.188:44827): Connection reset by peer (error 104) [ OK ] TsLocationAssignmentITest.Basic/4 (2068 ms) [ RUN ] TsLocationAssignmentITest.Basic/5 I0301 23:04:03.023208 90 test_util.cc:212] Using random seed: 1816754534 I0301 23:04:03.023695 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:33441 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.034327 11831 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.034426 11831 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.035188 11831 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:03.035212 11831 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.035219 11831 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:03.035225 11831 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:03.036264 11831 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:33441 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11831 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.037045 11831 master_main.cc:80] Initializing master server... I0301 23:04:03.037184 11831 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.037281 11831 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.037307 11831 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.037348 11831 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.037361 11831 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.037911 11831 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/instance: uuid: "d06e4e40077d447e9dec1c341ca89d7e" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.038074 11831 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal/instance: uuid: "d06e4e40077d447e9dec1c341ca89d7e" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.039083 11831 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:04:03.039278 11831 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.039351 11831 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.039872 11831 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.039902 11831 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal uuid: "d06e4e40077d447e9dec1c341ca89d7e" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.039927 11831 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.051867 11831 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.052023 11831 master_main.cc:83] Starting Master server... I0301 23:04:03.054056 11831 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:33441 I0301 23:04:03.054106 11831 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:04:03.054148 11831 webserver.cc:186] Document root disabled I0301 23:04:03.054280 11831 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:37875/ I0301 23:04:03.054404 11831 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:04:03.054622 11890 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:03.055215 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11831 I0301 23:04:03.055426 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:38639 --webserver_interface=127.0.22.189 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 with env {} I0301 23:04:03.056006 11890 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:03.059550 11890 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:03.059821 11890 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.189:38639: Network error: Client connection negotiation failed: client connection to 127.0.22.189:38639: connect: Connection refused (error 111) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.066340 11891 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.066439 11891 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.067200 11891 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:03.067221 11891 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.067226 11891 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:03.067230 11891 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:03.068300 11891 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:38639 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/info.pb --webserver_interface=127.0.22.189 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11891 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.069056 11891 master_main.cc:80] Initializing master server... I0301 23:04:03.069188 11891 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.069280 11891 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.069303 11891 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.069335 11891 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.069366 11891 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.069882 11891 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/instance: uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.070035 11891 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal/instance: uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.070994 11891 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:04:03.071183 11891 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.071244 11891 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.071753 11891 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.071779 11891 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.071795 11891 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.078944 11890 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } attempt: 1 W0301 23:04:03.079186 11890 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.189:38639: Network error: Client connection negotiation failed: client connection to 127.0.22.189:38639: connect: Connection refused (error 111) I0301 23:04:03.085139 11891 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.085284 11891 master_main.cc:83] Starting Master server... I0301 23:04:03.087307 11891 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.189:38639 I0301 23:04:03.087363 11891 webserver.cc:175] Starting webserver on 127.0.22.189:0 I0301 23:04:03.087368 11891 webserver.cc:186] Document root disabled I0301 23:04:03.087527 11891 webserver.cc:313] Webserver started. Bound to: http://127.0.22.189:44431/ I0301 23:04:03.087651 11891 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/info.pb I0301 23:04:03.087869 11952 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:03.089151 11952 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:03.091473 11952 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:03.093724 11952 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:03.093950 11952 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:41239: Network error: Client connection negotiation failed: client connection to 127.0.22.188:41239: connect: Connection refused (error 111) I0301 23:04:03.097340 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11891 I0301 23:04:03.097545 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:41239 --webserver_interface=127.0.22.188 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.107379 11955 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.107479 11955 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.108278 11955 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:03.108299 11955 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.108306 11955 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:03.108311 11955 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:03.109341 11955 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:41239 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/info.pb --webserver_interface=127.0.22.188 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.11955 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.110088 11955 master_main.cc:80] Initializing master server... I0301 23:04:03.110226 11955 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.110316 11955 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.110343 11955 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.110402 11955 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.110419 11955 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.110924 11955 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/instance: uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.111089 11955 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal/instance: uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.112020 11955 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:03.112277 11955 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.112339 11955 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.112875 11955 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.112903 11955 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.112922 11955 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.113067 11952 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } attempt: 1 W0301 23:04:03.113301 11952 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:41239: Network error: Client connection negotiation failed: client connection to 127.0.22.188:41239: connect: Connection refused (error 111) I0301 23:04:03.127306 11890 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } attempt: 2 I0301 23:04:03.129439 11890 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:03.129664 11890 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:41239: Network error: Client connection negotiation failed: client connection to 127.0.22.188:41239: connect: Connection refused (error 111) I0301 23:04:03.137259 11955 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.137408 11955 master_main.cc:83] Starting Master server... I0301 23:04:03.139219 11955 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.188:41239 I0301 23:04:03.139258 11955 webserver.cc:175] Starting webserver on 127.0.22.188:0 I0301 23:04:03.139263 11955 webserver.cc:186] Document root disabled I0301 23:04:03.139364 11955 webserver.cc:313] Webserver started. Bound to: http://127.0.22.188:37773/ I0301 23:04:03.139488 11955 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/info.pb I0301 23:04:03.139845 12014 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:03.141319 12014 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:03.143673 12014 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:03.145718 12014 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:03.148274 12014 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: Bootstrap starting. I0301 23:04:03.148521 12014 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: No blocks or log segments found. Creating new log. I0301 23:04:03.148653 12014 log.cc:525] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: Log is configured to *not* fsync() on all Append() calls I0301 23:04:03.148887 12014 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: No bootstrap required, opened a new log I0301 23:04:03.149101 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 11955 I0301 23:04:03.149304 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:03.149813 12014 raft_consensus.cc:340] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:03.149840 12014 raft_consensus.cc:366] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:03.149860 12014 raft_consensus.cc:705] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b19bbe45e5b4143aa6d29f74bbeb505, State: Initialized, Role: FOLLOWER I0301 23:04:03.149911 12014 consensus_queue.cc:229] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:03.150015 12014 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:03.150040 12014 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:03.150041 12019 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:03.150072 12019 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:03.150102 12014 sys_catalog.cc:424] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: configured and running, proceeding with master startup. W0301 23:04:03.150352 12020 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:03.150444 12020 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:03.150372 11955 master_main.cc:86] Master server successfully started. WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.159219 12018 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.159307 12018 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.160008 12018 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.160043 12018 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:04:03.160951 12018 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.12018 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.161447 11952 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } attempt: 2 I0301 23:04:03.161849 12018 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:03.162032 12018 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.162127 12018 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.162154 12018 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.162199 12018 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.162215 12018 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.162844 12018 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/instance: uuid: "97193d2fb4b340e097dff2c963be9989" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.163041 12018 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal/instance: uuid: "97193d2fb4b340e097dff2c963be9989" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.164307 12018 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s I0301 23:04:03.164564 11952 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: Bootstrap starting. I0301 23:04:03.164625 12018 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.164705 12018 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.164837 11952 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: No blocks or log segments found. Creating new log. I0301 23:04:03.165015 11952 log.cc:525] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: Log is configured to *not* fsync() on all Append() calls I0301 23:04:03.165302 11952 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: No bootstrap required, opened a new log I0301 23:04:03.165406 12018 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.165441 12018 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal uuid: "97193d2fb4b340e097dff2c963be9989" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.165470 12018 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.166580 11952 raft_consensus.cc:340] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:03.166612 11952 raft_consensus.cc:366] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:03.166620 11952 raft_consensus.cc:705] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1eb2a1c3784c9093c9f3ea1fc78643, State: Initialized, Role: FOLLOWER I0301 23:04:03.166676 11952 consensus_queue.cc:229] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:03.166788 11952 sys_catalog.cc:337] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:03.166813 11952 sys_catalog.cc:340] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:03.166849 11952 sys_catalog.cc:424] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:03.167070 11891 master_main.cc:86] Master server successfully started. I0301 23:04:03.168292 12029 sys_catalog.cc:337] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:03.168316 12029 sys_catalog.cc:340] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: This master's current role is: FOLLOWER W0301 23:04:03.168499 12030 catalog_manager.cc:1104] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:03.168519 12030 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:03.192798 11890 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } attempt: 1 I0301 23:04:03.195914 11890 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: Bootstrap starting. I0301 23:04:03.196235 11890 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: No blocks or log segments found. Creating new log. I0301 23:04:03.196424 11890 log.cc:525] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: Log is configured to *not* fsync() on all Append() calls I0301 23:04:03.200412 11890 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: No bootstrap required, opened a new log I0301 23:04:03.201725 11890 raft_consensus.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:03.201757 11890 raft_consensus.cc:366] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:03.201766 11890 raft_consensus.cc:705] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e4e40077d447e9dec1c341ca89d7e, State: Initialized, Role: FOLLOWER I0301 23:04:03.201849 11890 consensus_queue.cc:229] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:03.201970 11890 sys_catalog.cc:337] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:03.201997 11890 sys_catalog.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:03.202030 11890 sys_catalog.cc:424] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:03.202352 11831 master_main.cc:86] Master server successfully started. I0301 23:04:03.204250 12037 sys_catalog.cc:337] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:03.204275 12037 sys_catalog.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:03.204293 12037 raft_consensus.cc:472] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0301 23:04:03.204330 12037 raft_consensus.cc:494] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:03.204432 12037 leader_election.cc:292] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef1eb2a1c3784c9093c9f3ea1fc78643 (127.0.22.189:38639), 6b19bbe45e5b4143aa6d29f74bbeb505 (127.0.22.188:41239) W0301 23:04:03.204612 12038 catalog_manager.cc:1104] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:03.204623 12038 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:03.204638 11929 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d06e4e40077d447e9dec1c341ca89d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" is_pre_election: true I0301 23:04:03.204679 11929 raft_consensus.cc:2346] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e4e40077d447e9dec1c341ca89d7e in term 0. I0301 23:04:03.204718 11991 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d06e4e40077d447e9dec1c341ca89d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" is_pre_election: true I0301 23:04:03.204740 11991 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d06e4e40077d447e9dec1c341ca89d7e in term 0. I0301 23:04:03.204861 11840 leader_election.cc:306] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d06e4e40077d447e9dec1c341ca89d7e, ef1eb2a1c3784c9093c9f3ea1fc78643; no voters: I0301 23:04:03.204917 12039 raft_consensus.cc:2640] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 0 FOLLOWER]: Leader pre-election won for term 1 I0301 23:04:03.204928 12039 raft_consensus.cc:472] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0301 23:04:03.204936 12039 raft_consensus.cc:2886] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:03.216979 12018 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.217186 12018 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:03.217247 12018 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:03.221092 12018 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:46043 I0301 23:04:03.221151 12018 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:04:03.221158 12018 webserver.cc:186] Document root disabled I0301 23:04:03.221329 12018 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:32849/ I0301 23:04:03.221487 12018 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:04:03.221869 12018 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:03.231467 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 12018 I0301 23:04:03.231726 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:0 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:03.232376 12151 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:03.232427 12151 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.232467 12151 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:03.233111 12149 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:03.233160 12149 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.233224 12149 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:03.233253 12150 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:03.233340 12150 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.233415 12150 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.268105 12156 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.280244 12156 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.280979 12156 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.281009 12156 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:04:03.281890 12156 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.12156 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.282835 12156 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:03.283007 12156 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.283089 12156 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.283133 12156 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.283185 12156 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.283201 12156 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.283776 12156 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/instance: uuid: "685ba81c1a9240b5aac09c4d54725bc6" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.283942 12156 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal/instance: uuid: "685ba81c1a9240b5aac09c4d54725bc6" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.296723 12156 fs_manager.cc:503] Time spent creating directory manager: real 0.013s user 0.000s sys 0.002s I0301 23:04:03.296994 12156 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.297086 12156 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.297871 12156 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.297909 12156 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal uuid: "685ba81c1a9240b5aac09c4d54725bc6" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.297936 12156 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0301 23:04:03.302232 11846 tablet.cc:1786] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:04:03.316057 11981 ts_manager.cc:98] Registered new tserver with Master: 97193d2fb4b340e097dff2c963be9989 (127.0.22.129:46043) I0301 23:04:03.320719 11919 ts_manager.cc:98] Registered new tserver with Master: 97193d2fb4b340e097dff2c963be9989 (127.0.22.129:46043) I0301 23:04:03.328150 12156 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.328441 12156 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:03.328501 12156 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:03.331331 12156 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:36313 I0301 23:04:03.331382 12156 webserver.cc:175] Starting webserver on 127.0.22.130:0 I0301 23:04:03.331401 12156 webserver.cc:186] Document root disabled I0301 23:04:03.331554 12156 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:36177/ I0301 23:04:03.331677 12156 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:04:03.332350 12156 tablet_server_main.cc:93] Tablet server successfully started. W0301 23:04:03.335475 11908 tablet.cc:1786] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:04:03.335726 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 12156 I0301 23:04:03.336026 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:0 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:03.336294 12277 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:03.336311 12277 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.336346 12277 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:03.336485 12279 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:03.336505 12279 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.336536 12279 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:03.337826 12278 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:03.337852 12278 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.337891 12278 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.369747 12284 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.369840 12284 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.370563 12284 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.370597 12284 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:04:03.371484 12284 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.12284 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.380425 12284 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:03.380599 12284 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.380689 12284 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.380717 12284 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.380764 12284 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.380784 12284 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.381345 12284 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/instance: uuid: "c9f1b59e9f0f45a2b9a7455ca6e29352" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.381526 12284 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal/instance: uuid: "c9f1b59e9f0f45a2b9a7455ca6e29352" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.382563 12284 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:03.382850 12284 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.382944 12284 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.383658 12284 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.383694 12284 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal uuid: "c9f1b59e9f0f45a2b9a7455ca6e29352" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.383719 12284 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0301 23:04:03.387686 11970 tablet.cc:1786] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:04:03.415920 12284 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.416144 12284 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:03.416256 12284 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:03.420967 12284 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:39489 I0301 23:04:03.421012 12284 webserver.cc:175] Starting webserver on 127.0.22.131:0 I0301 23:04:03.421020 12284 webserver.cc:186] Document root disabled I0301 23:04:03.421182 12284 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:34265/ I0301 23:04:03.421298 12284 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:04:03.421699 12284 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:03.425140 12407 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:03.425176 12407 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.425223 12407 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:03.425261 12406 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:03.425283 12406 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.425312 12406 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:03.425498 12405 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:03.425501 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 12284 I0301 23:04:03.425521 12405 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.425556 12405 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:03.425740 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:0 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.438027 12412 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.438119 12412 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.439283 12412 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.439319 12412 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:04:03.440594 12412 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.12412 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.441426 12412 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:03.441596 12412 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.441681 12412 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.441709 12412 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.441751 12412 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.441771 12412 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.442445 12412 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/instance: uuid: "f825188e0ad4499ba1be3325acd1e27b" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.442598 12412 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal/instance: uuid: "f825188e0ad4499ba1be3325acd1e27b" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.443857 12412 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:03.444136 12412 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.444236 12412 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.444980 12412 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.445011 12412 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal uuid: "f825188e0ad4499ba1be3325acd1e27b" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.445044 12412 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.495271 12412 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.495524 12412 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:03.495584 12412 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:03.500684 12412 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:33783 I0301 23:04:03.500735 12412 webserver.cc:175] Starting webserver on 127.0.22.132:0 I0301 23:04:03.500751 12412 webserver.cc:186] Document root disabled I0301 23:04:03.500883 12412 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:45147/ I0301 23:04:03.501035 12412 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:04:03.501489 12412 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:03.504920 12533 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:03.504961 12533 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.504998 12533 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:03.505589 12531 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:03.505645 12531 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.505688 12531 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:03.506120 12532 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:03.506145 12532 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.506177 12532 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:03.507871 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 12412 I0301 23:04:03.508127 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:0 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.521754 12538 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.521847 12538 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.522851 12538 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.522884 12538 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:04:03.524197 12538 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.12538 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.525367 12538 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:03.525560 12538 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.525648 12538 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.525674 12538 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.525729 12538 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.525745 12538 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.526409 12538 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/instance: uuid: "9b2e49cd40254a6c8976f591cf142c28" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.526582 12538 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal/instance: uuid: "9b2e49cd40254a6c8976f591cf142c28" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.527962 12538 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s I0301 23:04:03.528290 12538 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.528363 12538 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.529011 12538 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.529042 12538 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal uuid: "9b2e49cd40254a6c8976f591cf142c28" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.529073 12538 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.564962 12538 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.565177 12538 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:03.565244 12538 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:03.570323 12538 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:41435 I0301 23:04:03.570374 12538 webserver.cc:175] Starting webserver on 127.0.22.133:0 I0301 23:04:03.570399 12538 webserver.cc:186] Document root disabled I0301 23:04:03.570535 12538 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:45167/ I0301 23:04:03.570652 12538 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:04:03.571038 12538 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:03.576845 12659 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:03.576870 12659 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.576871 12658 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:03.576895 12658 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.576938 12658 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:03.576939 12659 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:03.576975 12657 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:03.577019 12657 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.577055 12657 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:03.580334 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 12538 I0301 23:04:03.580600 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:0 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.593967 12664 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.594058 12664 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.595058 12664 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.595093 12664 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:04:03.596314 12664 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.12664 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.597487 12664 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:03.597662 12664 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.597750 12664 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.597777 12664 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.597826 12664 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.597842 12664 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.598544 12664 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/instance: uuid: "a637b77534124e2fa7d0e09b4cdec9c3" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.598721 12664 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal/instance: uuid: "a637b77534124e2fa7d0e09b4cdec9c3" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.600085 12664 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s I0301 23:04:03.600420 12664 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.600489 12664 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.601159 12664 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.601207 12664 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal uuid: "a637b77534124e2fa7d0e09b4cdec9c3" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.601240 12664 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.643471 12664 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.643712 12664 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:03.643760 12664 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:03.648741 12664 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:41221 I0301 23:04:03.648790 12664 webserver.cc:175] Starting webserver on 127.0.22.134:0 I0301 23:04:03.648797 12664 webserver.cc:186] Document root disabled I0301 23:04:03.648928 12664 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:39789/ I0301 23:04:03.649042 12664 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:04:03.649582 12664 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:03.652693 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 12664 I0301 23:04:03.652920 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:0 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:03.653319 12783 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:03.653349 12783 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.653405 12783 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:03.653537 12784 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:03.653561 12784 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.653611 12784 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:03.656738 12785 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:03.656801 12785 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.656889 12785 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.666561 12790 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.666656 12790 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.667644 12790 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.667680 12790 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:04:03.668892 12790 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.12790 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.670034 12790 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:03.670213 12790 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.670300 12790 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.670325 12790 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.670377 12790 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.670403 12790 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.671074 12790 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/instance: uuid: "9100bd7a5c7545d183e0f79f8d0e9c6f" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.671248 12790 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal/instance: uuid: "9100bd7a5c7545d183e0f79f8d0e9c6f" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.672778 12790 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s I0301 23:04:03.673085 12790 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.673154 12790 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.673858 12790 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.673887 12790 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal uuid: "9100bd7a5c7545d183e0f79f8d0e9c6f" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.673909 12790 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.688884 12039 raft_consensus.cc:494] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:03.688979 12039 leader_election.cc:292] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [CANDIDATE]: Term 1 election: Requested vote from peers ef1eb2a1c3784c9093c9f3ea1fc78643 (127.0.22.189:38639), 6b19bbe45e5b4143aa6d29f74bbeb505 (127.0.22.188:41239) I0301 23:04:03.694298 11929 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d06e4e40077d447e9dec1c341ca89d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" I0301 23:04:03.694345 11929 raft_consensus.cc:2886] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:03.694361 11991 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d06e4e40077d447e9dec1c341ca89d7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" I0301 23:04:03.694408 11991 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:03.695339 11919 ts_manager.cc:98] Registered new tserver with Master: 685ba81c1a9240b5aac09c4d54725bc6 (127.0.22.130:36313) I0301 23:04:03.726992 11981 ts_manager.cc:98] Registered new tserver with Master: 685ba81c1a9240b5aac09c4d54725bc6 (127.0.22.130:36313) I0301 23:04:03.771309 12790 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.771579 12790 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:03.771638 12790 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:03.789691 12790 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:32951 I0301 23:04:03.789746 12790 webserver.cc:175] Starting webserver on 127.0.22.135:0 I0301 23:04:03.789767 12790 webserver.cc:186] Document root disabled I0301 23:04:03.789911 12790 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:43361/ I0301 23:04:03.790041 12790 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:04:03.790328 12790 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:03.795145 12912 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:03.795171 12912 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.795186 12914 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:03.795204 12914 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.795209 12912 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:03.795238 12914 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:03.795806 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 12790 I0301 23:04:03.796082 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:0 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:03.799424 12913 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:03.799448 12913 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.799489 12913 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:03.810356 11857 ts_manager.cc:98] Registered new tserver with Master: 97193d2fb4b340e097dff2c963be9989 (127.0.22.129:46043) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:03.823827 12919 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:03.823915 12919 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:03.824681 12919 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:03.824717 12919 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:04:03.825593 12919 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.12919 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:03.826377 12919 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:03.826561 12919 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 37516us I0301 23:04:03.826648 12919 fs_manager.cc:263] Metadata directory not provided I0301 23:04:03.826676 12919 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:03.826720 12919 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:03.826740 12919 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:03.827272 12919 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/instance: uuid: "d5f037b598fc432e9e460a31c1589440" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.827458 12919 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal/instance: uuid: "d5f037b598fc432e9e460a31c1589440" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.832476 12919 fs_manager.cc:503] Time spent creating directory manager: real 0.005s user 0.001s sys 0.001s I0301 23:04:03.832859 12919 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:03.832932 12919 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:03.833626 12919 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:03.833659 12919 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal uuid: "d5f037b598fc432e9e460a31c1589440" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:03.833683 12919 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:03.869696 12919 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:03.869966 12919 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:03.870023 12919 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:03.875609 12919 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:38235 I0301 23:04:03.875661 12919 webserver.cc:175] Starting webserver on 127.0.22.136:0 I0301 23:04:03.875672 12919 webserver.cc:186] Document root disabled I0301 23:04:03.875808 12919 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:37843/ I0301 23:04:03.875944 12919 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:04:03.876416 12919 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:03.880569 13039 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:03.880620 13039 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.880699 13039 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:03.880920 13041 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:03.880941 13041 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.881007 13041 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:03.881217 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 12919 I0301 23:04:03.882061 13040 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:03.882124 13040 heartbeater.cc:425] Registering TS with master... I0301 23:04:03.882215 13040 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... W0301 23:04:04.204928 12038 catalog_manager.cc:1104] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:04.204980 12038 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:04.674198 11916 ts_manager.cc:98] Registered new tserver with Master: 9b2e49cd40254a6c8976f591cf142c28 (127.0.22.133:41435) I0301 23:04:04.674348 11916 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:43799 (request call id 2) took 1097ms. Request Metrics: {} W0301 23:04:04.950989 11929 consensus_meta.cc:220] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: Time spent flushing consensus metadata: real 1.257s user 0.001s sys 0.000s I0301 23:04:04.951064 11929 raft_consensus.cc:2346] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e4e40077d447e9dec1c341ca89d7e in term 1. I0301 23:04:04.951126 11929 rpcz_store.cc:269] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:39824 (request call id 3) took 1256ms. Request Metrics: {} W0301 23:04:04.951799 12030 catalog_manager.cc:1104] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:04.951817 12030 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:04.951937 11840 leader_election.cc:306] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d06e4e40077d447e9dec1c341ca89d7e, ef1eb2a1c3784c9093c9f3ea1fc78643; no voters: I0301 23:04:04.952100 13048 raft_consensus.cc:2640] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:04:04.952287 13048 raft_consensus.cc:667] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 1 LEADER]: Becoming Leader. State: Replica: d06e4e40077d447e9dec1c341ca89d7e, State: Running, Role: LEADER I0301 23:04:04.952366 13048 consensus_queue.cc:206] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:04.952659 13049 sys_catalog.cc:337] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader d06e4e40077d447e9dec1c341ca89d7e. Latest consensus state: current_term: 1 leader_uuid: "d06e4e40077d447e9dec1c341ca89d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:04.952677 13049 sys_catalog.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: This master's current role is: LEADER I0301 23:04:04.965564 11979 ts_manager.cc:98] Registered new tserver with Master: f825188e0ad4499ba1be3325acd1e27b (127.0.22.132:33783) I0301 23:04:04.965638 11979 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:43113 (request call id 2) took 1459ms. Request Metrics: {} W0301 23:04:04.975894 11991 consensus_meta.cc:220] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: Time spent flushing consensus metadata: real 1.281s user 0.001s sys 0.000s I0301 23:04:04.975963 11991 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d06e4e40077d447e9dec1c341ca89d7e in term 1. I0301 23:04:04.976020 11991 rpcz_store.cc:269] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:57308 (request call id 3) took 1281ms. Request Metrics: {} W0301 23:04:04.976698 12020 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:04.976714 12020 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:05.477434 11991 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 1 FOLLOWER]: Refusing update from remote peer d06e4e40077d447e9dec1c341ca89d7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0301 23:04:05.477849 13053 consensus_queue.cc:984] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0301 23:04:05.478591 13054 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d06e4e40077d447e9dec1c341ca89d7e. Latest consensus state: current_term: 1 leader_uuid: "d06e4e40077d447e9dec1c341ca89d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:05.478657 13054 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:05.479343 13056 sys_catalog.cc:337] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d06e4e40077d447e9dec1c341ca89d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:05.479362 13056 sys_catalog.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: This master's current role is: LEADER I0301 23:04:05.479552 11929 raft_consensus.cc:1181] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 1 FOLLOWER]: Refusing update from remote peer d06e4e40077d447e9dec1c341ca89d7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0301 23:04:05.479629 13054 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d06e4e40077d447e9dec1c341ca89d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:05.479640 13054 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:05.479936 13053 consensus_queue.cc:984] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0301 23:04:05.480597 13059 sys_catalog.cc:337] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d06e4e40077d447e9dec1c341ca89d7e. Latest consensus state: current_term: 1 leader_uuid: "d06e4e40077d447e9dec1c341ca89d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:05.480623 13059 sys_catalog.cc:340] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:05.480665 13059 sys_catalog.cc:337] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d06e4e40077d447e9dec1c341ca89d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:05.480692 13059 sys_catalog.cc:340] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: This master's current role is: FOLLOWER W0301 23:04:05.952033 12030 catalog_manager.cc:1104] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:05.952064 12030 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:05.963631 11855 ts_manager.cc:98] Registered new tserver with Master: c9f1b59e9f0f45a2b9a7455ca6e29352 (127.0.22.131:39489) I0301 23:04:05.963752 11850 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:34589 (request call id 3) took 1152ms. Request Metrics: {} I0301 23:04:05.963775 11855 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:41169 (request call id 2) took 2538ms. Request Metrics: {"spinlock_wait_cycles":618132864} I0301 23:04:05.969657 11978 ts_manager.cc:98] Registered new tserver with Master: 9b2e49cd40254a6c8976f591cf142c28 (127.0.22.133:41435) I0301 23:04:05.969718 11978 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:37515 (request call id 2) took 2392ms. Request Metrics: {} I0301 23:04:05.969830 11974 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:60447 (request call id 3) took 1652ms. Request Metrics: {"spinlock_wait_cycles":1517163264} W0301 23:04:05.976974 12020 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:05.977006 12020 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:06.010696 13065 sys_catalog.cc:337] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d06e4e40077d447e9dec1c341ca89d7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:06.010722 13065 sys_catalog.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: This master's current role is: LEADER I0301 23:04:06.020293 11917 ts_manager.cc:98] Registered new tserver with Master: f825188e0ad4499ba1be3325acd1e27b (127.0.22.132:33783) I0301 23:04:06.020360 11917 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:54357 (request call id 2) took 2513ms. Request Metrics: {} I0301 23:04:06.044333 11856 ts_manager.cc:98] Registered new tserver with Master: 685ba81c1a9240b5aac09c4d54725bc6 (127.0.22.130:36313) I0301 23:04:06.044468 11856 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:38923 (request call id 2) took 2707ms. Request Metrics: {"spinlock_wait_cycles":823913856} I0301 23:04:06.056855 11980 ts_manager.cc:98] Registered new tserver with Master: c9f1b59e9f0f45a2b9a7455ca6e29352 (127.0.22.131:39489) I0301 23:04:06.056926 11980 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:48253 (request call id 2) took 2631ms. Request Metrics: {} I0301 23:04:06.947250 11981 ts_manager.cc:98] Registered new tserver with Master: 9100bd7a5c7545d183e0f79f8d0e9c6f (127.0.22.135:32951) I0301 23:04:06.947423 11981 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.135:48947 (request call id 2) took 3151ms. Request Metrics: {"spinlock_wait_cycles":2715521792} W0301 23:04:06.952445 12030 catalog_manager.cc:1104] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:06.952478 12030 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:06.977214 12020 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:06.977250 12020 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:07.938246 11914 ts_manager.cc:98] Registered new tserver with Master: d5f037b598fc432e9e460a31c1589440 (127.0.22.136:38235) I0301 23:04:07.938350 11914 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:55921 (request call id 2) took 4055ms. Request Metrics: {"spinlock_wait_cycles":2458689408} I0301 23:04:07.938433 11913 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:54135 (request call id 3) took 3616ms. Request Metrics: {"spinlock_wait_cycles":1450527616} I0301 23:04:07.938520 11916 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:34337 (request call id 3) took 3242ms. Request Metrics: {"spinlock_wait_cycles":588735232} I0301 23:04:07.952128 11976 ts_manager.cc:98] Registered new tserver with Master: d5f037b598fc432e9e460a31c1589440 (127.0.22.136:38235) I0301 23:04:07.952226 11976 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:44027 (request call id 2) took 4070ms. Request Metrics: {"spinlock_wait_cycles":2518240000} I0301 23:04:07.952366 11973 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:56197 (request call id 3) took 3224ms. Request Metrics: {"spinlock_wait_cycles":572653312} W0301 23:04:07.952721 12030 catalog_manager.cc:1104] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:07.952751 12030 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:07.952961 11975 rpcz_store.cc:269] Call kudu.master.MasterService.ListTabletServers from 127.0.0.1:57310 (request call id 1) took 4068ms. Request Metrics: {} I0301 23:04:07.959575 11853 ts_manager.cc:98] Registered new tserver with Master: 9b2e49cd40254a6c8976f591cf142c28 (127.0.22.133:41435) I0301 23:04:07.959652 11853 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:44023 (request call id 2) took 4382ms. Request Metrics: {"spinlock_wait_cycles":270342016} W0301 23:04:07.977505 12020 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:07.977530 12020 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:07.979449 11918 ts_manager.cc:98] Registered new tserver with Master: c9f1b59e9f0f45a2b9a7455ca6e29352 (127.0.22.131:39489) I0301 23:04:07.979511 11918 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:40725 (request call id 2) took 4553ms. Request Metrics: {} I0301 23:04:07.979542 11912 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:43799 (request call id 3) took 2302ms. Request Metrics: {} I0301 23:04:08.024740 11919 ts_manager.cc:98] Registered new tserver with Master: 9100bd7a5c7545d183e0f79f8d0e9c6f (127.0.22.135:32951) I0301 23:04:08.024859 11919 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.135:60683 (request call id 2) took 4225ms. Request Metrics: {"spinlock_wait_cycles":2648242048} I0301 23:04:08.928129 11977 ts_manager.cc:98] Registered new tserver with Master: a637b77534124e2fa7d0e09b4cdec9c3 (127.0.22.134:41221) I0301 23:04:08.928267 11977 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:40685 (request call id 2) took 5274ms. Request Metrics: {} I0301 23:04:08.942824 11915 ts_manager.cc:98] Registered new tserver with Master: a637b77534124e2fa7d0e09b4cdec9c3 (127.0.22.134:41221) I0301 23:04:08.942886 11915 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:50635 (request call id 2) took 5289ms. Request Metrics: {} I0301 23:04:08.942953 11917 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:54357 (request call id 3) took 1921ms. Request Metrics: {} W0301 23:04:08.953061 12030 catalog_manager.cc:1104] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:08.953078 12030 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:08.977664 12020 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:08.977689 12020 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:09.002851 11857 ts_manager.cc:98] Registered new tserver with Master: d5f037b598fc432e9e460a31c1589440 (127.0.22.136:38235) I0301 23:04:09.002909 11857 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:34077 (request call id 2) took 5121ms. Request Metrics: {} I0301 23:04:09.004536 11855 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:34589 (request call id 4) took 2036ms. Request Metrics: {} I0301 23:04:09.039710 11852 ts_manager.cc:98] Registered new tserver with Master: a637b77534124e2fa7d0e09b4cdec9c3 (127.0.22.134:41221) I0301 23:04:09.039808 11852 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:53773 (request call id 2) took 5382ms. Request Metrics: {"spinlock_wait_cycles":86008192} I0301 23:04:09.074885 11851 ts_manager.cc:98] Registered new tserver with Master: 9100bd7a5c7545d183e0f79f8d0e9c6f (127.0.22.135:32951) I0301 23:04:09.074957 11851 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.135:35765 (request call id 2) took 5279ms. Request Metrics: {} I0301 23:04:09.109645 11854 ts_manager.cc:98] Registered new tserver with Master: f825188e0ad4499ba1be3325acd1e27b (127.0.22.132:33783) I0301 23:04:09.109727 11854 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:58155 (request call id 2) took 5604ms. Request Metrics: {"spinlock_wait_cycles":435217664} I0301 23:04:09.109789 13051 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:04:09.109953 13051 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:04:09.110003 11853 rpcz_store.cc:269] Call kudu.master.MasterService.ListTabletServers from 127.0.0.1:46546 (request call id 1) took 1126ms. Request Metrics: {} I0301 23:04:09.112848 90 external_mini_cluster.cc:623] 8 TS(s) registered with all masters I0301 23:04:09.113550 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 12018 W0301 23:04:09.116997 11840 connection.cc:647] server connection from 127.0.22.129:34589 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:34589): Connection reset by peer (error 104) W0301 23:04:09.117007 11900 connection.cc:647] server connection from 127.0.22.129:54135 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:54135): Connection reset by peer (error 104) I0301 23:04:09.117044 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 12156 W0301 23:04:09.117698 11965 connection.cc:647] server connection from 127.0.22.129:60447 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:60447): Connection reset by peer (error 104) I0301 23:04:09.120278 11850 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:38923 (request call id 3) took 2075ms. Request Metrics: {} W0301 23:04:09.120429 11838 connection.cc:647] server connection from 127.0.22.130:38923 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:38923): Connection reset by peer (error 104) W0301 23:04:09.120442 11838 connection.cc:554] Connection torn down before Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:38923 (request call id 3) could send its response W0301 23:04:09.120501 11900 connection.cc:647] server connection from 127.0.22.130:34337 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:34337): Connection reset by peer (error 104) I0301 23:04:09.120579 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 12284 W0301 23:04:09.120606 11964 connection.cc:647] server connection from 127.0.22.130:56197 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:56197): Connection reset by peer (error 104) W0301 23:04:09.122838 11965 connection.cc:647] server connection from 127.0.22.131:48253 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:48253): Connection reset by peer (error 104) W0301 23:04:09.122866 11839 connection.cc:647] server connection from 127.0.22.131:41169 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:41169): Connection reset by peer (error 104) W0301 23:04:09.122897 11901 connection.cc:647] server connection from 127.0.22.131:40725 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:40725): Connection reset by peer (error 104) I0301 23:04:09.122931 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 12412 W0301 23:04:09.126314 11965 connection.cc:647] server connection from 127.0.22.132:43113 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:43113): Connection reset by peer (error 104) W0301 23:04:09.126333 11901 connection.cc:647] server connection from 127.0.22.132:54357 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:54357): Connection reset by peer (error 104) W0301 23:04:09.126341 11841 connection.cc:647] server connection from 127.0.22.132:58155 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:58155): Connection reset by peer (error 104) I0301 23:04:09.126487 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 12538 W0301 23:04:09.129628 11838 connection.cc:647] server connection from 127.0.22.133:44023 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:44023): Connection reset by peer (error 104) W0301 23:04:09.129644 11901 connection.cc:647] server connection from 127.0.22.133:43799 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:43799): Connection reset by peer (error 104) W0301 23:04:09.129703 11963 connection.cc:647] server connection from 127.0.22.133:37515 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:37515): Connection reset by peer (error 104) I0301 23:04:09.129825 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 12664 W0301 23:04:09.132905 11840 connection.cc:647] server connection from 127.0.22.134:53773 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:53773): Connection reset by peer (error 104) W0301 23:04:09.132936 11903 connection.cc:647] server connection from 127.0.22.134:50635 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:50635): Connection reset by peer (error 104) W0301 23:04:09.132966 11965 connection.cc:647] server connection from 127.0.22.134:40685 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:40685): Connection reset by peer (error 104) I0301 23:04:09.132988 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 12790 I0301 23:04:09.134567 13051 catalog_manager.cc:941] Generated new certificate authority record I0301 23:04:09.135479 13051 catalog_manager.cc:1066] Loading token signing keys... W0301 23:04:09.135594 11901 connection.cc:647] server connection from 127.0.22.135:60683 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:60683): Connection reset by peer (error 104) W0301 23:04:09.135594 11841 connection.cc:647] server connection from 127.0.22.135:35765 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:35765): Connection reset by peer (error 104) I0301 23:04:09.135639 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 12919 W0301 23:04:09.137027 11965 connection.cc:647] server connection from 127.0.22.135:48947 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:48947): Connection reset by peer (error 104) W0301 23:04:09.139446 11840 connection.cc:647] server connection from 127.0.22.136:34077 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:34077): Connection reset by peer (error 104) W0301 23:04:09.139448 11903 connection.cc:647] server connection from 127.0.22.136:55921 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:55921): Connection reset by peer (error 104) I0301 23:04:09.139474 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11831 W0301 23:04:09.139561 11965 connection.cc:647] server connection from 127.0.22.136:44027 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:44027): Connection reset by peer (error 104) W0301 23:04:09.142779 11830 connection.cc:647] client connection to 127.0.22.190:33441 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:33441): Connection reset by peer (error 104) W0301 23:04:09.142812 11962 connection.cc:647] server connection from 127.0.0.1:57308 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:57308): Connection reset by peer (error 104) W0301 23:04:09.142889 11902 connection.cc:647] client connection to 127.0.22.190:33441 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:33441): Connection reset by peer (error 104) W0301 23:04:09.142810 11964 connection.cc:647] client connection to 127.0.22.190:33441 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:33441): Connection reset by peer (error 104) I0301 23:04:09.143023 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11891 W0301 23:04:09.143043 11902 connection.cc:647] server connection from 127.0.0.1:39824 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39824): Connection reset by peer (error 104) W0301 23:04:09.145751 11830 connection.cc:647] client connection to 127.0.22.189:38639 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:38639): Connection reset by peer (error 104) W0301 23:04:09.145751 11962 connection.cc:647] server connection from 127.0.0.1:57306 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:57306): Connection reset by peer (error 104) W0301 23:04:09.145768 11964 connection.cc:647] client connection to 127.0.22.189:38639 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:38639): Connection reset by peer (error 104) I0301 23:04:09.145885 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 11955 W0301 23:04:09.148352 11830 connection.cc:647] client connection to 127.0.22.188:41239 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.188:41239): Connection reset by peer (error 104) I0301 23:04:09.148628 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:33441 --webserver_interface=127.0.22.190 --webserver_port=37875 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.159742 13093 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.159864 13093 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.161056 13093 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:09.161078 13093 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.161083 13093 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:09.161087 13093 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:09.162125 13093 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:33441 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=37875 --never_fsync=true --heap_profile_path=/tmp/kudu-master.13093 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.163194 13093 master_main.cc:80] Initializing master server... I0301 23:04:09.163345 13093 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.163486 13093 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.163523 13093 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.164454 13093 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:09.164605 13093 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.164664 13093 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.165112 13093 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.165220 13093 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal uuid: "d06e4e40077d447e9dec1c341ca89d7e" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.165251 13093 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.186465 13093 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.186585 13093 master_main.cc:83] Starting Master server... I0301 23:04:09.188818 13093 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:33441 I0301 23:04:09.188863 13093 webserver.cc:175] Starting webserver on 127.0.22.190:37875 I0301 23:04:09.188868 13093 webserver.cc:186] Document root disabled I0301 23:04:09.188983 13093 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:37875/ I0301 23:04:09.189121 13093 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:04:09.189791 13152 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:09.190063 13152 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: Bootstrap starting. I0301 23:04:09.190503 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 13093 I0301 23:04:09.190665 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:38639 --webserver_interface=127.0.22.189 --webserver_port=44431 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 with env {} I0301 23:04:09.196077 13152 log.cc:525] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: Log is configured to *not* fsync() on all Append() calls I0301 23:04:09.196741 13152 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:09.196940 13152 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: Bootstrap complete. I0301 23:04:09.199049 13152 raft_consensus.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:09.199080 13152 raft_consensus.cc:705] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: d06e4e40077d447e9dec1c341ca89d7e, State: Initialized, Role: FOLLOWER I0301 23:04:09.199147 13152 consensus_queue.cc:229] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:09.199234 13152 sys_catalog.cc:337] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:09.199255 13152 sys_catalog.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:09.199292 13152 sys_catalog.cc:424] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:09.199448 13155 sys_catalog.cc:337] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:09.199570 13093 master_main.cc:86] Master server successfully started. I0301 23:04:09.199645 13155 sys_catalog.cc:340] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e [sys.catalog]: This master's current role is: FOLLOWER WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.202481 13153 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.202569 13153 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.203361 13153 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:09.203419 13153 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.203428 13153 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:09.203434 13153 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:09.204529 13153 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:38639 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/info.pb --webserver_interface=127.0.22.189 --webserver_port=44431 --never_fsync=true --heap_profile_path=/tmp/kudu-master.13153 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.204648 13156 catalog_manager.cc:1102] T 00000000000000000000000000000000 P d06e4e40077d447e9dec1c341ca89d7e: acquiring CA information for follower catalog manager: success W0301 23:04:09.204695 13156 catalog_manager.cc:587] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry I0301 23:04:09.205350 13153 master_main.cc:80] Initializing master server... I0301 23:04:09.205502 13153 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.205626 13153 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.205649 13153 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.206445 13153 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.206632 13153 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.206693 13153 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.207269 13153 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.207377 13153 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.207449 13153 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.239419 13153 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.239552 13153 master_main.cc:83] Starting Master server... I0301 23:04:09.241329 13153 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.189:38639 I0301 23:04:09.241371 13153 webserver.cc:175] Starting webserver on 127.0.22.189:44431 I0301 23:04:09.241376 13153 webserver.cc:186] Document root disabled I0301 23:04:09.241533 13153 webserver.cc:313] Webserver started. Bound to: http://127.0.22.189:44431/ I0301 23:04:09.241659 13153 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-1/data/info.pb I0301 23:04:09.242338 13216 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:09.242660 13216 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: Bootstrap starting. I0301 23:04:09.243852 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 13153 I0301 23:04:09.244048 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:41239 --webserver_interface=127.0.22.188 --webserver_port=37773 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 with env {} I0301 23:04:09.248270 13216 log.cc:525] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: Log is configured to *not* fsync() on all Append() calls I0301 23:04:09.248962 13216 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:09.249181 13216 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: Bootstrap complete. I0301 23:04:09.252468 13216 raft_consensus.cc:340] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:09.252501 13216 raft_consensus.cc:705] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef1eb2a1c3784c9093c9f3ea1fc78643, State: Initialized, Role: FOLLOWER I0301 23:04:09.252569 13216 consensus_queue.cc:229] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:09.252665 13216 sys_catalog.cc:337] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:09.252707 13216 sys_catalog.cc:340] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:09.252744 13216 sys_catalog.cc:424] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:09.253298 13153 master_main.cc:86] Master server successfully started. I0301 23:04:09.256263 13219 sys_catalog.cc:337] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:09.256301 13219 sys_catalog.cc:340] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:09.257299 13220 catalog_manager.cc:1102] T 00000000000000000000000000000000 P ef1eb2a1c3784c9093c9f3ea1fc78643: acquiring CA information for follower catalog manager: success W0301 23:04:09.257354 13220 catalog_manager.cc:587] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.276517 13217 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.276813 13217 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.277920 13217 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:09.277950 13217 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.277956 13217 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:09.277961 13217 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:09.279436 13217 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:4 --map /L1:3 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:41239 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/info.pb --webserver_interface=127.0.22.188 --webserver_port=37773 --never_fsync=true --heap_profile_path=/tmp/kudu-master.13217 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.288560 13217 master_main.cc:80] Initializing master server... I0301 23:04:09.288682 13217 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.288765 13217 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.288795 13217 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.289572 13217 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:09.289808 13217 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.289891 13217 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.290699 13217 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.290853 13217 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.290894 13217 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.329180 13217 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.329337 13217 master_main.cc:83] Starting Master server... I0301 23:04:09.331818 13217 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.188:41239 I0301 23:04:09.331876 13217 webserver.cc:175] Starting webserver on 127.0.22.188:37773 I0301 23:04:09.331882 13217 webserver.cc:186] Document root disabled I0301 23:04:09.332039 13217 webserver.cc:313] Webserver started. Bound to: http://127.0.22.188:37773/ I0301 23:04:09.332543 13217 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/master-2/data/info.pb I0301 23:04:09.336630 13280 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:09.336853 13280 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: Bootstrap starting. I0301 23:04:09.340544 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 13217 I0301 23:04:09.340740 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:46043 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_port=32849 --webserver_interface=127.0.22.129 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:09.351011 13280 log.cc:525] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: Log is configured to *not* fsync() on all Append() calls I0301 23:04:09.351709 13280 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:09.351912 13280 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: Bootstrap complete. I0301 23:04:09.354375 13280 raft_consensus.cc:340] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:09.354442 13280 raft_consensus.cc:705] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b19bbe45e5b4143aa6d29f74bbeb505, State: Initialized, Role: FOLLOWER I0301 23:04:09.354504 13280 consensus_queue.cc:229] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } I0301 23:04:09.354629 13280 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:09.354653 13280 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:09.354691 13280 sys_catalog.cc:424] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:09.354748 13283 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d06e4e40077d447e9dec1c341ca89d7e" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 33441 } } peers { permanent_uuid: "ef1eb2a1c3784c9093c9f3ea1fc78643" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 38639 } } peers { permanent_uuid: "6b19bbe45e5b4143aa6d29f74bbeb505" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41239 } } } I0301 23:04:09.354971 13217 master_main.cc:86] Master server successfully started. I0301 23:04:09.354859 13283 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505 [sys.catalog]: This master's current role is: FOLLOWER WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.355322 13281 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.355484 13281 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0301 23:04:09.355996 13284 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 6b19bbe45e5b4143aa6d29f74bbeb505: acquiring CA information for follower catalog manager: success W0301 23:04:09.356056 13284 catalog_manager.cc:587] Not found: no TSK found in the system table: failed to prepare follower catalog manager, will retry W0301 23:04:09.356554 13281 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.356598 13281 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:04:09.357883 13281 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:46043 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=32849 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.13281 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.359166 13281 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:09.359347 13281 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.359481 13281 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.359534 13281 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.364503 13281 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.000s sys 0.000s I0301 23:04:09.364682 13281 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.364763 13281 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.365555 13281 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.365728 13281 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal uuid: "97193d2fb4b340e097dff2c963be9989" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.365772 13281 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.389941 13281 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.390183 13281 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:09.390254 13281 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:09.394189 13281 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:46043 I0301 23:04:09.394248 13281 webserver.cc:175] Starting webserver on 127.0.22.129:32849 I0301 23:04:09.394255 13281 webserver.cc:186] Document root disabled I0301 23:04:09.394429 13281 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:32849/ I0301 23:04:09.394584 13281 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:04:09.394958 13281 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:09.402675 13406 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:09.402707 13406 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.402747 13406 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:09.403187 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 13281 I0301 23:04:09.403367 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:36313 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_port=36177 --webserver_interface=127.0.22.130 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:09.405045 13404 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:09.405066 13404 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.405099 13404 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:09.409319 13405 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:09.409337 13405 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.409377 13405 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.419137 13414 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.419234 13414 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.420303 13414 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.420346 13414 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:04:09.421655 13414 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:36313 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=36177 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.13414 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.423056 13414 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:09.423251 13414 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.423349 13414 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.423424 13414 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.424470 13414 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:09.424624 13414 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.424705 13414 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.425437 13414 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.425603 13414 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal uuid: "685ba81c1a9240b5aac09c4d54725bc6" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.425648 13414 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.440235 13119 ts_manager.cc:98] Registered new tserver with Master: 97193d2fb4b340e097dff2c963be9989 (127.0.22.129:46043) I0301 23:04:09.463621 13414 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.463847 13414 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:09.463927 13414 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:09.467984 13414 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:36313 I0301 23:04:09.468035 13414 webserver.cc:175] Starting webserver on 127.0.22.130:36177 I0301 23:04:09.468044 13414 webserver.cc:186] Document root disabled I0301 23:04:09.468196 13414 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:36177/ I0301 23:04:09.468340 13414 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:04:09.468714 13414 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:09.476084 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 13414 I0301 23:04:09.476312 13538 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:09.476316 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:39489 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_port=34265 --webserver_interface=127.0.22.131 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:09.476438 13538 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.476518 13538 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:09.479024 13536 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:09.479074 13536 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.479142 13536 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:09.479380 13537 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:09.479441 13537 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.479470 13537 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:09.517918 13238 ts_manager.cc:98] Registered new tserver with Master: 97193d2fb4b340e097dff2c963be9989 (127.0.22.129:46043) I0301 23:04:09.518821 13183 ts_manager.cc:98] Registered new tserver with Master: 97193d2fb4b340e097dff2c963be9989 (127.0.22.129:46043) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.520318 13543 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.520462 13543 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.521498 13543 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.521540 13543 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:04:09.522799 13543 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:39489 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=34265 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.13543 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.524000 13543 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:09.544226 13543 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.544329 13543 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.544359 13543 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.545167 13543 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:04:09.545328 13543 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.545439 13543 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.546001 13543 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.546166 13543 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal uuid: "c9f1b59e9f0f45a2b9a7455ca6e29352" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.546207 13543 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.567430 13543 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.567658 13543 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:09.567757 13543 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:09.570756 13119 ts_manager.cc:98] Registered new tserver with Master: 685ba81c1a9240b5aac09c4d54725bc6 (127.0.22.130:36313) I0301 23:04:09.572229 13543 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:39489 I0301 23:04:09.572284 13543 webserver.cc:175] Starting webserver on 127.0.22.131:34265 I0301 23:04:09.572299 13543 webserver.cc:186] Document root disabled I0301 23:04:09.572453 13543 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:34265/ I0301 23:04:09.572576 13543 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:04:09.573192 13543 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:09.577698 13666 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:09.577751 13666 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.577809 13666 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:09.578110 13667 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:09.578136 13667 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.578171 13667 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:09.580533 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 13543 I0301 23:04:09.580706 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:33783 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_port=45147 --webserver_interface=127.0.22.132 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:09.593222 13665 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:09.593250 13665 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.593282 13665 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.623733 13673 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.623838 13673 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.633033 13673 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.633072 13673 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:04:09.634348 13673 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:33783 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=45147 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.13673 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.635629 13673 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:09.635823 13673 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.635912 13673 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.635963 13673 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.639493 13182 ts_manager.cc:98] Registered new tserver with Master: 685ba81c1a9240b5aac09c4d54725bc6 (127.0.22.130:36313) I0301 23:04:09.648633 13247 ts_manager.cc:98] Registered new tserver with Master: 685ba81c1a9240b5aac09c4d54725bc6 (127.0.22.130:36313) I0301 23:04:09.649171 13673 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.649727 13673 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.649875 13673 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.650562 13673 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.650727 13673 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal uuid: "f825188e0ad4499ba1be3325acd1e27b" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.650768 13673 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.666589 13673 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.666831 13673 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:09.666918 13673 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:09.672253 13673 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:33783 I0301 23:04:09.672307 13673 webserver.cc:175] Starting webserver on 127.0.22.132:45147 I0301 23:04:09.672325 13673 webserver.cc:186] Document root disabled I0301 23:04:09.672497 13673 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:45147/ I0301 23:04:09.672641 13673 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:04:09.672992 13673 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:09.677170 13795 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:09.677187 13795 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.677192 13796 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:09.677208 13796 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.677224 13795 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:09.677243 13796 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:09.677484 13794 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:09.677528 13794 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.677584 13794 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:09.679833 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 13673 I0301 23:04:09.680035 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:41435 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_port=45167 --webserver_interface=127.0.22.133 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:09.693874 13119 ts_manager.cc:98] Registered new tserver with Master: c9f1b59e9f0f45a2b9a7455ca6e29352 (127.0.22.131:39489) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.718727 13801 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.718835 13801 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.719895 13801 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.719938 13801 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:04:09.723455 13183 ts_manager.cc:98] Registered new tserver with Master: c9f1b59e9f0f45a2b9a7455ca6e29352 (127.0.22.131:39489) I0301 23:04:09.723736 13801 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:41435 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=45167 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.13801 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.725000 13801 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:09.725183 13801 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.725277 13801 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.725345 13801 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.725713 13118 ts_manager.cc:98] Registered new tserver with Master: f825188e0ad4499ba1be3325acd1e27b (127.0.22.132:33783) I0301 23:04:09.727128 13801 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:09.727304 13801 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.727417 13801 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.728191 13801 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.728363 13801 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal uuid: "9b2e49cd40254a6c8976f591cf142c28" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.728438 13801 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.734594 13238 ts_manager.cc:98] Registered new tserver with Master: c9f1b59e9f0f45a2b9a7455ca6e29352 (127.0.22.131:39489) I0301 23:04:09.767822 13801 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.768102 13801 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:09.768189 13801 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:09.771049 13182 ts_manager.cc:98] Registered new tserver with Master: f825188e0ad4499ba1be3325acd1e27b (127.0.22.132:33783) I0301 23:04:09.771927 13801 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:41435 I0301 23:04:09.771999 13801 webserver.cc:175] Starting webserver on 127.0.22.133:45167 I0301 23:04:09.772032 13801 webserver.cc:186] Document root disabled I0301 23:04:09.772307 13801 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:45167/ I0301 23:04:09.772493 13801 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:04:09.772881 13801 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:09.777693 13923 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:09.777711 13923 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.777751 13923 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:09.777890 13924 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:09.777923 13924 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.777952 13925 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:09.777993 13925 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.778033 13925 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:09.777957 13924 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:09.779815 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 13801 I0301 23:04:09.779995 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:41221 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_port=39789 --webserver_interface=127.0.22.134 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:09.780270 13247 ts_manager.cc:98] Registered new tserver with Master: f825188e0ad4499ba1be3325acd1e27b (127.0.22.132:33783) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.791208 13932 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.791307 13932 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.792378 13932 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.792461 13932 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:04:09.793722 13932 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:41221 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=39789 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.13932 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.794934 13932 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:09.795181 13932 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.795280 13932 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.795320 13932 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.796308 13932 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:09.797303 13932 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.797425 13932 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.798053 13932 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.798218 13932 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal uuid: "a637b77534124e2fa7d0e09b4cdec9c3" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.798259 13932 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.817872 13238 ts_manager.cc:98] Registered new tserver with Master: 9b2e49cd40254a6c8976f591cf142c28 (127.0.22.133:41435) I0301 23:04:09.818717 13118 ts_manager.cc:98] Registered new tserver with Master: 9b2e49cd40254a6c8976f591cf142c28 (127.0.22.133:41435) I0301 23:04:09.819835 13182 ts_manager.cc:98] Registered new tserver with Master: 9b2e49cd40254a6c8976f591cf142c28 (127.0.22.133:41435) I0301 23:04:09.824512 13932 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.824724 13932 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:09.824791 13932 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:09.828974 13932 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:41221 I0301 23:04:09.829026 13932 webserver.cc:175] Starting webserver on 127.0.22.134:39789 I0301 23:04:09.829035 13932 webserver.cc:186] Document root disabled I0301 23:04:09.829165 13932 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:39789/ I0301 23:04:09.829289 13932 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:04:09.829666 13932 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:09.831966 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 13932 I0301 23:04:09.832160 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:32951 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_port=43361 --webserver_interface=127.0.22.135 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:09.834044 14053 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:09.834058 14054 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:09.834081 14053 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.834089 14054 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.834128 14053 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:09.834132 14054 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:09.834535 14052 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:09.834583 14052 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.834640 14052 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.851629 14059 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.851709 14059 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0301 23:04:09.860606 13182 ts_manager.cc:98] Registered new tserver with Master: a637b77534124e2fa7d0e09b4cdec9c3 (127.0.22.134:41221) W0301 23:04:09.864537 14059 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.864578 14059 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:04:09.865487 14059 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:32951 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=43361 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.14059 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.866325 14059 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:09.866521 14059 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.866611 14059 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.866647 14059 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.867485 14059 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:09.867617 14059 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.867692 14059 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.868477 14059 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.868643 14059 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal uuid: "9100bd7a5c7545d183e0f79f8d0e9c6f" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.868680 14059 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.888155 13238 ts_manager.cc:98] Registered new tserver with Master: a637b77534124e2fa7d0e09b4cdec9c3 (127.0.22.134:41221) I0301 23:04:09.892216 13118 ts_manager.cc:98] Registered new tserver with Master: a637b77534124e2fa7d0e09b4cdec9c3 (127.0.22.134:41221) I0301 23:04:09.905303 14059 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.905563 14059 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:09.905624 14059 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:09.910255 14059 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:32951 I0301 23:04:09.910331 14059 webserver.cc:175] Starting webserver on 127.0.22.135:43361 I0301 23:04:09.910336 14059 webserver.cc:186] Document root disabled I0301 23:04:09.910487 14059 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:43361/ I0301 23:04:09.910624 14059 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:04:09.912195 14059 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:09.914613 14181 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:09.914641 14181 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.914680 14181 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:09.915123 14183 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:09.915140 14183 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.915161 14182 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:09.915169 14183 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:09.915174 14182 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.915205 14182 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:09.915529 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 14059 I0301 23:04:09.915690 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:38235 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_port=37843 --webserver_interface=127.0.22.136 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:09.941761 14191 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:09.941848 14191 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:09.942606 14191 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:09.942647 14191 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:04:09.943564 14191 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:38235 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=37843 --tserver_master_addrs=127.0.22.190:33441,127.0.22.189:38639,127.0.22.188:41239 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.14191 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:09.948536 14191 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:09.948727 14191 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 40516us I0301 23:04:09.948818 14191 fs_manager.cc:263] Metadata directory not provided I0301 23:04:09.948854 14191 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:09.952452 14191 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s I0301 23:04:09.952632 14191 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:09.952729 14191 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:09.953433 14191 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:09.953624 14191 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal uuid: "d5f037b598fc432e9e460a31c1589440" format_stamp: "Formatted at 2019-03-01 23:04:03 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:09.953689 14191 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:09.956714 13238 ts_manager.cc:98] Registered new tserver with Master: 9100bd7a5c7545d183e0f79f8d0e9c6f (127.0.22.135:32951) I0301 23:04:09.961247 13118 ts_manager.cc:98] Registered new tserver with Master: 9100bd7a5c7545d183e0f79f8d0e9c6f (127.0.22.135:32951) I0301 23:04:09.962080 13182 ts_manager.cc:98] Registered new tserver with Master: 9100bd7a5c7545d183e0f79f8d0e9c6f (127.0.22.135:32951) I0301 23:04:09.979213 14191 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:09.979475 14191 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:09.979537 14191 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:09.985117 14191 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:38235 I0301 23:04:09.985164 14191 webserver.cc:175] Starting webserver on 127.0.22.136:37843 I0301 23:04:09.985169 14191 webserver.cc:186] Document root disabled I0301 23:04:09.985277 14191 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:37843/ I0301 23:04:09.985450 14191 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_5.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:04:09.986115 14191 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:09.989699 14310 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41239 I0301 23:04:09.989718 14310 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.989754 14310 heartbeater.cc:474] Master 127.0.22.188:41239 requested a full tablet report, sending... I0301 23:04:09.990010 14311 heartbeater.cc:345] Connected to a master server at 127.0.22.189:38639 I0301 23:04:09.990036 14311 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.990070 14311 heartbeater.cc:474] Master 127.0.22.189:38639 requested a full tablet report, sending... I0301 23:04:09.990245 14312 heartbeater.cc:345] Connected to a master server at 127.0.22.190:33441 I0301 23:04:09.990268 14312 heartbeater.cc:425] Registering TS with master... I0301 23:04:09.990298 14312 heartbeater.cc:474] Master 127.0.22.190:33441 requested a full tablet report, sending... I0301 23:04:09.991674 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 14191 I0301 23:04:10.071790 13238 ts_manager.cc:98] Registered new tserver with Master: d5f037b598fc432e9e460a31c1589440 (127.0.22.136:38235) I0301 23:04:10.077116 13182 ts_manager.cc:98] Registered new tserver with Master: d5f037b598fc432e9e460a31c1589440 (127.0.22.136:38235) I0301 23:04:10.078032 13118 ts_manager.cc:98] Registered new tserver with Master: d5f037b598fc432e9e460a31c1589440 (127.0.22.136:38235) I0301 23:04:10.080262 90 external_mini_cluster.cc:623] 8 TS(s) registered with all masters I0301 23:04:10.080999 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 13281 W0301 23:04:10.084309 13100 connection.cc:647] server connection from 127.0.22.129:41897 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:41897): Connection reset by peer (error 104) W0301 23:04:10.084360 13165 connection.cc:647] server connection from 127.0.22.129:33569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:33569): Connection reset by peer (error 104) W0301 23:04:10.084432 13230 connection.cc:647] server connection from 127.0.22.129:55051 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:55051): Connection reset by peer (error 104) I0301 23:04:10.084455 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 13414 W0301 23:04:10.086921 13165 connection.cc:647] server connection from 127.0.22.130:43225 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:43225): Connection reset by peer (error 104) W0301 23:04:10.086938 13231 connection.cc:647] server connection from 127.0.22.130:59183 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:59183): Connection reset by peer (error 104) W0301 23:04:10.086953 13101 connection.cc:647] server connection from 127.0.22.130:53887 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:53887): Connection reset by peer (error 104) I0301 23:04:10.086966 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 13543 W0301 23:04:10.089221 13101 connection.cc:647] server connection from 127.0.22.131:35629 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:35629): Connection reset by peer (error 104) W0301 23:04:10.089256 13230 connection.cc:647] server connection from 127.0.22.131:53081 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:53081): Connection reset by peer (error 104) W0301 23:04:10.089267 13164 connection.cc:647] server connection from 127.0.22.131:37277 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:37277): Connection reset by peer (error 104) I0301 23:04:10.089277 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 13673 W0301 23:04:10.091774 13101 connection.cc:647] server connection from 127.0.22.132:42627 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:42627): Connection reset by peer (error 104) W0301 23:04:10.091827 13164 connection.cc:647] server connection from 127.0.22.132:49211 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:49211): Connection reset by peer (error 104) W0301 23:04:10.091840 13228 connection.cc:647] server connection from 127.0.22.132:48411 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:48411): Connection reset by peer (error 104) I0301 23:04:10.091842 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 13801 W0301 23:04:10.094168 13164 connection.cc:647] server connection from 127.0.22.133:56043 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:56043): Connection reset by peer (error 104) W0301 23:04:10.094195 13230 connection.cc:647] server connection from 127.0.22.133:48381 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:48381): Connection reset by peer (error 104) W0301 23:04:10.094202 13103 connection.cc:647] server connection from 127.0.22.133:55945 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:55945): Connection reset by peer (error 104) I0301 23:04:10.094218 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 13932 W0301 23:04:10.096801 13101 connection.cc:647] server connection from 127.0.22.134:47485 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:47485): Connection reset by peer (error 104) W0301 23:04:10.096812 13167 connection.cc:647] server connection from 127.0.22.134:56017 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:56017): Connection reset by peer (error 104) W0301 23:04:10.096812 13228 connection.cc:647] server connection from 127.0.22.134:42289 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:42289): Connection reset by peer (error 104) I0301 23:04:10.096841 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 14059 W0301 23:04:10.099189 13230 connection.cc:647] server connection from 127.0.22.135:59587 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:59587): Connection reset by peer (error 104) W0301 23:04:10.099192 13102 connection.cc:647] server connection from 127.0.22.135:44531 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:44531): Connection reset by peer (error 104) W0301 23:04:10.099208 13166 connection.cc:647] server connection from 127.0.22.135:44421 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:44421): Connection reset by peer (error 104) I0301 23:04:10.099225 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 14191 W0301 23:04:10.101779 13100 connection.cc:647] server connection from 127.0.22.136:39707 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:39707): Connection reset by peer (error 104) W0301 23:04:10.101804 13166 connection.cc:647] server connection from 127.0.22.136:35507 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:35507): Connection reset by peer (error 104) W0301 23:04:10.101831 13230 connection.cc:647] server connection from 127.0.22.136:53225 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:53225): Connection reset by peer (error 104) I0301 23:04:10.101861 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 13093 W0301 23:04:10.104717 11830 connection.cc:647] client connection to 127.0.22.190:33441 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:33441): Connection reset by peer (error 104) I0301 23:04:10.104890 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 13153 W0301 23:04:10.107327 11830 connection.cc:647] client connection to 127.0.22.189:38639 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:38639): Connection reset by peer (error 104) I0301 23:04:10.107379 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 13217 W0301 23:04:10.110298 11830 connection.cc:647] client connection to 127.0.22.188:41239 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.188:41239): Connection reset by peer (error 104) [ OK ] TsLocationAssignmentITest.Basic/5 (7896 ms) [ RUN ] TsLocationAssignmentITest.Basic/6 I0301 23:04:10.918543 90 test_util.cc:212] Using random seed: 1824649869 I0301 23:04:10.919040 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:45973 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:10.930109 14322 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:10.930191 14322 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:10.931059 14322 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:10.931082 14322 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:10.931085 14322 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:10.931089 14322 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:10.932163 14322 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:45973 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.14322 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:10.933048 14322 master_main.cc:80] Initializing master server... I0301 23:04:10.933200 14322 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41016us I0301 23:04:10.933305 14322 fs_manager.cc:263] Metadata directory not provided I0301 23:04:10.933341 14322 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:10.933419 14322 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:10.933436 14322 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:10.933969 14322 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/instance: uuid: "4457cd6310c641c4b393d2e151035eb4" format_stamp: "Formatted at 2019-03-01 23:04:10 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:10.934139 14322 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal/instance: uuid: "4457cd6310c641c4b393d2e151035eb4" format_stamp: "Formatted at 2019-03-01 23:04:10 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:10.935137 14322 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:10.935374 14322 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:10.935477 14322 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:10.936091 14322 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:10.936118 14322 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal uuid: "4457cd6310c641c4b393d2e151035eb4" format_stamp: "Formatted at 2019-03-01 23:04:10 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:10.936136 14322 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:10.971786 14322 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:10.971956 14322 master_main.cc:83] Starting Master server... I0301 23:04:10.974654 14322 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:45973 I0301 23:04:10.974701 14322 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:04:10.974706 14322 webserver.cc:186] Document root disabled I0301 23:04:10.974830 14322 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:42883/ I0301 23:04:10.974961 14322 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:04:10.975210 14381 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:10.976625 14381 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:10.979830 14381 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:10.980245 14381 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.189:36569: Network error: Client connection negotiation failed: client connection to 127.0.22.189:36569: connect: Connection refused (error 111) I0301 23:04:10.981240 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 14322 I0301 23:04:10.981487 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:36569 --webserver_interface=127.0.22.189 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:10.992031 14384 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:10.992115 14384 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:10.992974 14384 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:10.992998 14384 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:10.993005 14384 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:10.993011 14384 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:10.994055 14384 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:36569 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/info.pb --webserver_interface=127.0.22.189 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.14384 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:10.994889 14384 master_main.cc:80] Initializing master server... I0301 23:04:10.995051 14384 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41016us I0301 23:04:10.995155 14384 fs_manager.cc:263] Metadata directory not provided I0301 23:04:10.995204 14384 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:10.995244 14384 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:10.995249 14384 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:10.995786 14384 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/instance: uuid: "9191e9b5d78f4517b68d6a7efbf73301" format_stamp: "Formatted at 2019-03-01 23:04:10 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:10.995975 14384 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal/instance: uuid: "9191e9b5d78f4517b68d6a7efbf73301" format_stamp: "Formatted at 2019-03-01 23:04:10 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:10.997138 14384 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:04:10.997366 14384 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:10.997473 14384 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:10.998018 14384 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:10.998049 14384 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal uuid: "9191e9b5d78f4517b68d6a7efbf73301" format_stamp: "Formatted at 2019-03-01 23:04:10 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:10.998071 14384 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:10.999419 14381 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } attempt: 1 W0301 23:04:10.999792 14381 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.189:36569: Network error: Client connection negotiation failed: client connection to 127.0.22.189:36569: connect: Connection refused (error 111) I0301 23:04:11.010605 14384 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.010766 14384 master_main.cc:83] Starting Master server... I0301 23:04:11.012656 14384 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.189:36569 I0301 23:04:11.012714 14384 webserver.cc:175] Starting webserver on 127.0.22.189:0 I0301 23:04:11.012722 14384 webserver.cc:186] Document root disabled I0301 23:04:11.012841 14384 webserver.cc:313] Webserver started. Bound to: http://127.0.22.189:44079/ I0301 23:04:11.012969 14384 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/info.pb I0301 23:04:11.013206 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 14384 I0301 23:04:11.013268 14443 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:11.013486 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:46753 --webserver_interface=127.0.22.188 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 with env {} I0301 23:04:11.014870 14443 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:11.018115 14443 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:11.021112 14443 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:11.021528 14443 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:46753: Network error: Client connection negotiation failed: client connection to 127.0.22.188:46753: connect: Connection refused (error 111) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.025530 14444 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.025622 14444 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.026597 14444 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:11.026623 14444 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.026629 14444 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:11.026635 14444 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:11.027675 14444 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:46753 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/info.pb --webserver_interface=127.0.22.188 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.14444 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.028528 14444 master_main.cc:80] Initializing master server... I0301 23:04:11.028679 14444 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.028781 14444 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.028823 14444 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.028862 14444 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.028868 14444 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.029374 14444 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/instance: uuid: "af574d09abdf44d797ac2b771b578e91" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.029589 14444 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal/instance: uuid: "af574d09abdf44d797ac2b771b578e91" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.030607 14444 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:11.030820 14444 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.030890 14444 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.031476 14444 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.031507 14444 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal uuid: "af574d09abdf44d797ac2b771b578e91" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.031529 14444 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.040669 14443 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } attempt: 1 W0301 23:04:11.041041 14443 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:46753: Network error: Client connection negotiation failed: client connection to 127.0.22.188:46753: connect: Connection refused (error 111) I0301 23:04:11.047950 14381 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } attempt: 2 I0301 23:04:11.050909 14381 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:11.051182 14381 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:46753: Network error: Client connection negotiation failed: client connection to 127.0.22.188:46753: connect: Connection refused (error 111) I0301 23:04:11.075556 14444 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.075716 14444 master_main.cc:83] Starting Master server... I0301 23:04:11.078446 14444 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.188:46753 I0301 23:04:11.079437 14444 webserver.cc:175] Starting webserver on 127.0.22.188:0 I0301 23:04:11.079461 14444 webserver.cc:186] Document root disabled I0301 23:04:11.079573 14444 webserver.cc:313] Webserver started. Bound to: http://127.0.22.188:33451/ I0301 23:04:11.079663 14444 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/info.pb I0301 23:04:11.079885 14505 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:11.081252 14505 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:11.084208 14505 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:11.086786 14505 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:11.086782 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 14444 I0301 23:04:11.087054 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:11.089206 14443 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } attempt: 2 I0301 23:04:11.090662 14505 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: Bootstrap starting. I0301 23:04:11.090941 14505 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: No blocks or log segments found. Creating new log. I0301 23:04:11.091121 14505 log.cc:525] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: Log is configured to *not* fsync() on all Append() calls I0301 23:04:11.091755 14505 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: No bootstrap required, opened a new log I0301 23:04:11.092687 14443 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Bootstrap starting. I0301 23:04:11.092963 14443 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: No blocks or log segments found. Creating new log. I0301 23:04:11.093021 14505 raft_consensus.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:11.093036 14505 raft_consensus.cc:366] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:11.093044 14505 raft_consensus.cc:705] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af574d09abdf44d797ac2b771b578e91, State: Initialized, Role: FOLLOWER I0301 23:04:11.093111 14505 consensus_queue.cc:229] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:11.093181 14443 log.cc:525] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Log is configured to *not* fsync() on all Append() calls I0301 23:04:11.093219 14505 sys_catalog.cc:337] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:11.093248 14505 sys_catalog.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:11.093283 14505 sys_catalog.cc:424] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:11.093488 14511 sys_catalog.cc:337] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:11.093677 14511 sys_catalog.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:11.093638 14444 master_main.cc:86] Master server successfully started. W0301 23:04:11.093802 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:11.093848 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:11.093976 14443 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: No bootstrap required, opened a new log I0301 23:04:11.095254 14443 raft_consensus.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:11.095285 14443 raft_consensus.cc:366] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:11.095293 14443 raft_consensus.cc:705] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9191e9b5d78f4517b68d6a7efbf73301, State: Initialized, Role: FOLLOWER I0301 23:04:11.095362 14443 consensus_queue.cc:229] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:11.095491 14443 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:11.095518 14443 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:11.095552 14443 sys_catalog.cc:424] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:11.095944 14384 master_main.cc:86] Master server successfully started. I0301 23:04:11.096263 14515 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:11.096292 14515 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: FOLLOWER W0301 23:04:11.096524 14516 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:11.096549 14516 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.100850 14508 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.100953 14508 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.102026 14508 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.102069 14508 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:04:11.103322 14508 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.14508 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.104627 14508 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.104825 14508 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.104920 14508 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.104959 14508 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.105005 14508 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.105026 14508 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.105804 14508 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/instance: uuid: "b2c730d41d15403dadbcbf1c4e154fe8" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.105998 14508 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal/instance: uuid: "b2c730d41d15403dadbcbf1c4e154fe8" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.112449 14508 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.001s sys 0.001s I0301 23:04:11.112715 14508 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.112793 14508 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.113567 14508 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.113602 14508 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal uuid: "b2c730d41d15403dadbcbf1c4e154fe8" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.113627 14508 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.114327 14381 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } attempt: 1 I0301 23:04:11.117066 14381 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: Bootstrap starting. I0301 23:04:11.117307 14381 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: No blocks or log segments found. Creating new log. I0301 23:04:11.117509 14381 log.cc:525] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: Log is configured to *not* fsync() on all Append() calls I0301 23:04:11.120466 14381 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: No bootstrap required, opened a new log I0301 23:04:11.121351 14381 raft_consensus.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:11.121378 14381 raft_consensus.cc:366] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:11.121421 14381 raft_consensus.cc:705] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4457cd6310c641c4b393d2e151035eb4, State: Initialized, Role: FOLLOWER I0301 23:04:11.121474 14381 consensus_queue.cc:229] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:11.121596 14381 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:11.121623 14381 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:11.121659 14381 sys_catalog.cc:424] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:11.121913 14322 master_main.cc:86] Master server successfully started. W0301 23:04:11.122004 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:11.122037 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:11.128254 14529 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:11.128283 14529 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:11.133724 14508 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.133962 14508 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.134030 14508 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.138821 14508 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:44781 I0301 23:04:11.138877 14508 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:04:11.138885 14508 webserver.cc:186] Document root disabled I0301 23:04:11.139050 14508 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:43439/ I0301 23:04:11.139220 14508 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:04:11.139446 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 14508 I0301 23:04:11.139698 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:0 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:11.139734 14508 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.147668 14640 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.147697 14640 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.147737 14640 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.148119 14641 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.148136 14641 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.148133 14642 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.148154 14642 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.148216 14642 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.148298 14641 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.174253 14644 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.174371 14644 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.175465 14644 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.175508 14644 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:04:11.175954 14515 raft_consensus.cc:472] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0301 23:04:11.176048 14515 raft_consensus.cc:494] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:11.176128 14515 leader_election.cc:292] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4457cd6310c641c4b393d2e151035eb4 (127.0.22.190:45973), af574d09abdf44d797ac2b771b578e91 (127.0.22.188:46753) I0301 23:04:11.176528 14479 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9191e9b5d78f4517b68d6a7efbf73301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af574d09abdf44d797ac2b771b578e91" is_pre_election: true I0301 23:04:11.176569 14479 raft_consensus.cc:2346] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9191e9b5d78f4517b68d6a7efbf73301 in term 0. I0301 23:04:11.176867 14358 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9191e9b5d78f4517b68d6a7efbf73301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4457cd6310c641c4b393d2e151035eb4" is_pre_election: true I0301 23:04:11.176921 14358 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9191e9b5d78f4517b68d6a7efbf73301 in term 0. I0301 23:04:11.177103 14391 leader_election.cc:306] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4457cd6310c641c4b393d2e151035eb4, 9191e9b5d78f4517b68d6a7efbf73301; no voters: I0301 23:04:11.177361 14515 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0301 23:04:11.177376 14515 raft_consensus.cc:472] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0301 23:04:11.177424 14515 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:11.192839 14644 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.14644 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.192864 14472 ts_manager.cc:98] Registered new tserver with Master: b2c730d41d15403dadbcbf1c4e154fe8 (127.0.22.129:44781) I0301 23:04:11.193778 14644 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.193959 14644 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.194051 14644 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.194108 14644 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.194156 14644 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.194175 14644 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.194762 14644 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/instance: uuid: "cec24fa21a664f1e98e80518d4875d14" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.194947 14644 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal/instance: uuid: "cec24fa21a664f1e98e80518d4875d14" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.196475 14644 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:11.196785 14644 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.196873 14644 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.197746 14644 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.197783 14644 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal uuid: "cec24fa21a664f1e98e80518d4875d14" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.197811 14644 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0301 23:04:11.222196 14337 tablet.cc:1786] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:04:11.240576 14644 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.240861 14644 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.240969 14644 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.245270 14644 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:38955 I0301 23:04:11.245352 14644 webserver.cc:175] Starting webserver on 127.0.22.130:0 I0301 23:04:11.245373 14644 webserver.cc:186] Document root disabled I0301 23:04:11.245568 14644 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:41651/ I0301 23:04:11.245712 14644 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:04:11.246033 14644 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.252205 14770 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.252235 14770 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.252305 14770 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:11.252650 14771 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.252737 14771 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.252787 14771 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.252959 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 14644 I0301 23:04:11.253212 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:0 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:11.254288 14769 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.254314 14769 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.254369 14769 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.254928 14410 ts_manager.cc:98] Registered new tserver with Master: b2c730d41d15403dadbcbf1c4e154fe8 (127.0.22.129:44781) I0301 23:04:11.259199 14348 ts_manager.cc:98] Registered new tserver with Master: b2c730d41d15403dadbcbf1c4e154fe8 (127.0.22.129:44781) W0301 23:04:11.261009 14399 tablet.cc:1786] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Can't schedule compaction. Clean time has not been advanced past its initial value. WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.288369 14776 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.288538 14776 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.289554 14776 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.289599 14776 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:04:11.290848 14776 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.14776 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.292074 14776 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.296351 14776 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.296494 14776 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.296531 14776 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.296582 14776 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.296604 14776 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.297567 14776 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/instance: uuid: "7052f504631e40809718e2a0fe5e2cc3" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.297767 14776 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal/instance: uuid: "7052f504631e40809718e2a0fe5e2cc3" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.304467 14776 fs_manager.cc:503] Time spent creating directory manager: real 0.007s user 0.000s sys 0.003s I0301 23:04:11.304780 14776 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.304893 14776 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.305671 14776 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.305735 14776 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal uuid: "7052f504631e40809718e2a0fe5e2cc3" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.305804 14776 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.322327 14776 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.322628 14776 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.322705 14776 tablet_server_main.cc:90] Starting tablet server... W0301 23:04:11.325976 14461 tablet.cc:1786] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: Can't schedule compaction. Clean time has not been advanced past its initial value. I0301 23:04:11.328119 14776 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:36453 I0301 23:04:11.328212 14776 webserver.cc:175] Starting webserver on 127.0.22.131:0 I0301 23:04:11.328222 14776 webserver.cc:186] Document root disabled I0301 23:04:11.328352 14776 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:34553/ I0301 23:04:11.328527 14776 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:04:11.329121 14776 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.335929 14898 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.335949 14898 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.335994 14898 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:11.336352 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 14776 I0301 23:04:11.336575 14897 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.336588 14897 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.336618 14897 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.336648 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:0 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:11.337901 14899 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.337918 14899 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.337949 14899 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.359324 14904 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.359453 14904 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.364202 14904 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.364243 14904 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:04:11.365139 14904 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.14904 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.365999 14904 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.366183 14904 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.366276 14904 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.366330 14904 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.366379 14904 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.366430 14904 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.366986 14904 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/instance: uuid: "a1608725c87e4eab92fe9207cf54cf58" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.367161 14904 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal/instance: uuid: "a1608725c87e4eab92fe9207cf54cf58" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.368240 14904 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:11.368571 14904 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.368649 14904 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.369338 14904 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.369421 14904 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal uuid: "a1608725c87e4eab92fe9207cf54cf58" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.369446 14904 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.393990 14904 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.394219 14904 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.394284 14904 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.398844 14904 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:40927 I0301 23:04:11.398898 14904 webserver.cc:175] Starting webserver on 127.0.22.132:0 I0301 23:04:11.398906 14904 webserver.cc:186] Document root disabled I0301 23:04:11.399040 14904 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:36249/ I0301 23:04:11.399178 14904 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:04:11.399593 14904 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.401968 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 14904 I0301 23:04:11.402252 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:0 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:11.404618 15023 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.404635 15023 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.404680 15023 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.404812 15024 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.404829 15024 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.404856 15024 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:11.405709 15025 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.405735 15025 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.405771 15025 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.416616 15030 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.416724 15030 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.417749 15030 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.417783 15030 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:04:11.419037 15030 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.15030 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.420253 15030 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.420475 15030 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.420564 15030 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.420591 15030 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.420636 15030 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.420655 15030 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.421334 15030 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/instance: uuid: "afe42b93631a46b79d48c710bb0949c3" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.421541 15030 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal/instance: uuid: "afe42b93631a46b79d48c710bb0949c3" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.422911 15030 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:11.423154 15030 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.423228 15030 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.423929 15030 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.423960 15030 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal uuid: "afe42b93631a46b79d48c710bb0949c3" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.423983 15030 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.470201 15030 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.470485 15030 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.470549 15030 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.476583 15030 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:39893 I0301 23:04:11.476632 15030 webserver.cc:175] Starting webserver on 127.0.22.133:0 I0301 23:04:11.476647 15030 webserver.cc:186] Document root disabled I0301 23:04:11.476784 15030 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:46699/ I0301 23:04:11.476924 15030 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:04:11.477324 15030 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.481710 15151 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.481727 15151 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.481765 15151 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.481961 15150 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.481995 15149 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.482019 15150 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.482044 15149 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.482074 15150 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:11.482084 15149 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.484783 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 15030 I0301 23:04:11.485049 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:0 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.499058 15156 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.499158 15156 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.500227 15156 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.500262 15156 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:04:11.501569 15156 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.15156 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.502810 15156 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.503036 15156 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.503124 15156 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.503142 15156 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.503183 15156 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.503198 15156 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.503937 15156 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/instance: uuid: "0b487e0e73524a20a7d2c021d55ca8e1" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.504123 15156 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal/instance: uuid: "0b487e0e73524a20a7d2c021d55ca8e1" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.505568 15156 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:04:11.505815 15156 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.505887 15156 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.506604 15156 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.506633 15156 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal uuid: "0b487e0e73524a20a7d2c021d55ca8e1" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.506656 15156 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.539815 15156 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.540055 15156 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.540119 15156 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.546232 15156 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:37517 I0301 23:04:11.546315 15156 webserver.cc:175] Starting webserver on 127.0.22.134:0 I0301 23:04:11.546334 15156 webserver.cc:186] Document root disabled I0301 23:04:11.546514 15156 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:38431/ I0301 23:04:11.546636 15156 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:04:11.547293 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 15156 I0301 23:04:11.547569 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:0 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:11.548719 15156 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.551232 15277 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.551249 15277 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.551286 15277 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.552049 15275 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.552075 15275 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.552106 15275 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.552870 15276 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.552886 15276 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.552954 15276 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.561537 15282 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.561637 15282 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.562669 15282 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.562697 15282 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:04:11.563935 15282 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.15282 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.565129 15282 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.565310 15282 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.565438 15282 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.565467 15282 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.565507 15282 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.565526 15282 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.566187 15282 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/instance: uuid: "f8811aad84f24cb899523d311eac48cf" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.566500 15282 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal/instance: uuid: "f8811aad84f24cb899523d311eac48cf" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.568022 15282 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s I0301 23:04:11.568331 15282 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.568436 15282 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.569039 15282 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.569069 15282 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal uuid: "f8811aad84f24cb899523d311eac48cf" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.569092 15282 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.612498 15282 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.612773 15282 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.612830 15282 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.617753 15282 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:41893 I0301 23:04:11.617812 15282 webserver.cc:175] Starting webserver on 127.0.22.135:0 I0301 23:04:11.617831 15282 webserver.cc:186] Document root disabled I0301 23:04:11.617977 15282 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:41841/ I0301 23:04:11.618096 15282 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:04:11.618438 15282 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.619684 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 15282 I0301 23:04:11.619943 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:0 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:11.622644 15403 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.622694 15403 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.622761 15403 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.622975 15401 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.622993 15401 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.623050 15401 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.626291 15402 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.626310 15402 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.626482 15402 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.633996 15408 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.634088 15408 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.635110 15408 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.635143 15408 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:04:11.636425 15408 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.15408 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.637594 15408 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.637778 15408 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.637864 15408 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.637892 15408 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.638010 15408 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.638026 15408 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.638769 15408 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/instance: uuid: "13620ea0d2134184b6ae7cb6ab31534b" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.638978 15408 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal/instance: uuid: "13620ea0d2134184b6ae7cb6ab31534b" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.640323 15408 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:11.640839 15408 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.640923 15408 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.641688 15408 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.641734 15408 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal uuid: "13620ea0d2134184b6ae7cb6ab31534b" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.641762 15408 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.707842 15408 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.708081 15408 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.708150 15408 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.713894 15408 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:35561 I0301 23:04:11.713953 15408 webserver.cc:175] Starting webserver on 127.0.22.136:0 I0301 23:04:11.713965 15408 webserver.cc:186] Document root disabled I0301 23:04:11.714102 15408 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:38479/ I0301 23:04:11.714231 15408 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:04:11.714627 15408 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.720829 15529 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.720847 15529 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.720885 15529 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.720894 15528 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.720909 15528 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.720989 15528 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:11.721747 15527 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.721771 15527 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.721801 15527 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.722548 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 15408 I0301 23:04:11.722813 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data --block_manager=log --rpc_bind_addresses=127.0.22.137:0 --local_ip_for_outbound_sockets=127.0.22.137 --webserver_interface=127.0.22.137 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.737191 15534 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.737289 15534 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.738301 15534 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.738337 15534 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.137 I0301 23:04:11.739621 15534 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.137:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/info.pb --webserver_interface=127.0.22.137 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.15534 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.137 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.740895 15534 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.741087 15534 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.741178 15534 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.741206 15534 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.741250 15534 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.741266 15534 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.742010 15534 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/instance: uuid: "ae1fd5ced0f746b7907cab3ad4fd25a8" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.742187 15534 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal/instance: uuid: "ae1fd5ced0f746b7907cab3ad4fd25a8" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.743646 15534 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s I0301 23:04:11.743952 15534 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.744029 15534 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.744855 15534 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.744887 15534 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal uuid: "ae1fd5ced0f746b7907cab3ad4fd25a8" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.744912 15534 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.766103 15534 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.766343 15534 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.766445 15534 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.772931 15534 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.137:44147 I0301 23:04:11.772981 15534 webserver.cc:175] Starting webserver on 127.0.22.137:0 I0301 23:04:11.772997 15534 webserver.cc:186] Document root disabled I0301 23:04:11.773134 15534 webserver.cc:313] Webserver started. Bound to: http://127.0.22.137:44669/ I0301 23:04:11.773249 15534 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/info.pb I0301 23:04:11.773963 15534 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.775120 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 15534 I0301 23:04:11.775434 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data --block_manager=log --rpc_bind_addresses=127.0.22.138:0 --local_ip_for_outbound_sockets=127.0.22.138 --webserver_interface=127.0.22.138 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:11.779309 15654 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.779325 15654 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.779448 15655 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.779465 15655 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.779289 15653 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.779568 15654 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:11.779600 15655 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.779670 15653 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.780086 15653 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.789161 15660 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.789254 15660 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.790259 15660 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.790294 15660 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.138 I0301 23:04:11.791548 15660 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.138:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/info.pb --webserver_interface=127.0.22.138 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.15660 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.138 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.792728 15660 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.792913 15660 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.792997 15660 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.793026 15660 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.793081 15660 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.793090 15660 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.793792 15660 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/instance: uuid: "81c15935bd774f6da0a260fc3aeed423" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.793967 15660 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal/instance: uuid: "81c15935bd774f6da0a260fc3aeed423" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.795761 15660 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.002s sys 0.001s I0301 23:04:11.796030 15660 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.796103 15660 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.797027 15660 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.797101 15660 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal uuid: "81c15935bd774f6da0a260fc3aeed423" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.797200 15660 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.824419 15660 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.824631 15660 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.824692 15660 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.830143 15660 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.138:43345 I0301 23:04:11.830195 15660 webserver.cc:175] Starting webserver on 127.0.22.138:0 I0301 23:04:11.830205 15660 webserver.cc:186] Document root disabled I0301 23:04:11.830327 15660 webserver.cc:313] Webserver started. Bound to: http://127.0.22.138:40401/ I0301 23:04:11.830483 15660 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/info.pb I0301 23:04:11.832190 15660 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.835132 15781 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.835148 15781 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.835186 15781 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.835557 15780 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.835644 15780 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.835801 15779 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.835822 15780 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:11.835824 15779 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.835966 15779 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.837697 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 15660 I0301 23:04:11.837960 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data --block_manager=log --rpc_bind_addresses=127.0.22.139:0 --local_ip_for_outbound_sockets=127.0.22.139 --webserver_interface=127.0.22.139 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.852072 15786 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.852188 15786 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.853184 15786 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.853219 15786 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.139 I0301 23:04:11.854487 15786 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.139:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/info.pb --webserver_interface=127.0.22.139 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.15786 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.139 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.855648 15786 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.855813 15786 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.855907 15786 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.855927 15786 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.855969 15786 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.855975 15786 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.856690 15786 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/instance: uuid: "8a0c9c16cf7c4007bfc5616bd13816be" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.856860 15786 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal/instance: uuid: "8a0c9c16cf7c4007bfc5616bd13816be" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.858232 15786 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:04:11.858521 15786 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.858595 15786 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.859483 15786 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:11.859553 15786 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal uuid: "8a0c9c16cf7c4007bfc5616bd13816be" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.859619 15786 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.898293 15786 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:11.898703 15786 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:11.898766 15786 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:11.905815 15786 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.139:45995 I0301 23:04:11.905874 15786 webserver.cc:175] Starting webserver on 127.0.22.139:0 I0301 23:04:11.905895 15786 webserver.cc:186] Document root disabled I0301 23:04:11.906018 15786 webserver.cc:313] Webserver started. Bound to: http://127.0.22.139:41791/ I0301 23:04:11.906126 15786 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/info.pb I0301 23:04:11.906745 15786 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:11.910439 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 15786 I0301 23:04:11.910691 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data --block_manager=log --rpc_bind_addresses=127.0.22.140:0 --local_ip_for_outbound_sockets=127.0.22.140 --webserver_interface=127.0.22.140 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} W0301 23:04:11.911291 14515 consensus_meta.cc:220] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Time spent flushing consensus metadata: real 0.734s user 0.001s sys 0.000s I0301 23:04:11.911360 14515 raft_consensus.cc:494] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:11.911479 14515 leader_election.cc:292] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [CANDIDATE]: Term 1 election: Requested vote from peers 4457cd6310c641c4b393d2e151035eb4 (127.0.22.190:45973), af574d09abdf44d797ac2b771b578e91 (127.0.22.188:46753) I0301 23:04:11.912878 15905 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:11.912891 15905 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.912925 15905 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:11.914681 15907 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:11.914695 15907 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.914746 15907 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:11.914961 14358 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9191e9b5d78f4517b68d6a7efbf73301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4457cd6310c641c4b393d2e151035eb4" I0301 23:04:11.914984 14358 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:11.915658 14479 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9191e9b5d78f4517b68d6a7efbf73301" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af574d09abdf44d797ac2b771b578e91" I0301 23:04:11.915678 14479 raft_consensus.cc:2886] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:11.918159 15906 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:11.918272 15906 heartbeater.cc:425] Registering TS with master... I0301 23:04:11.918480 15906 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:11.919853 14472 ts_manager.cc:98] Registered new tserver with Master: cec24fa21a664f1e98e80518d4875d14 (127.0.22.130:38955) I0301 23:04:11.950875 14347 ts_manager.cc:98] Registered new tserver with Master: cec24fa21a664f1e98e80518d4875d14 (127.0.22.130:38955) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:11.951287 15912 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:11.951478 15912 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:11.956559 15912 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:11.956591 15912 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.140 I0301 23:04:11.957819 15912 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.140:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/info.pb --webserver_interface=127.0.22.140 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.15912 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.140 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:11.959700 15912 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:11.959997 15912 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 41516us I0301 23:04:11.960116 15912 fs_manager.cc:263] Metadata directory not provided I0301 23:04:11.960220 15912 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:11.960304 15912 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:11.963117 15912 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:11.963974 15912 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/instance: uuid: "260a23a01ec64ac59599fca9754bb369" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.964226 15912 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal/instance: uuid: "260a23a01ec64ac59599fca9754bb369" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.965688 15912 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:04:11.965951 15912 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:11.966033 15912 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:11.967578 15912 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0301 23:04:11.969048 15912 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal uuid: "260a23a01ec64ac59599fca9754bb369" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:11.970775 15912 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:11.982671 14409 ts_manager.cc:98] Registered new tserver with Master: cec24fa21a664f1e98e80518d4875d14 (127.0.22.130:38955) I0301 23:04:12.051789 15912 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:12.052052 15912 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:12.052114 15912 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:12.062052 15912 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.140:33735 I0301 23:04:12.062119 15912 webserver.cc:175] Starting webserver on 127.0.22.140:0 I0301 23:04:12.062130 15912 webserver.cc:186] Document root disabled I0301 23:04:12.062263 15912 webserver.cc:313] Webserver started. Bound to: http://127.0.22.140:46381/ I0301 23:04:12.062430 15912 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/info.pb I0301 23:04:12.062788 15912 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:12.065351 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 15912 I0301 23:04:12.065667 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data --block_manager=log --rpc_bind_addresses=127.0.22.141:0 --local_ip_for_outbound_sockets=127.0.22.141 --webserver_interface=127.0.22.141 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:12.074113 16037 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:12.074132 16037 heartbeater.cc:425] Registering TS with master... I0301 23:04:12.074177 16037 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:12.074687 16035 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:12.074756 16035 heartbeater.cc:425] Registering TS with master... I0301 23:04:12.074795 16035 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:12.080673 16036 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:12.080693 16036 heartbeater.cc:425] Registering TS with master... I0301 23:04:12.080730 16036 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:12.087219 16042 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:12.087306 16042 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:12.088340 16042 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:12.088376 16042 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.141 I0301 23:04:12.089613 16042 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.141:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/info.pb --webserver_interface=127.0.22.141 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.16042 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.141 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:12.090845 16042 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:12.091027 16042 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 42016us I0301 23:04:12.091116 16042 fs_manager.cc:263] Metadata directory not provided I0301 23:04:12.091146 16042 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:12.091192 16042 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:12.091202 16042 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:12.091924 16042 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/instance: uuid: "7cb814db45714c4c861e0ca70033e26a" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.092092 16042 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal/instance: uuid: "7cb814db45714c4c861e0ca70033e26a" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.093828 16042 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s I0301 23:04:12.094656 16042 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:12.094807 16042 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:12.095530 16042 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:12.095561 16042 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal uuid: "7cb814db45714c4c861e0ca70033e26a" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.095594 16042 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0301 23:04:12.096768 14516 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:12.096791 14516 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:12.123701 16042 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:12.123934 16042 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:12.123999 16042 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:12.132154 16042 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.141:41515 I0301 23:04:12.132248 16042 webserver.cc:175] Starting webserver on 127.0.22.141:0 I0301 23:04:12.132277 16042 webserver.cc:186] Document root disabled I0301 23:04:12.132437 16042 webserver.cc:313] Webserver started. Bound to: http://127.0.22.141:44059/ I0301 23:04:12.132555 16042 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/info.pb I0301 23:04:12.132992 16042 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:12.140347 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 16042 I0301 23:04:12.140637 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data --block_manager=log --rpc_bind_addresses=127.0.22.142:0 --local_ip_for_outbound_sockets=127.0.22.142 --webserver_interface=127.0.22.142 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:12.164271 16168 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:12.164373 16168 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:12.165432 16168 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:12.165460 16168 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.142 I0301 23:04:12.166787 16168 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.142:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/info.pb --webserver_interface=127.0.22.142 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.16168 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.142 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:12.168131 16168 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:12.168357 16168 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 42016us I0301 23:04:12.168479 16168 fs_manager.cc:263] Metadata directory not provided I0301 23:04:12.168498 16168 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:12.168541 16168 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:12.168546 16168 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:12.169204 16168 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/instance: uuid: "125f195fa3694b589407de1f591f0d1e" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.169373 16168 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal/instance: uuid: "125f195fa3694b589407de1f591f0d1e" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.170681 16168 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:12.170912 16168 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:12.170974 16168 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:12.171730 16168 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:12.171828 16168 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal uuid: "125f195fa3694b589407de1f591f0d1e" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.171989 16168 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:12.194102 16168 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:12.194331 16168 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:12.194416 16168 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:12.201561 16168 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.142:33235 I0301 23:04:12.201604 16168 webserver.cc:175] Starting webserver on 127.0.22.142:0 I0301 23:04:12.201614 16168 webserver.cc:186] Document root disabled I0301 23:04:12.201737 16168 webserver.cc:313] Webserver started. Bound to: http://127.0.22.142:42459/ I0301 23:04:12.201850 16168 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/info.pb I0301 23:04:12.202663 16168 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:12.203176 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 16168 I0301 23:04:12.203491 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data --block_manager=log --rpc_bind_addresses=127.0.22.143:0 --local_ip_for_outbound_sockets=127.0.22.143 --webserver_interface=127.0.22.143 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:12.220700 16291 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:12.220844 16291 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:12.221838 16291 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:12.221897 16291 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.143 I0301 23:04:12.223131 16291 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.143:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/info.pb --webserver_interface=127.0.22.143 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.16291 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.143 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:12.224445 16291 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:12.224651 16291 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 42016us I0301 23:04:12.224758 16291 fs_manager.cc:263] Metadata directory not provided I0301 23:04:12.224803 16291 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:12.224875 16291 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:12.224907 16291 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:12.225692 16291 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/instance: uuid: "8c1416a176564de683d21f1dcd69d7aa" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.225893 16291 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal/instance: uuid: "8c1416a176564de683d21f1dcd69d7aa" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.227926 16291 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.001s sys 0.000s I0301 23:04:12.228694 16291 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:12.228853 16291 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:12.229737 16291 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:12.229789 16291 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal uuid: "8c1416a176564de683d21f1dcd69d7aa" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.229840 16291 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:12.310834 16291 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:12.311080 16291 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:12.311141 16291 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:12.320161 16291 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.143:43607 I0301 23:04:12.320264 16291 webserver.cc:175] Starting webserver on 127.0.22.143:0 I0301 23:04:12.320300 16291 webserver.cc:186] Document root disabled I0301 23:04:12.320725 16291 webserver.cc:313] Webserver started. Bound to: http://127.0.22.143:36561/ I0301 23:04:12.321220 16291 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/info.pb I0301 23:04:12.325515 16291 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:12.326759 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 16291 I0301 23:04:12.327023 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data --block_manager=log --rpc_bind_addresses=127.0.22.144:0 --local_ip_for_outbound_sockets=127.0.22.144 --webserver_interface=127.0.22.144 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:12.345976 16420 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:12.346102 16420 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:12.347126 16420 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:12.347162 16420 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.144 I0301 23:04:12.348479 16420 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.144:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/info.pb --webserver_interface=127.0.22.144 --webserver_port=0 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.16420 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.144 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:12.349726 16420 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:12.349925 16420 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 42016us I0301 23:04:12.350014 16420 fs_manager.cc:263] Metadata directory not provided I0301 23:04:12.350044 16420 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:12.350106 16420 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:12.350123 16420 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:12.350868 16420 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/instance: uuid: "d7c95de99bdc421f9ab5a1f05bd5492c" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.351080 16420 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal/instance: uuid: "d7c95de99bdc421f9ab5a1f05bd5492c" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.352838 16420 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.001s sys 0.001s I0301 23:04:12.353539 16420 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:12.353698 16420 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:12.355273 16420 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0301 23:04:12.355355 16420 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal uuid: "d7c95de99bdc421f9ab5a1f05bd5492c" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:12.355473 16420 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:12.388029 16420 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:12.388326 16420 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:12.388432 16420 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:12.399951 16420 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.144:33027 I0301 23:04:12.400036 16420 webserver.cc:175] Starting webserver on 127.0.22.144:0 I0301 23:04:12.400054 16420 webserver.cc:186] Document root disabled I0301 23:04:12.400295 16420 webserver.cc:313] Webserver started. Bound to: http://127.0.22.144:33355/ I0301 23:04:12.400444 16420 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/info.pb I0301 23:04:12.400856 16420 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:12.402700 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 16420 W0301 23:04:12.891767 14358 consensus_meta.cc:220] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: Time spent flushing consensus metadata: real 0.977s user 0.001s sys 0.000s I0301 23:04:12.891832 14358 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9191e9b5d78f4517b68d6a7efbf73301 in term 1. W0301 23:04:12.892011 14479 consensus_meta.cc:220] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: Time spent flushing consensus metadata: real 0.976s user 0.001s sys 0.000s I0301 23:04:12.892040 14479 raft_consensus.cc:2346] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9191e9b5d78f4517b68d6a7efbf73301 in term 1. W0301 23:04:12.892844 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:12.892863 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:12.893146 14391 leader_election.cc:306] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4457cd6310c641c4b393d2e151035eb4, 9191e9b5d78f4517b68d6a7efbf73301; no voters: I0301 23:04:12.893364 16548 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Leader election won for term 1 W0301 23:04:12.893373 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:12.893429 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:12.893496 16548 raft_consensus.cc:667] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 LEADER]: Becoming Leader. State: Replica: 9191e9b5d78f4517b68d6a7efbf73301, State: Running, Role: LEADER I0301 23:04:12.893612 16548 consensus_queue.cc:206] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:12.893784 16548 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9191e9b5d78f4517b68d6a7efbf73301. Latest consensus state: current_term: 1 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:12.893793 16548 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: LEADER I0301 23:04:12.897451 14465 ts_manager.cc:98] Registered new tserver with Master: 8a0c9c16cf7c4007bfc5616bd13816be (127.0.22.139:45995) I0301 23:04:12.897778 16161 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:12.897800 16161 heartbeater.cc:425] Registering TS with master... I0301 23:04:12.897861 16161 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:13.395709 14358 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 1 FOLLOWER]: Refusing update from remote peer 9191e9b5d78f4517b68d6a7efbf73301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0301 23:04:13.396023 16549 consensus_queue.cc:984] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0301 23:04:13.396669 16553 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9191e9b5d78f4517b68d6a7efbf73301. Latest consensus state: current_term: 1 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:13.396752 16553 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:13.397344 16549 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:13.397361 16549 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: LEADER I0301 23:04:13.397819 14479 raft_consensus.cc:1181] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 1 FOLLOWER]: Refusing update from remote peer 9191e9b5d78f4517b68d6a7efbf73301: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0301 23:04:13.398430 16555 consensus_queue.cc:984] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0301 23:04:13.398468 16553 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:13.398494 16553 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:13.399652 16558 sys_catalog.cc:337] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9191e9b5d78f4517b68d6a7efbf73301. Latest consensus state: current_term: 1 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:13.399677 16558 sys_catalog.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:13.399780 16561 sys_catalog.cc:337] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:13.399801 16561 sys_catalog.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:13.778481 16549 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:13.778513 16549 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: LEADER I0301 23:04:13.864722 14408 ts_manager.cc:98] Registered new tserver with Master: f8811aad84f24cb899523d311eac48cf (127.0.22.135:41893) I0301 23:04:13.864851 14408 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.135:49087 (request call id 2) took 2238ms. Request Metrics: {"spinlock_wait_cycles":665664384} I0301 23:04:13.866916 14408 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.141:37977 (request call id 1) took 1711ms. Request Metrics: {} I0301 23:04:13.867022 14408 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.142:60123 (request call id 1) took 1653ms. Request Metrics: {} I0301 23:04:13.867761 16162 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:13.867781 16288 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:13.867789 16162 heartbeater.cc:425] Registering TS with master... I0301 23:04:13.867801 16288 heartbeater.cc:425] Registering TS with master... I0301 23:04:13.867846 16162 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:13.867853 16288 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... W0301 23:04:13.893072 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:13.893106 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:13.893585 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:13.893612 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:14.835413 14466 ts_manager.cc:98] Registered new tserver with Master: 13620ea0d2134184b6ae7cb6ab31534b (127.0.22.136:35561) I0301 23:04:14.835552 14466 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:50667 (request call id 2) took 3113ms. Request Metrics: {} I0301 23:04:14.837502 14466 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.142:47047 (request call id 1) took 2621ms. Request Metrics: {} I0301 23:04:14.837699 14466 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.143:55085 (request call id 1) took 2508ms. Request Metrics: {} I0301 23:04:14.837747 14466 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.144:58945 (request call id 1) took 2428ms. Request Metrics: {} I0301 23:04:14.838027 16413 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:14.838048 16413 heartbeater.cc:425] Registering TS with master... I0301 23:04:14.838158 16413 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:14.838194 16539 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:14.838213 16539 heartbeater.cc:425] Registering TS with master... I0301 23:04:14.838261 16539 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:14.838352 16287 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:14.838371 16287 heartbeater.cc:425] Registering TS with master... I0301 23:04:14.838445 16287 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... W0301 23:04:14.893290 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:14.893318 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:14.893915 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:14.893942 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:15.136945 14406 ts_manager.cc:98] Registered new tserver with Master: a1608725c87e4eab92fe9207cf54cf58 (127.0.22.132:40927) I0301 23:04:15.137013 14406 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:40253 (request call id 2) took 3731ms. Request Metrics: {"spinlock_wait_cycles":1174542720} I0301 23:04:15.137082 14406 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.143:53987 (request call id 1) took 2804ms. Request Metrics: {} I0301 23:04:15.137114 14406 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.144:43253 (request call id 1) took 2728ms. Request Metrics: {} I0301 23:04:15.137296 16540 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:15.137320 16540 heartbeater.cc:425] Registering TS with master... I0301 23:04:15.137368 16540 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:15.139106 16414 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:15.139129 16414 heartbeater.cc:425] Registering TS with master... I0301 23:04:15.139173 16414 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:15.173478 14407 ts_manager.cc:98] Registered new tserver with Master: 13620ea0d2134184b6ae7cb6ab31534b (127.0.22.136:35561) I0301 23:04:15.173542 14407 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:34609 (request call id 2) took 3452ms. Request Metrics: {"spinlock_wait_cycles":447156608} I0301 23:04:15.209378 14401 ts_manager.cc:98] Registered new tserver with Master: 8a0c9c16cf7c4007bfc5616bd13816be (127.0.22.139:45995) I0301 23:04:15.209455 14401 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.139:42753 (request call id 2) took 3290ms. Request Metrics: {} W0301 23:04:15.893499 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:15.893527 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:15.894090 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:15.894110 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:16.111793 14463 ts_manager.cc:98] Registered new tserver with Master: ae1fd5ced0f746b7907cab3ad4fd25a8 (127.0.22.137:44147) I0301 23:04:16.111913 14463 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.137:38963 (request call id 2) took 4331ms. Request Metrics: {} W0301 23:04:16.893760 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:16.893795 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:16.894484 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:16.894505 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:17.093231 14410 ts_manager.cc:98] Registered new tserver with Master: 7052f504631e40809718e2a0fe5e2cc3 (127.0.22.131:36453) I0301 23:04:17.093363 14410 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:43963 (request call id 2) took 5755ms. Request Metrics: {"spinlock_wait_cycles":1326581632} W0301 23:04:17.893990 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:17.894022 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:17.894683 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:17.894711 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:18.083204 14344 ts_manager.cc:98] Registered new tserver with Master: 0b487e0e73524a20a7d2c021d55ca8e1 (127.0.22.134:37517) I0301 23:04:18.083343 14344 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:41777 (request call id 2) took 6531ms. Request Metrics: {} I0301 23:04:18.085331 14344 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.141:55849 (request call id 1) took 5925ms. Request Metrics: {} I0301 23:04:18.085461 14344 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.142:57803 (request call id 1) took 5869ms. Request Metrics: {} I0301 23:04:18.086483 16163 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:18.086509 16163 heartbeater.cc:425] Registering TS with master... I0301 23:04:18.086561 16163 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:18.086565 16289 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:18.086585 16289 heartbeater.cc:425] Registering TS with master... I0301 23:04:18.086627 16289 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... W0301 23:04:18.894274 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:18.894306 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:18.894886 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:18.894904 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:19.057341 14409 ts_manager.cc:98] Registered new tserver with Master: 260a23a01ec64ac59599fca9754bb369 (127.0.22.140:33735) I0301 23:04:19.057480 14409 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.140:55745 (request call id 2) took 6976ms. Request Metrics: {} W0301 23:04:19.894527 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:19.894552 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:19.895078 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:19.895098 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:20.048125 14340 ts_manager.cc:98] Registered new tserver with Master: 81c15935bd774f6da0a260fc3aeed423 (127.0.22.138:43345) I0301 23:04:20.048272 14340 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.138:50421 (request call id 2) took 8212ms. Request Metrics: {} I0301 23:04:20.048346 14340 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.143:40963 (request call id 1) took 7715ms. Request Metrics: {} I0301 23:04:20.051021 14340 rpcz_store.cc:269] Call kudu.master.MasterService.Ping from 127.0.22.144:38207 (request call id 1) took 7644ms. Request Metrics: {} I0301 23:04:20.051615 16541 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:20.051652 16541 heartbeater.cc:425] Registering TS with master... I0301 23:04:20.051707 16541 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:20.051785 16415 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:20.051805 16415 heartbeater.cc:425] Registering TS with master... I0301 23:04:20.051846 16415 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:20.245883 14470 ts_manager.cc:98] Registered new tserver with Master: a1608725c87e4eab92fe9207cf54cf58 (127.0.22.132:40927) I0301 23:04:20.245970 14470 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:59883 (request call id 2) took 8841ms. Request Metrics: {} W0301 23:04:20.894918 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:20.894946 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:20.895424 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:20.895448 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:21.163508 14463 ts_manager.cc:98] Registered new tserver with Master: 7cb814db45714c4c861e0ca70033e26a (127.0.22.141:41515) I0301 23:04:21.163564 14463 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.141:54453 (request call id 2) took 8263ms. Request Metrics: {} I0301 23:04:21.163712 14463 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.139:38247 (request call id 3) took 7263ms. Request Metrics: {} I0301 23:04:21.192755 14403 ts_manager.cc:98] Registered new tserver with Master: 0b487e0e73524a20a7d2c021d55ca8e1 (127.0.22.134:37517) I0301 23:04:21.192864 14403 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:54197 (request call id 2) took 9639ms. Request Metrics: {"spinlock_wait_cycles":831026048} I0301 23:04:21.193073 14406 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:33697 (request call id 3) took 8209ms. Request Metrics: {} I0301 23:04:21.193162 14408 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:40257 (request call id 3) took 8937ms. Request Metrics: {} W0301 23:04:21.895180 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:21.895212 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:21.895782 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:21.895812 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:22.132313 14463 ts_manager.cc:98] Registered new tserver with Master: 8c1416a176564de683d21f1dcd69d7aa (127.0.22.143:43607) I0301 23:04:22.132421 14463 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.143:55085 (request call id 2) took 7293ms. Request Metrics: {} I0301 23:04:22.148440 14342 ts_manager.cc:98] Registered new tserver with Master: ae1fd5ced0f746b7907cab3ad4fd25a8 (127.0.22.137:44147) I0301 23:04:22.148502 14342 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.137:41403 (request call id 2) took 10368ms. Request Metrics: {} I0301 23:04:22.193017 14468 ts_manager.cc:98] Registered new tserver with Master: 0b487e0e73524a20a7d2c021d55ca8e1 (127.0.22.134:37517) I0301 23:04:22.193150 14468 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:48009 (request call id 2) took 10640ms. Request Metrics: {} I0301 23:04:22.198086 14402 ts_manager.cc:98] Registered new tserver with Master: 81c15935bd774f6da0a260fc3aeed423 (127.0.22.138:43345) I0301 23:04:22.198169 14402 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.138:58501 (request call id 2) took 10361ms. Request Metrics: {"spinlock_wait_cycles":182744960} I0301 23:04:22.216300 14339 ts_manager.cc:98] Registered new tserver with Master: 8a0c9c16cf7c4007bfc5616bd13816be (127.0.22.139:45995) I0301 23:04:22.216375 14339 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.139:43229 (request call id 2) took 10301ms. Request Metrics: {} W0301 23:04:22.895604 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:22.895642 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:22.896148 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:22.896203 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:23.122212 14405 ts_manager.cc:98] Registered new tserver with Master: afe42b93631a46b79d48c710bb0949c3 (127.0.22.133:39893) W0301 23:04:23.122287 14405 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:47645 (request call id 2) took 11640 ms (11.6 s). Client timeout 15000 ms (15 s) W0301 23:04:23.122360 14405 rpcz_store.cc:259] Trace: 0301 23:04:11.482257 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.482285 (+ 28us) service_pool.cc:221] Handling call 0301 23:04:11.914901 (+432616us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x50a46a0. stack: 00000000024b19de 0000000000acd213 0000000000aa4866 000000000233481b 0000000002335149 00000000024c34b0 00007f64002e4183 00007f63fe6c2ffc 0301 23:04:22.198138 (+10283237us) ts_descriptor.cc:229] tablet server afe42b93631a46b79d48c710bb0949c3: assigning location 0301 23:04:23.122139 (+924001us) ts_descriptor.cc:235] tablet server afe42b93631a46b79d48c710bb0949c3: assigned location '/L1' 0301 23:04:23.122259 (+ 120us) inbound_call.cc:162] Queueing success response Metrics: {"spinlock_wait_cycles":994744576} I0301 23:04:23.133877 14348 ts_manager.cc:98] Registered new tserver with Master: 7052f504631e40809718e2a0fe5e2cc3 (127.0.22.131:36453) W0301 23:04:23.133941 14348 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:42373 (request call id 2) took 11795 ms (11.8 s). Client timeout 15000 ms (15 s) W0301 23:04:23.133996 14348 rpcz_store.cc:259] Trace: 0301 23:04:11.338760 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.338773 (+ 13us) service_pool.cc:221] Handling call 0301 23:04:22.224582 (+10885809us) ts_descriptor.cc:229] tablet server 7052f504631e40809718e2a0fe5e2cc3: assigning location 0301 23:04:23.133861 (+909279us) ts_descriptor.cc:235] tablet server 7052f504631e40809718e2a0fe5e2cc3: assigned location '/L1' 0301 23:04:23.133922 (+ 61us) inbound_call.cc:162] Queueing success response Metrics: {} W0301 23:04:23.896018 14530 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:23.896049 14530 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry W0301 23:04:23.896378 14513 catalog_manager.cc:1104] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:23.896423 14513 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:24.058866 14463 ts_manager.cc:98] Registered new tserver with Master: d7c95de99bdc421f9ab5a1f05bd5492c (127.0.22.144:33027) I0301 23:04:24.058934 14463 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.144:58945 (request call id 2) took 9220ms. Request Metrics: {} W0301 23:04:24.058998 14465 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:42313 (request call id 3) took 11865 ms (11.9 s). Client timeout 15000 ms (15 s) W0301 23:04:24.059098 14465 rpcz_store.cc:259] Trace: 0301 23:04:12.193593 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:12.897529 (+703936us) service_pool.cc:221] Handling call 0301 23:04:24.058944 (+11161415us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.066272 14346 ts_manager.cc:98] Registered new tserver with Master: a1608725c87e4eab92fe9207cf54cf58 (127.0.22.132:40927) W0301 23:04:24.066335 14346 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:50633 (request call id 2) took 12660 ms (12.7 s). Client timeout 15000 ms (15 s) W0301 23:04:24.068101 14346 rpcz_store.cc:259] Trace: 0301 23:04:11.405973 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.406005 (+ 32us) service_pool.cc:221] Handling call 0301 23:04:23.133965 (+11727960us) ts_descriptor.cc:229] tablet server a1608725c87e4eab92fe9207cf54cf58: assigning location 0301 23:04:24.066222 (+932257us) ts_descriptor.cc:235] tablet server a1608725c87e4eab92fe9207cf54cf58: assigned location '/L1' 0301 23:04:24.066317 (+ 95us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.131141 14472 ts_manager.cc:98] Registered new tserver with Master: 260a23a01ec64ac59599fca9754bb369 (127.0.22.140:33735) W0301 23:04:24.131201 14472 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.140:37135 (request call id 2) took 12056 ms (12.1 s). Client timeout 15000 ms (15 s) W0301 23:04:24.131275 14472 rpcz_store.cc:259] Trace: 0301 23:04:12.075042 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:12.075057 (+ 15us) service_pool.cc:221] Handling call 0301 23:04:12.892885 (+817828us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x5d2b3c4. stack: 00000000024b19de 00000000021ff112 0000000000acd072 0000000000aa4866 000000000233481b 0000000002335149 00000000024c34b0 00007fdef7641183 00007fdef5a1fffc 0301 23:04:24.059015 (+11166130us) ts_descriptor.cc:229] tablet server 260a23a01ec64ac59599fca9754bb369: assigning location 0301 23:04:24.131108 (+ 72093us) ts_descriptor.cc:235] tablet server 260a23a01ec64ac59599fca9754bb369: assigned location '/L1' 0301 23:04:24.131181 (+ 73us) inbound_call.cc:162] Queueing success response Metrics: {"spinlock_wait_cycles":1880536448} W0301 23:04:24.131312 14466 rpcz_store.cc:253] Call kudu.master.MasterService.ListTabletServers from 127.0.0.1:54942 (request call id 1) took 11718 ms (11.7 s). Client timeout 14999 ms (15 s) W0301 23:04:24.131348 14466 rpcz_store.cc:259] Trace: 0301 23:04:12.412357 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:14.837765 (+2425408us) service_pool.cc:221] Handling call 0301 23:04:24.131286 (+9293521us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.131426 14472 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:59883 (request call id 3) took 2883ms. Request Metrics: {} I0301 23:04:24.131474 14466 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.141:54453 (request call id 3) took 1966ms. Request Metrics: {} I0301 23:04:24.131505 14472 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.139:38247 (request call id 4) took 1966ms. Request Metrics: {} I0301 23:04:24.131567 14463 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:50667 (request call id 3) took 8292ms. Request Metrics: {} I0301 23:04:24.131701 14470 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:34017 (request call id 3) took 11211ms. Request Metrics: {} I0301 23:04:24.132426 14343 ts_manager.cc:98] Registered new tserver with Master: f8811aad84f24cb899523d311eac48cf (127.0.22.135:41893) W0301 23:04:24.132477 14343 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.135:41565 (request call id 2) took 12509 ms (12.5 s). Client timeout 15000 ms (15 s) W0301 23:04:24.132521 14343 rpcz_store.cc:259] Trace: 0301 23:04:11.623050 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.623090 (+ 40us) service_pool.cc:221] Handling call 0301 23:04:24.066349 (+12443259us) ts_descriptor.cc:229] tablet server f8811aad84f24cb899523d311eac48cf: assigning location 0301 23:04:24.132403 (+ 66054us) ts_descriptor.cc:235] tablet server f8811aad84f24cb899523d311eac48cf: assigned location '/L1' 0301 23:04:24.132459 (+ 56us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.147877 14401 ts_manager.cc:98] Registered new tserver with Master: 7cb814db45714c4c861e0ca70033e26a (127.0.22.141:41515) I0301 23:04:24.147959 14401 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.141:37977 (request call id 2) took 10279ms. Request Metrics: {} I0301 23:04:24.148025 14401 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.140:55745 (request call id 3) took 4089ms. Request Metrics: {} I0301 23:04:24.148057 14401 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:54197 (request call id 3) took 1954ms. Request Metrics: {} I0301 23:04:24.148097 14401 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:33697 (request call id 4) took 1951ms. Request Metrics: {} I0301 23:04:24.148126 14401 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:40257 (request call id 4) took 1951ms. Request Metrics: {} I0301 23:04:24.148778 14402 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.139:42753 (request call id 3) took 7936ms. Request Metrics: {} I0301 23:04:24.228772 14469 ts_manager.cc:98] Registered new tserver with Master: 81c15935bd774f6da0a260fc3aeed423 (127.0.22.138:43345) W0301 23:04:24.228842 14469 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.138:55255 (request call id 2) took 12392 ms (12.4 s). Client timeout 15000 ms (15 s) I0301 23:04:24.228852 14465 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.137:38963 (request call id 3) took 7116ms. Request Metrics: {} W0301 23:04:24.228929 14469 rpcz_store.cc:259] Trace: 0301 23:04:11.836225 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.836239 (+ 14us) service_pool.cc:221] Handling call 0301 23:04:24.131649 (+12295410us) ts_descriptor.cc:229] tablet server 81c15935bd774f6da0a260fc3aeed423: assigning location 0301 23:04:24.228748 (+ 97099us) ts_descriptor.cc:235] tablet server 81c15935bd774f6da0a260fc3aeed423: assigned location '/L1' 0301 23:04:24.228818 (+ 70us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.230814 14345 ts_manager.cc:98] Registered new tserver with Master: afe42b93631a46b79d48c710bb0949c3 (127.0.22.133:39893) W0301 23:04:24.230866 14345 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:51125 (request call id 2) took 12748 ms (12.7 s). Client timeout 15000 ms (15 s) W0301 23:04:24.230921 14345 rpcz_store.cc:259] Trace: 0301 23:04:11.481984 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.481999 (+ 15us) service_pool.cc:221] Handling call 0301 23:04:24.132532 (+12650533us) ts_descriptor.cc:229] tablet server afe42b93631a46b79d48c710bb0949c3: assigning location 0301 23:04:24.230799 (+ 98267us) ts_descriptor.cc:235] tablet server afe42b93631a46b79d48c710bb0949c3: assigned location '/L1' 0301 23:04:24.230848 (+ 49us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.230993 14348 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.134:41777 (request call id 3) took 5144ms. Request Metrics: {} I0301 23:04:24.248584 14404 ts_manager.cc:98] Registered new tserver with Master: ae1fd5ced0f746b7907cab3ad4fd25a8 (127.0.22.137:44147) W0301 23:04:24.248631 14404 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.137:37433 (request call id 2) took 12468 ms (12.5 s). Client timeout 15000 ms (15 s) W0301 23:04:24.248684 14404 rpcz_store.cc:259] Trace: 0301 23:04:11.779991 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.780004 (+ 13us) service_pool.cc:221] Handling call 0301 23:04:11.914005 (+134001us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x50a46a0. stack: 00000000024b19de 0000000000acd213 0000000000aa4866 000000000233481b 0000000002335149 00000000024c34b0 00007f64002e4183 00007f63fe6c2ffc 0301 23:04:24.148984 (+12234979us) ts_descriptor.cc:229] tablet server ae1fd5ced0f746b7907cab3ad4fd25a8: assigning location 0301 23:04:24.248567 (+ 99583us) ts_descriptor.cc:235] tablet server ae1fd5ced0f746b7907cab3ad4fd25a8: assigned location '/L1' 0301 23:04:24.248612 (+ 45us) inbound_call.cc:162] Queueing success response Metrics: {"spinlock_wait_cycles":307677056} I0301 23:04:24.248728 14408 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.132:40253 (request call id 3) took 8110ms. Request Metrics: {} I0301 23:04:24.248785 14405 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:43963 (request call id 3) took 6153ms. Request Metrics: {} I0301 23:04:24.248934 16551 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:04:24.248942 14410 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.135:49087 (request call id 3) took 9380ms. Request Metrics: {} I0301 23:04:24.249104 16551 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:04:24.269518 16551 catalog_manager.cc:941] Generated new certificate authority record I0301 23:04:24.270355 16551 catalog_manager.cc:1066] Loading token signing keys... I0301 23:04:24.283823 16551 catalog_manager.cc:4095] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Generated new TSK 0 I0301 23:04:24.320435 14468 ts_manager.cc:98] Registered new tserver with Master: 125f195fa3694b589407de1f591f0d1e (127.0.22.142:33235) I0301 23:04:24.320487 14468 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.142:47047 (request call id 2) took 9481ms. Request Metrics: {} I0301 23:04:24.332250 14347 ts_manager.cc:98] Registered new tserver with Master: 260a23a01ec64ac59599fca9754bb369 (127.0.22.140:33735) W0301 23:04:24.332309 14347 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.140:42835 (request call id 2) took 12257 ms (12.3 s). Client timeout 15000 ms (15 s) I0301 23:04:24.332332 14345 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.138:50421 (request call id 3) took 3281ms. Request Metrics: {} W0301 23:04:24.332376 14347 rpcz_store.cc:259] Trace: 0301 23:04:12.074348 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:12.074360 (+ 12us) service_pool.cc:221] Handling call 0301 23:04:12.892490 (+818130us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x4bbd3c4. stack: 00000000024b19de 00000000021ff112 0000000000acd072 0000000000aa4866 000000000233481b 0000000002335149 00000000024c34b0 00007faabcca9183 00007faabb087ffc 0301 23:04:24.230983 (+11338493us) ts_descriptor.cc:229] tablet server 260a23a01ec64ac59599fca9754bb369: assigning location 0301 23:04:24.332227 (+101244us) ts_descriptor.cc:235] tablet server 260a23a01ec64ac59599fca9754bb369: assigned location '/L1' 0301 23:04:24.332291 (+ 64us) inbound_call.cc:162] Queueing success response Metrics: {"spinlock_wait_cycles":1880969472} I0301 23:04:24.347797 14409 ts_manager.cc:98] Registered new tserver with Master: d7c95de99bdc421f9ab5a1f05bd5492c (127.0.22.144:33027) I0301 23:04:24.347851 14409 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.144:43253 (request call id 2) took 9208ms. Request Metrics: {} I0301 23:04:24.350752 14406 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:34609 (request call id 3) took 8173ms. Request Metrics: {} I0301 23:04:24.365041 14467 ts_manager.cc:98] Registered new tserver with Master: f8811aad84f24cb899523d311eac48cf (127.0.22.135:41893) W0301 23:04:24.365098 14467 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.135:44241 (request call id 2) took 12741 ms (12.7 s). Client timeout 15000 ms (15 s) W0301 23:04:24.365144 14467 rpcz_store.cc:259] Trace: 0301 23:04:11.623228 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.623249 (+ 21us) service_pool.cc:221] Handling call 0301 23:04:24.320566 (+12697317us) ts_descriptor.cc:229] tablet server f8811aad84f24cb899523d311eac48cf: assigning location 0301 23:04:24.365018 (+ 44452us) ts_descriptor.cc:235] tablet server f8811aad84f24cb899523d311eac48cf: assigned location '/L1' 0301 23:04:24.365071 (+ 53us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.373996 14339 ts_manager.cc:98] Registered new tserver with Master: 125f195fa3694b589407de1f591f0d1e (127.0.22.142:33235) W0301 23:04:24.374068 14344 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.129:38337 (request call id 3) took 12114 ms (12.1 s). Client timeout 15000 ms (15 s) W0301 23:04:24.374104 14344 rpcz_store.cc:259] Trace: 0301 23:04:12.259747 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:18.085513 (+5825766us) service_pool.cc:221] Handling call 0301 23:04:24.374045 (+6288532us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.374158 14348 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.137:41403 (request call id 3) took 1223ms. Request Metrics: {} I0301 23:04:24.374069 14339 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.142:57803 (request call id 2) took 6287ms. Request Metrics: {} I0301 23:04:24.432411 14403 ts_manager.cc:98] Registered new tserver with Master: 8c1416a176564de683d21f1dcd69d7aa (127.0.22.143:43607) I0301 23:04:24.432497 14403 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.143:53987 (request call id 2) took 9292ms. Request Metrics: {} I0301 23:04:24.460659 14471 ts_manager.cc:98] Registered new tserver with Master: 7052f504631e40809718e2a0fe5e2cc3 (127.0.22.131:36453) W0301 23:04:24.460729 14471 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.131:40089 (request call id 2) took 13123 ms (13.1 s). Client timeout 15000 ms (15 s) W0301 23:04:24.460796 14471 rpcz_store.cc:259] Trace: 0301 23:04:11.336800 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.336813 (+ 13us) service_pool.cc:221] Handling call 0301 23:04:24.365095 (+13028282us) ts_descriptor.cc:229] tablet server 7052f504631e40809718e2a0fe5e2cc3: assigning location 0301 23:04:24.460636 (+ 95541us) ts_descriptor.cc:235] tablet server 7052f504631e40809718e2a0fe5e2cc3: assigned location '/L1' 0301 23:04:24.460700 (+ 64us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.472355 14346 ts_manager.cc:98] Registered new tserver with Master: d7c95de99bdc421f9ab5a1f05bd5492c (127.0.22.144:33027) I0301 23:04:24.472419 14346 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.144:38207 (request call id 2) took 4420ms. Request Metrics: {} I0301 23:04:24.472425 14345 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.139:43229 (request call id 3) took 1255ms. Request Metrics: {} I0301 23:04:24.509619 14407 ts_manager.cc:98] Registered new tserver with Master: 125f195fa3694b589407de1f591f0d1e (127.0.22.142:33235) I0301 23:04:24.509672 14407 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.142:60123 (request call id 2) took 10641ms. Request Metrics: {} I0301 23:04:24.510874 14343 ts_manager.cc:98] Registered new tserver with Master: 8c1416a176564de683d21f1dcd69d7aa (127.0.22.143:43607) I0301 23:04:24.510957 14343 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.143:40963 (request call id 2) took 4458ms. Request Metrics: {} I0301 23:04:24.528316 14464 ts_manager.cc:98] Registered new tserver with Master: afe42b93631a46b79d48c710bb0949c3 (127.0.22.133:39893) W0301 23:04:24.528373 14464 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.133:55217 (request call id 2) took 13046 ms (13 s). Client timeout 15000 ms (15 s) W0301 23:04:24.528447 14464 rpcz_store.cc:259] Trace: 0301 23:04:11.482268 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.482282 (+ 14us) service_pool.cc:221] Handling call 0301 23:04:24.461434 (+12979152us) ts_descriptor.cc:229] tablet server afe42b93631a46b79d48c710bb0949c3: assigning location 0301 23:04:24.528296 (+ 66862us) ts_descriptor.cc:235] tablet server afe42b93631a46b79d48c710bb0949c3: assigned location '/L1' 0301 23:04:24.528353 (+ 57us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.552597 14342 ts_manager.cc:98] Registered new tserver with Master: 7cb814db45714c4c861e0ca70033e26a (127.0.22.141:41515) I0301 23:04:24.552644 14342 rpcz_store.cc:269] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.141:55849 (request call id 2) took 6465ms. Request Metrics: {} W0301 23:04:24.552687 14340 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.130:46503 (request call id 3) took 11601 ms (11.6 s). Client timeout 15000 ms (15 s) W0301 23:04:24.552723 14340 rpcz_store.cc:259] Trace: 0301 23:04:12.951585 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:20.051184 (+7099599us) service_pool.cc:221] Handling call 0301 23:04:24.552659 (+4501475us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.577582 14341 ts_manager.cc:98] Registered new tserver with Master: 13620ea0d2134184b6ae7cb6ab31534b (127.0.22.136:35561) W0301 23:04:24.577638 14341 rpcz_store.cc:253] Call kudu.master.MasterService.TSHeartbeat from 127.0.22.136:46965 (request call id 2) took 12856 ms (12.9 s). Client timeout 15000 ms (15 s) W0301 23:04:24.577697 14341 rpcz_store.cc:259] Trace: 0301 23:04:11.721109 (+ 0us) service_pool.cc:162] Inserting onto call queue 0301 23:04:11.721122 (+ 13us) service_pool.cc:221] Handling call 0301 23:04:24.553039 (+12831917us) ts_descriptor.cc:229] tablet server 13620ea0d2134184b6ae7cb6ab31534b: assigning location 0301 23:04:24.577567 (+ 24528us) ts_descriptor.cc:235] tablet server 13620ea0d2134184b6ae7cb6ab31534b: assigned location '/L1' 0301 23:04:24.577620 (+ 53us) inbound_call.cc:162] Queueing success response Metrics: {} I0301 23:04:24.578022 90 external_mini_cluster.cc:623] 16 TS(s) registered with all masters I0301 23:04:24.578630 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 14508 W0301 23:04:24.581907 14329 connection.cc:647] server connection from 127.0.22.129:38337 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:38337): Connection reset by peer (error 104) W0301 23:04:24.581924 14391 connection.cc:647] server connection from 127.0.22.129:40257 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:40257): Connection reset by peer (error 104) W0301 23:04:24.581938 14456 connection.cc:647] server connection from 127.0.22.129:42313 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:42313): Connection reset by peer (error 104) I0301 23:04:24.581995 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 14644 W0301 23:04:24.584975 14330 connection.cc:647] server connection from 127.0.22.130:46503 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:46503): Connection reset by peer (error 104) W0301 23:04:24.584997 14394 connection.cc:647] server connection from 127.0.22.130:33697 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:33697): Connection reset by peer (error 104) W0301 23:04:24.585019 14453 connection.cc:647] server connection from 127.0.22.130:34017 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:34017): Connection reset by peer (error 104) I0301 23:04:24.585060 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 14776 W0301 23:04:24.587684 14330 connection.cc:647] server connection from 127.0.22.131:42373 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:42373): Connection reset by peer (error 104) W0301 23:04:24.587699 14394 connection.cc:647] server connection from 127.0.22.131:43963 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:43963): Connection reset by peer (error 104) W0301 23:04:24.587739 14454 connection.cc:647] server connection from 127.0.22.131:40089 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:40089): Connection reset by peer (error 104) I0301 23:04:24.587769 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 14904 W0301 23:04:24.590266 14329 connection.cc:647] server connection from 127.0.22.132:50633 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:50633): Connection reset by peer (error 104) W0301 23:04:24.590273 14453 connection.cc:647] server connection from 127.0.22.132:59883 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:59883): Connection reset by peer (error 104) W0301 23:04:24.590356 14393 connection.cc:647] server connection from 127.0.22.132:40253 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:40253): Connection reset by peer (error 104) I0301 23:04:24.590411 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 15030 W0301 23:04:24.593463 14330 connection.cc:647] server connection from 127.0.22.133:51125 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:51125): Connection reset by peer (error 104) W0301 23:04:24.593484 14393 connection.cc:647] server connection from 127.0.22.133:47645 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:47645): Connection reset by peer (error 104) W0301 23:04:24.593500 14454 connection.cc:647] server connection from 127.0.22.133:55217 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:55217): Connection reset by peer (error 104) I0301 23:04:24.593610 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 15156 W0301 23:04:24.595963 14330 connection.cc:647] server connection from 127.0.22.134:41777 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:41777): Connection reset by peer (error 104) W0301 23:04:24.595994 14454 connection.cc:647] server connection from 127.0.22.134:48009 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:48009): Connection reset by peer (error 104) W0301 23:04:24.595998 14392 connection.cc:647] server connection from 127.0.22.134:54197 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:54197): Connection reset by peer (error 104) I0301 23:04:24.596062 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 15282 W0301 23:04:24.598258 14329 connection.cc:647] server connection from 127.0.22.135:41565 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:41565): Connection reset by peer (error 104) W0301 23:04:24.598282 14394 connection.cc:647] server connection from 127.0.22.135:49087 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:49087): Connection reset by peer (error 104) W0301 23:04:24.598300 14454 connection.cc:647] server connection from 127.0.22.135:44241 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:44241): Connection reset by peer (error 104) I0301 23:04:24.598353 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 15408 W0301 23:04:24.600675 14330 connection.cc:647] server connection from 127.0.22.136:46965 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:46965): Connection reset by peer (error 104) W0301 23:04:24.600709 14454 connection.cc:647] server connection from 127.0.22.136:50667 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:50667): Connection reset by peer (error 104) W0301 23:04:24.600721 14394 connection.cc:647] server connection from 127.0.22.136:34609 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:34609): Connection reset by peer (error 104) I0301 23:04:24.600772 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 15534 W0301 23:04:24.603056 14332 connection.cc:647] server connection from 127.0.22.137:41403 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:41403): Connection reset by peer (error 104) W0301 23:04:24.603060 14393 connection.cc:647] server connection from 127.0.22.137:37433 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:37433): Connection reset by peer (error 104) W0301 23:04:24.603083 14453 connection.cc:647] server connection from 127.0.22.137:38963 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:38963): Connection reset by peer (error 104) I0301 23:04:24.603143 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 15660 W0301 23:04:24.605567 14332 connection.cc:647] server connection from 127.0.22.138:50421 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:50421): Connection reset by peer (error 104) W0301 23:04:24.605602 14393 connection.cc:647] server connection from 127.0.22.138:58501 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:58501): Connection reset by peer (error 104) I0301 23:04:24.605657 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 15786 W0301 23:04:24.605660 14456 connection.cc:647] server connection from 127.0.22.138:55255 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:55255): Connection reset by peer (error 104) W0301 23:04:24.607899 14392 connection.cc:647] server connection from 127.0.22.139:42753 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:42753): Connection reset by peer (error 104) W0301 23:04:24.607903 14331 connection.cc:647] server connection from 127.0.22.139:43229 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:43229): Connection reset by peer (error 104) W0301 23:04:24.607924 14454 connection.cc:647] server connection from 127.0.22.139:38247 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:38247): Connection reset by peer (error 104) I0301 23:04:24.607980 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 15912 W0301 23:04:24.610321 14330 connection.cc:647] server connection from 127.0.22.140:42835 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:42835): Connection reset by peer (error 104) W0301 23:04:24.610342 14456 connection.cc:647] server connection from 127.0.22.140:37135 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:37135): Connection reset by peer (error 104) W0301 23:04:24.610363 14393 connection.cc:647] server connection from 127.0.22.140:55745 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:55745): Connection reset by peer (error 104) I0301 23:04:24.610446 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 16042 W0301 23:04:24.612753 14391 connection.cc:647] server connection from 127.0.22.141:37977 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:37977): Connection reset by peer (error 104) W0301 23:04:24.612776 14331 connection.cc:647] server connection from 127.0.22.141:55849 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:55849): Connection reset by peer (error 104) I0301 23:04:24.612833 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 16168 W0301 23:04:24.612896 14454 connection.cc:647] server connection from 127.0.22.141:54453 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:54453): Connection reset by peer (error 104) W0301 23:04:24.615011 14331 connection.cc:647] server connection from 127.0.22.142:57803 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:57803): Connection reset by peer (error 104) W0301 23:04:24.615020 14456 connection.cc:647] server connection from 127.0.22.142:47047 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:47047): Connection reset by peer (error 104) W0301 23:04:24.615041 14391 connection.cc:647] server connection from 127.0.22.142:60123 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:60123): Connection reset by peer (error 104) I0301 23:04:24.615105 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 16291 W0301 23:04:24.617839 14332 connection.cc:647] server connection from 127.0.22.143:40963 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:40963): Connection reset by peer (error 104) W0301 23:04:24.617913 14392 connection.cc:647] server connection from 127.0.22.143:53987 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:53987): Connection reset by peer (error 104) W0301 23:04:24.617990 14454 connection.cc:647] server connection from 127.0.22.143:55085 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:55085): Connection reset by peer (error 104) I0301 23:04:24.617992 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 16420 W0301 23:04:24.620085 14393 connection.cc:647] server connection from 127.0.22.144:43253 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:43253): Connection reset by peer (error 104) W0301 23:04:24.620106 14453 connection.cc:647] server connection from 127.0.22.144:58945 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:58945): Connection reset by peer (error 104) W0301 23:04:24.620128 14329 connection.cc:647] server connection from 127.0.22.144:38207 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:38207): Connection reset by peer (error 104) I0301 23:04:24.620271 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 14322 W0301 23:04:24.623178 14454 connection.cc:647] server connection from 127.0.0.1:54940 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:54940): Connection reset by peer (error 104) W0301 23:04:24.623179 14321 connection.cc:647] client connection to 127.0.22.190:45973 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:45973): Connection reset by peer (error 104) W0301 23:04:24.623201 14393 connection.cc:647] server connection from 127.0.0.1:60946 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:60946): Connection reset by peer (error 104) W0301 23:04:24.623293 14391 connection.cc:647] client connection to 127.0.22.190:45973 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:45973): Connection reset by peer (error 104) W0301 23:04:24.623308 14453 connection.cc:647] client connection to 127.0.22.190:45973 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:45973): Connection reset by peer (error 104) I0301 23:04:24.623428 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 14384 W0301 23:04:24.626054 14321 connection.cc:647] client connection to 127.0.22.189:36569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:36569): Connection reset by peer (error 104) W0301 23:04:24.626085 14454 connection.cc:647] server connection from 127.0.0.1:54938 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:54938): Connection reset by peer (error 104) W0301 23:04:24.626091 14453 connection.cc:647] client connection to 127.0.22.189:36569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:36569): Connection reset by peer (error 104) I0301 23:04:24.626252 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 14444 W0301 23:04:24.628624 14321 connection.cc:647] client connection to 127.0.22.188:46753 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.188:46753): Connection reset by peer (error 104) I0301 23:04:24.628873 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:45973 --webserver_interface=127.0.22.190 --webserver_port=42883 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:24.639255 16614 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:24.639338 16614 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:24.640121 16614 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:24.640143 16614 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:24.640147 16614 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:24.640151 16614 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:24.641435 16614 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:45973 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=42883 --never_fsync=true --heap_profile_path=/tmp/kudu-master.16614 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:24.642155 16614 master_main.cc:80] Initializing master server... I0301 23:04:24.642288 16614 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48016us I0301 23:04:24.642395 16614 fs_manager.cc:263] Metadata directory not provided I0301 23:04:24.642434 16614 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:24.643097 16614 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:24.643266 16614 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:24.643333 16614 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:24.643852 16614 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:24.643986 16614 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal uuid: "4457cd6310c641c4b393d2e151035eb4" format_stamp: "Formatted at 2019-03-01 23:04:10 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:24.644016 16614 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:24.685712 16614 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:24.685861 16614 master_main.cc:83] Starting Master server... I0301 23:04:24.688418 16614 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:45973 I0301 23:04:24.688495 16614 webserver.cc:175] Starting webserver on 127.0.22.190:42883 I0301 23:04:24.688513 16614 webserver.cc:186] Document root disabled I0301 23:04:24.688642 16614 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:42883/ I0301 23:04:24.688762 16614 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:04:24.689235 16673 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:24.689488 16673 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: Bootstrap starting. I0301 23:04:24.690588 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 16614 I0301 23:04:24.690731 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:36569 --webserver_interface=127.0.22.189 --webserver_port=44079 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 with env {} I0301 23:04:24.694962 16673 log.cc:525] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: Log is configured to *not* fsync() on all Append() calls I0301 23:04:24.695509 16673 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:24.695678 16673 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: Bootstrap complete. I0301 23:04:24.697801 16673 raft_consensus.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:24.697831 16673 raft_consensus.cc:705] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4457cd6310c641c4b393d2e151035eb4, State: Initialized, Role: FOLLOWER I0301 23:04:24.697890 16673 consensus_queue.cc:229] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:24.697988 16673 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:24.698007 16673 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:24.698034 16673 sys_catalog.cc:424] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:24.698284 16614 master_main.cc:86] Master server successfully started. WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:24.704427 16674 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:24.704505 16674 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:24.705260 16674 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:24.705281 16674 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:24.705286 16674 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:24.705289 16674 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:24.705615 16676 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:24.705636 16676 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:24.706369 16674 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:36569 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/info.pb --webserver_interface=127.0.22.189 --webserver_port=44079 --never_fsync=true --heap_profile_path=/tmp/kudu-master.16674 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:24.706698 16677 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: acquiring CA information for follower catalog manager: success I0301 23:04:24.706820 16677 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0301 23:04:24.707171 16674 master_main.cc:80] Initializing master server... I0301 23:04:24.707307 16674 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48016us I0301 23:04:24.707422 16674 fs_manager.cc:263] Metadata directory not provided I0301 23:04:24.707453 16674 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:24.708123 16674 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:24.708334 16674 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:24.708423 16674 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:24.708930 16674 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:24.709055 16674 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal uuid: "9191e9b5d78f4517b68d6a7efbf73301" format_stamp: "Formatted at 2019-03-01 23:04:10 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:24.709089 16674 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:24.758839 16674 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:24.758999 16674 master_main.cc:83] Starting Master server... I0301 23:04:24.760787 16674 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.189:36569 I0301 23:04:24.760836 16674 webserver.cc:175] Starting webserver on 127.0.22.189:44079 I0301 23:04:24.760843 16674 webserver.cc:186] Document root disabled I0301 23:04:24.760962 16674 webserver.cc:313] Webserver started. Bound to: http://127.0.22.189:44079/ I0301 23:04:24.761085 16674 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-1/data/info.pb I0301 23:04:24.764756 16737 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:24.765028 16737 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Bootstrap starting. I0301 23:04:24.766650 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 16674 I0301 23:04:24.766855 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:46753 --webserver_interface=127.0.22.188 --webserver_port=33451 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 with env {} I0301 23:04:24.770635 16737 log.cc:525] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Log is configured to *not* fsync() on all Append() calls WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:24.777650 16738 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:24.777732 16738 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:24.778530 16738 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:24.778553 16738 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:24.778560 16738 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:24.778565 16738 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:24.779572 16738 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:12 --map /L2:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:46753 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/info.pb --webserver_interface=127.0.22.188 --webserver_port=33451 --never_fsync=true --heap_profile_path=/tmp/kudu-master.16738 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:24.780563 16738 master_main.cc:80] Initializing master server... I0301 23:04:24.780706 16738 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48016us I0301 23:04:24.780803 16738 fs_manager.cc:263] Metadata directory not provided I0301 23:04:24.780810 16737 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:24.780838 16738 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:24.781013 16737 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Bootstrap complete. I0301 23:04:24.784116 16737 raft_consensus.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:24.784149 16737 raft_consensus.cc:705] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9191e9b5d78f4517b68d6a7efbf73301, State: Initialized, Role: FOLLOWER I0301 23:04:24.784245 16737 consensus_queue.cc:229] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:24.784348 16737 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:24.784369 16745 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:24.784373 16737 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:24.784379 16745 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:24.784397 16738 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.000s sys 0.000s I0301 23:04:24.784428 16737 sys_catalog.cc:424] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:24.784610 16738 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:24.784675 16738 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:24.784739 16674 master_main.cc:86] Master server successfully started. I0301 23:04:24.785321 16738 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:24.785491 16738 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal uuid: "af574d09abdf44d797ac2b771b578e91" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:24.785532 16738 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:24.785812 16746 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: acquiring CA information for follower catalog manager: success I0301 23:04:24.785938 16746 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0301 23:04:24.809552 16738 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:24.809716 16738 master_main.cc:83] Starting Master server... I0301 23:04:24.812145 16738 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.188:46753 I0301 23:04:24.812229 16738 webserver.cc:175] Starting webserver on 127.0.22.188:33451 I0301 23:04:24.812249 16738 webserver.cc:186] Document root disabled I0301 23:04:24.812427 16738 webserver.cc:313] Webserver started. Bound to: http://127.0.22.188:33451/ I0301 23:04:24.812556 16738 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/master-2/data/info.pb I0301 23:04:24.813086 16801 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:24.813351 16801 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: Bootstrap starting. I0301 23:04:24.818662 16801 log.cc:525] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: Log is configured to *not* fsync() on all Append() calls I0301 23:04:24.818914 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 16738 I0301 23:04:24.819097 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:44781 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_port=43439 --webserver_interface=127.0.22.129 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:24.819325 16801 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:24.819573 16801 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: Bootstrap complete. I0301 23:04:24.822757 16801 raft_consensus.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:24.822791 16801 raft_consensus.cc:705] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: af574d09abdf44d797ac2b771b578e91, State: Initialized, Role: FOLLOWER I0301 23:04:24.822916 16801 consensus_queue.cc:229] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:24.823045 16801 sys_catalog.cc:337] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:24.823071 16801 sys_catalog.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:24.823105 16801 sys_catalog.cc:424] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:24.823113 16804 sys_catalog.cc:337] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:24.823345 16738 master_main.cc:86] Master server successfully started. I0301 23:04:24.823423 16804 sys_catalog.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:24.825495 16805 catalog_manager.cc:1102] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: acquiring CA information for follower catalog manager: success I0301 23:04:24.825624 16805 catalog_manager.cc:1130] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:24.831425 16803 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:24.831528 16803 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:24.832600 16803 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:24.832643 16803 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:04:24.833891 16803 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:44781 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=43439 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.16803 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:24.835130 16803 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:24.835328 16803 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48016us I0301 23:04:24.835450 16803 fs_manager.cc:263] Metadata directory not provided I0301 23:04:24.835491 16803 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:24.836418 16803 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.001s I0301 23:04:24.836570 16803 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:24.836647 16803 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:24.837345 16803 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:24.837535 16803 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal uuid: "b2c730d41d15403dadbcbf1c4e154fe8" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:24.837579 16803 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:24.936887 16803 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:24.937188 16803 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:24.937291 16803 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:24.942103 16803 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:44781 I0301 23:04:24.942171 16803 webserver.cc:175] Starting webserver on 127.0.22.129:43439 I0301 23:04:24.942195 16803 webserver.cc:186] Document root disabled I0301 23:04:24.942337 16803 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:43439/ I0301 23:04:24.942512 16803 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:04:24.942870 16803 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:24.951982 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 16803 I0301 23:04:24.952147 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:38955 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_port=41651 --webserver_interface=127.0.22.130 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:24.955443 16926 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:24.955471 16926 heartbeater.cc:425] Registering TS with master... I0301 23:04:24.955484 16927 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:24.955493 16927 heartbeater.cc:425] Registering TS with master... I0301 23:04:24.955516 16926 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:24.955516 16927 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:24.958583 16925 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:24.958604 16925 heartbeater.cc:425] Registering TS with master... I0301 23:04:24.958629 16925 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:24.986865 16935 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:24.986964 16935 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:24.987660 16935 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:24.987695 16935 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:04:24.996649 16935 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:38955 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=41651 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.16935 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:24.997464 16935 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:24.997635 16935 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48016us I0301 23:04:24.997725 16935 fs_manager.cc:263] Metadata directory not provided I0301 23:04:24.997762 16935 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:24.998507 16935 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:04:24.998641 16935 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:24.998705 16935 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:24.999217 16935 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:24.999357 16935 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal uuid: "cec24fa21a664f1e98e80518d4875d14" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:24.999399 16935 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.030910 16768 ts_manager.cc:98] Registered new tserver with Master: b2c730d41d15403dadbcbf1c4e154fe8 (127.0.22.129:44781) I0301 23:04:25.037046 16935 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.037293 16935 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.037369 16935 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.039911 16698 ts_manager.cc:98] Registered new tserver with Master: b2c730d41d15403dadbcbf1c4e154fe8 (127.0.22.129:44781) I0301 23:04:25.042198 16640 ts_manager.cc:98] Registered new tserver with Master: b2c730d41d15403dadbcbf1c4e154fe8 (127.0.22.129:44781) I0301 23:04:25.042477 16935 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:38955 I0301 23:04:25.042521 16935 webserver.cc:175] Starting webserver on 127.0.22.130:41651 I0301 23:04:25.042527 16935 webserver.cc:186] Document root disabled I0301 23:04:25.042740 16935 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:41651/ I0301 23:04:25.045452 16935 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:04:25.045976 16935 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.049187 17057 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.049216 17057 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.049271 17057 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.049711 17058 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.049731 17058 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.049762 17058 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.050117 17059 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.050132 17059 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.050161 17059 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.054780 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 16935 I0301 23:04:25.054951 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:36453 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_port=34553 --webserver_interface=127.0.22.131 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.078547 17067 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.078651 17067 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.079675 17067 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.079718 17067 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:04:25.085139 17067 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:36453 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=34553 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.17067 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.086351 17067 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.086570 17067 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.086665 17067 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.086705 17067 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.092413 17067 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s I0301 23:04:25.092548 17067 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.092622 17067 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.093123 17067 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.093261 17067 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal uuid: "7052f504631e40809718e2a0fe5e2cc3" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.093295 17067 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.105955 16640 ts_manager.cc:98] Registered new tserver with Master: cec24fa21a664f1e98e80518d4875d14 (127.0.22.130:38955) I0301 23:04:25.109429 16768 ts_manager.cc:98] Registered new tserver with Master: cec24fa21a664f1e98e80518d4875d14 (127.0.22.130:38955) I0301 23:04:25.114521 16698 ts_manager.cc:98] Registered new tserver with Master: cec24fa21a664f1e98e80518d4875d14 (127.0.22.130:38955) I0301 23:04:25.130784 17067 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.130997 17067 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.131074 17067 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.135854 17067 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:36453 I0301 23:04:25.135913 17067 webserver.cc:175] Starting webserver on 127.0.22.131:34553 I0301 23:04:25.135932 17067 webserver.cc:186] Document root disabled I0301 23:04:25.136067 17067 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:34553/ I0301 23:04:25.136242 17067 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:04:25.136662 17067 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.139037 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 17067 I0301 23:04:25.139212 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:40927 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_port=36249 --webserver_interface=127.0.22.132 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:25.139972 17186 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.139995 17186 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.140031 17186 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.140422 17188 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.140444 17187 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.140450 17188 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.140456 17187 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.140485 17187 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.140487 17188 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.169629 17193 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.169740 17193 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.170761 17193 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.170804 17193 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:04:25.176327 17193 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:40927 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=36249 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.17193 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.177561 17193 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.177755 17193 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.177848 17193 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.177891 17193 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.178835 17193 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:25.178973 17193 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.179049 17193 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.179564 17193 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.179704 17193 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal uuid: "a1608725c87e4eab92fe9207cf54cf58" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.179739 17193 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.195396 16640 ts_manager.cc:98] Registered new tserver with Master: 7052f504631e40809718e2a0fe5e2cc3 (127.0.22.131:36453) I0301 23:04:25.201369 17193 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.201591 17193 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.201648 17193 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.203588 16698 ts_manager.cc:98] Registered new tserver with Master: 7052f504631e40809718e2a0fe5e2cc3 (127.0.22.131:36453) I0301 23:04:25.205834 17193 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:40927 I0301 23:04:25.205885 17193 webserver.cc:175] Starting webserver on 127.0.22.132:36249 I0301 23:04:25.205891 17193 webserver.cc:186] Document root disabled I0301 23:04:25.206004 17193 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:36249/ I0301 23:04:25.206125 17193 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:04:25.206441 17193 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.209307 16768 ts_manager.cc:98] Registered new tserver with Master: 7052f504631e40809718e2a0fe5e2cc3 (127.0.22.131:36453) I0301 23:04:25.210136 17315 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.210155 17315 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.210189 17315 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.210296 17317 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.210312 17317 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.210337 17317 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.210547 17316 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.210570 17316 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.210600 17316 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.211714 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 17193 I0301 23:04:25.211907 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:39893 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_port=46699 --webserver_interface=127.0.22.133 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.253247 17325 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.253337 17325 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.254046 17325 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.254077 17325 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:04:25.254977 17325 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:39893 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=46699 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.17325 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.255801 17325 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.255967 17325 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.256052 17325 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.256083 17325 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.268878 17325 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:25.269022 17325 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.269086 17325 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.269624 17325 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.269769 17325 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal uuid: "afe42b93631a46b79d48c710bb0949c3" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.269801 17325 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.287921 16698 ts_manager.cc:98] Registered new tserver with Master: a1608725c87e4eab92fe9207cf54cf58 (127.0.22.132:40927) I0301 23:04:25.294394 16768 ts_manager.cc:98] Registered new tserver with Master: a1608725c87e4eab92fe9207cf54cf58 (127.0.22.132:40927) I0301 23:04:25.294430 16640 ts_manager.cc:98] Registered new tserver with Master: a1608725c87e4eab92fe9207cf54cf58 (127.0.22.132:40927) I0301 23:04:25.300137 17325 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.300400 17325 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.300459 17325 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.304796 17325 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:39893 I0301 23:04:25.304857 17325 webserver.cc:175] Starting webserver on 127.0.22.133:46699 I0301 23:04:25.304880 17325 webserver.cc:186] Document root disabled I0301 23:04:25.305007 17325 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:46699/ I0301 23:04:25.305125 17325 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:04:25.305610 17325 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.308859 17444 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.308884 17444 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.308905 17445 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.308930 17445 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.308936 17444 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.308964 17445 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.308976 17446 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.308985 17446 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.309016 17446 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.311612 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 17325 I0301 23:04:25.311803 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:37517 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_port=38431 --webserver_interface=127.0.22.134 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.346788 17454 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.346870 17454 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.347606 17454 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.347637 17454 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:04:25.360608 17454 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:37517 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=38431 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.17454 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.361433 17454 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.361598 17454 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.361680 17454 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.361711 17454 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.362412 17454 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:25.362560 17454 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.362633 17454 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.363296 17454 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.363483 17454 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal uuid: "0b487e0e73524a20a7d2c021d55ca8e1" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.363524 17454 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.402060 16640 ts_manager.cc:98] Registered new tserver with Master: afe42b93631a46b79d48c710bb0949c3 (127.0.22.133:39893) I0301 23:04:25.403653 16698 ts_manager.cc:98] Registered new tserver with Master: afe42b93631a46b79d48c710bb0949c3 (127.0.22.133:39893) I0301 23:04:25.405135 16768 ts_manager.cc:98] Registered new tserver with Master: afe42b93631a46b79d48c710bb0949c3 (127.0.22.133:39893) I0301 23:04:25.429486 17454 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.429685 17454 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.429747 17454 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.433467 17454 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:37517 I0301 23:04:25.433521 17454 webserver.cc:175] Starting webserver on 127.0.22.134:38431 I0301 23:04:25.433539 17454 webserver.cc:186] Document root disabled I0301 23:04:25.433650 17454 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:38431/ I0301 23:04:25.433779 17454 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:04:25.434175 17454 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.437891 17573 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.437917 17573 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.437958 17573 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.438032 17574 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.438057 17574 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.438096 17574 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.438807 17575 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.438832 17575 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.438863 17575 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.441892 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 17454 I0301 23:04:25.442051 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:41893 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_port=41841 --webserver_interface=127.0.22.135 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.481161 17583 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.481258 17583 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.481986 17583 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.482020 17583 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:04:25.483006 17583 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:41893 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=41841 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.17583 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.483870 17583 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.484062 17583 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.484143 17583 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.484218 17583 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.484941 17583 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:25.485060 17583 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.485121 17583 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.485664 17583 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.485886 17583 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal uuid: "f8811aad84f24cb899523d311eac48cf" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.485934 17583 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.502756 17583 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.502955 17583 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.503008 17583 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.510587 17583 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:41893 I0301 23:04:25.510639 17583 webserver.cc:175] Starting webserver on 127.0.22.135:41841 I0301 23:04:25.510645 17583 webserver.cc:186] Document root disabled I0301 23:04:25.510782 17583 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:41841/ I0301 23:04:25.510921 17583 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:04:25.511261 17583 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.515666 17702 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.515683 17702 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.515719 17702 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.516577 17704 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.516602 17704 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.516640 17704 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.518327 17703 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.518409 17703 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.518479 17703 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.519316 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 17583 I0301 23:04:25.519516 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:35561 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_port=38479 --webserver_interface=127.0.22.136 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:25.522899 16768 ts_manager.cc:98] Registered new tserver with Master: 0b487e0e73524a20a7d2c021d55ca8e1 (127.0.22.134:37517) I0301 23:04:25.525719 16698 ts_manager.cc:98] Registered new tserver with Master: 0b487e0e73524a20a7d2c021d55ca8e1 (127.0.22.134:37517) I0301 23:04:25.533660 16640 ts_manager.cc:98] Registered new tserver with Master: 0b487e0e73524a20a7d2c021d55ca8e1 (127.0.22.134:37517) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.539350 17709 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.539460 17709 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.540488 17709 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.540529 17709 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:04:25.541810 17709 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:35561 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=38479 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.17709 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.543035 17709 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.543211 17709 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.543306 17709 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.543344 17709 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.544306 17709 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:04:25.544509 17709 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.544606 17709 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.545258 17709 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.545464 17709 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal uuid: "13620ea0d2134184b6ae7cb6ab31534b" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.545536 17709 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.565552 16697 ts_manager.cc:98] Registered new tserver with Master: f8811aad84f24cb899523d311eac48cf (127.0.22.135:41893) I0301 23:04:25.567101 16767 ts_manager.cc:98] Registered new tserver with Master: f8811aad84f24cb899523d311eac48cf (127.0.22.135:41893) I0301 23:04:25.570348 16639 ts_manager.cc:98] Registered new tserver with Master: f8811aad84f24cb899523d311eac48cf (127.0.22.135:41893) I0301 23:04:25.591320 17709 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.591543 17709 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.591603 17709 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.594841 17709 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:35561 I0301 23:04:25.594902 17709 webserver.cc:175] Starting webserver on 127.0.22.136:38479 I0301 23:04:25.594925 17709 webserver.cc:186] Document root disabled I0301 23:04:25.595041 17709 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:38479/ I0301 23:04:25.595165 17709 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:04:25.595499 17709 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.599233 17831 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.599257 17831 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.599300 17831 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.599536 17832 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.599553 17832 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.599565 17833 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.599573 17833 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.599581 17832 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.599601 17833 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.604233 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 17709 I0301 23:04:25.604413 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data --block_manager=log --rpc_bind_addresses=127.0.22.137:44147 --local_ip_for_outbound_sockets=127.0.22.137 --webserver_port=44669 --webserver_interface=127.0.22.137 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.645264 17841 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.645352 17841 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.646061 17841 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.646095 17841 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.137 I0301 23:04:25.647006 17841 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.137:44147 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/info.pb --webserver_interface=127.0.22.137 --webserver_port=44669 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.17841 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.137 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.647859 17841 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.648061 17841 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.660259 17841 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.660302 17841 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.661015 17841 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:25.661173 17841 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.661250 17841 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.661939 17841 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.662104 17841 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal uuid: "ae1fd5ced0f746b7907cab3ad4fd25a8" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.662145 17841 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.679786 17841 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.680014 17841 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.680083 17841 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.684993 17841 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.137:44147 I0301 23:04:25.685081 17841 webserver.cc:175] Starting webserver on 127.0.22.137:44669 I0301 23:04:25.685101 17841 webserver.cc:186] Document root disabled I0301 23:04:25.685286 17841 webserver.cc:313] Webserver started. Bound to: http://127.0.22.137:44669/ I0301 23:04:25.685453 17841 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-8/data/info.pb I0301 23:04:25.685745 17841 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.689826 16767 ts_manager.cc:98] Registered new tserver with Master: 13620ea0d2134184b6ae7cb6ab31534b (127.0.22.136:35561) I0301 23:04:25.690130 17960 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.690147 17960 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.690186 17960 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.690395 17962 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.690448 17962 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.690480 17962 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.690754 17961 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.690802 17961 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.690851 17961 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.691357 16639 ts_manager.cc:98] Registered new tserver with Master: 13620ea0d2134184b6ae7cb6ab31534b (127.0.22.136:35561) I0301 23:04:25.691423 16697 ts_manager.cc:98] Registered new tserver with Master: 13620ea0d2134184b6ae7cb6ab31534b (127.0.22.136:35561) I0301 23:04:25.693511 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 17841 I0301 23:04:25.693693 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data --block_manager=log --rpc_bind_addresses=127.0.22.138:43345 --local_ip_for_outbound_sockets=127.0.22.138 --webserver_port=40401 --webserver_interface=127.0.22.138 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.730558 17970 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.730648 17970 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.731622 17970 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.731657 17970 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.138 I0301 23:04:25.748772 17970 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.138:43345 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/info.pb --webserver_interface=127.0.22.138 --webserver_port=40401 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.17970 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.138 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.749931 17970 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.750123 17970 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.750234 17970 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.750270 17970 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.751204 17970 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:25.751360 17970 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.751451 17970 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.751974 17970 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.752118 17970 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal uuid: "81c15935bd774f6da0a260fc3aeed423" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.752156 17970 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.771239 17970 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.771483 17970 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.771553 17970 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.776954 17970 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.138:43345 I0301 23:04:25.777004 17970 webserver.cc:175] Starting webserver on 127.0.22.138:40401 I0301 23:04:25.777011 17970 webserver.cc:186] Document root disabled I0301 23:04:25.777153 17970 webserver.cc:313] Webserver started. Bound to: http://127.0.22.138:40401/ I0301 23:04:25.777294 17970 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-9/data/info.pb I0301 23:04:25.777709 17970 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.781529 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 17970 I0301 23:04:25.781707 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data --block_manager=log --rpc_bind_addresses=127.0.22.139:45995 --local_ip_for_outbound_sockets=127.0.22.139 --webserver_port=41791 --webserver_interface=127.0.22.139 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:25.782358 18091 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.782439 18091 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.782481 18091 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.783103 18089 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.783123 18089 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.783196 18089 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.783761 18090 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.783812 18090 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.783874 18090 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.784318 16767 ts_manager.cc:98] Registered new tserver with Master: ae1fd5ced0f746b7907cab3ad4fd25a8 (127.0.22.137:44147) I0301 23:04:25.789100 16698 ts_manager.cc:98] Registered new tserver with Master: ae1fd5ced0f746b7907cab3ad4fd25a8 (127.0.22.137:44147) I0301 23:04:25.790096 16640 ts_manager.cc:98] Registered new tserver with Master: ae1fd5ced0f746b7907cab3ad4fd25a8 (127.0.22.137:44147) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.811622 18096 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.811707 18096 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.824795 18096 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.824837 18096 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.139 I0301 23:04:25.826086 18096 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.139:45995 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/info.pb --webserver_interface=127.0.22.139 --webserver_port=41791 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.18096 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.139 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.827268 18096 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.827471 18096 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.827558 18096 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.827594 18096 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.840519 18096 fs_manager.cc:399] Time spent opening directory manager: real 0.012s user 0.001s sys 0.000s I0301 23:04:25.840672 18096 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.840749 18096 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.841420 18096 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.841583 18096 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal uuid: "8a0c9c16cf7c4007bfc5616bd13816be" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.841619 18096 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.861425 18096 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.861619 18096 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.861682 18096 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.867393 18096 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.139:45995 I0301 23:04:25.867455 18096 webserver.cc:175] Starting webserver on 127.0.22.139:41791 I0301 23:04:25.867465 18096 webserver.cc:186] Document root disabled I0301 23:04:25.867595 18096 webserver.cc:313] Webserver started. Bound to: http://127.0.22.139:41791/ I0301 23:04:25.867729 18096 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-10/data/info.pb I0301 23:04:25.868151 18096 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.872246 18220 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.872298 18220 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.872421 18220 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.872798 18218 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.872822 18218 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.872886 18218 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.873081 18219 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.873150 18219 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.873240 18219 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.874771 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 18096 I0301 23:04:25.874955 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data --block_manager=log --rpc_bind_addresses=127.0.22.140:33735 --local_ip_for_outbound_sockets=127.0.22.140 --webserver_port=46381 --webserver_interface=127.0.22.140 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:25.901362 16768 ts_manager.cc:98] Registered new tserver with Master: 81c15935bd774f6da0a260fc3aeed423 (127.0.22.138:43345) I0301 23:04:25.908964 16639 ts_manager.cc:98] Registered new tserver with Master: 81c15935bd774f6da0a260fc3aeed423 (127.0.22.138:43345) I0301 23:04:25.908957 16697 ts_manager.cc:98] Registered new tserver with Master: 81c15935bd774f6da0a260fc3aeed423 (127.0.22.138:43345) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:25.909420 18225 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:25.909515 18225 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:25.910571 18225 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:25.910612 18225 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.140 I0301 23:04:25.911602 18229 raft_consensus.cc:472] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0301 23:04:25.911696 18229 raft_consensus.cc:494] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:25.911840 18225 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.140:33735 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/info.pb --webserver_interface=127.0.22.140 --webserver_port=46381 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.18225 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.140 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:25.913008 18225 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:25.913170 18225 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0301 23:04:25.913269 18225 fs_manager.cc:263] Metadata directory not provided I0301 23:04:25.913308 18225 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:25.913317 18229 leader_election.cc:292] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4457cd6310c641c4b393d2e151035eb4 (127.0.22.190:45973), af574d09abdf44d797ac2b771b578e91 (127.0.22.188:46753) I0301 23:04:25.916340 16650 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9191e9b5d78f4517b68d6a7efbf73301" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4457cd6310c641c4b393d2e151035eb4" is_pre_election: true I0301 23:04:25.916404 18225 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.000s sys 0.000s I0301 23:04:25.916424 16650 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9191e9b5d78f4517b68d6a7efbf73301 in term 1. I0301 23:04:25.916554 18225 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:25.916618 18225 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:25.916664 16685 leader_election.cc:306] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4457cd6310c641c4b393d2e151035eb4, 9191e9b5d78f4517b68d6a7efbf73301; no voters: I0301 23:04:25.916770 18229 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Leader pre-election won for term 2 I0301 23:04:25.916862 18229 raft_consensus.cc:472] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0301 23:04:25.916946 18229 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 1 FOLLOWER]: Advancing to term 2 I0301 23:04:25.917233 18225 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:25.917418 18225 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal uuid: "260a23a01ec64ac59599fca9754bb369" format_stamp: "Formatted at 2019-03-01 23:04:11 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:25.917457 18225 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:25.918146 18229 raft_consensus.cc:494] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:25.918489 16650 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9191e9b5d78f4517b68d6a7efbf73301" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "4457cd6310c641c4b393d2e151035eb4" I0301 23:04:25.918506 16650 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 1 FOLLOWER]: Advancing to term 2 I0301 23:04:25.919265 16650 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9191e9b5d78f4517b68d6a7efbf73301 in term 2. I0301 23:04:25.919348 16770 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9191e9b5d78f4517b68d6a7efbf73301" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af574d09abdf44d797ac2b771b578e91" is_pre_election: true I0301 23:04:25.919417 16770 raft_consensus.cc:2346] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9191e9b5d78f4517b68d6a7efbf73301 in term 1. I0301 23:04:25.919517 16685 leader_election.cc:306] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4457cd6310c641c4b393d2e151035eb4, 9191e9b5d78f4517b68d6a7efbf73301; no voters: I0301 23:04:25.919872 16770 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "9191e9b5d78f4517b68d6a7efbf73301" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "af574d09abdf44d797ac2b771b578e91" I0301 23:04:25.919893 16770 raft_consensus.cc:2886] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 1 FOLLOWER]: Advancing to term 2 I0301 23:04:25.921030 18238 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 2 FOLLOWER]: Leader election won for term 2 I0301 23:04:25.921083 16770 raft_consensus.cc:2346] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9191e9b5d78f4517b68d6a7efbf73301 in term 2. I0301 23:04:25.921115 18238 raft_consensus.cc:667] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [term 2 LEADER]: Becoming Leader. State: Replica: 9191e9b5d78f4517b68d6a7efbf73301, State: Running, Role: LEADER I0301 23:04:25.921186 18238 consensus_queue.cc:206] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } I0301 23:04:25.921324 18229 leader_election.cc:292] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [CANDIDATE]: Term 2 election: Requested vote from peers 4457cd6310c641c4b393d2e151035eb4 (127.0.22.190:45973), af574d09abdf44d797ac2b771b578e91 (127.0.22.188:46753) I0301 23:04:25.921411 18238 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9191e9b5d78f4517b68d6a7efbf73301. Latest consensus state: current_term: 2 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:25.921624 18238 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: LEADER I0301 23:04:25.946871 16640 ts_manager.cc:98] Registered new tserver with Master: 8a0c9c16cf7c4007bfc5616bd13816be (127.0.22.139:45995) I0301 23:04:25.948043 16698 ts_manager.cc:98] Registered new tserver with Master: 8a0c9c16cf7c4007bfc5616bd13816be (127.0.22.139:45995) I0301 23:04:25.948127 18241 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:04:25.948298 18241 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:04:25.948518 18241 catalog_manager.cc:1066] Loading token signing keys... I0301 23:04:25.948575 18241 catalog_manager.cc:4106] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301: Loaded TSK: 0 I0301 23:04:25.959554 16767 ts_manager.cc:98] Registered new tserver with Master: 8a0c9c16cf7c4007bfc5616bd13816be (127.0.22.139:45995) I0301 23:04:25.970358 18225 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:25.970549 18225 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:25.970599 18225 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:25.973829 18225 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.140:33735 I0301 23:04:25.973879 18225 webserver.cc:175] Starting webserver on 127.0.22.140:46381 I0301 23:04:25.973886 18225 webserver.cc:186] Document root disabled I0301 23:04:25.974020 18225 webserver.cc:313] Webserver started. Bound to: http://127.0.22.140:46381/ I0301 23:04:25.974143 18225 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-11/data/info.pb I0301 23:04:25.974583 18225 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:25.978209 18355 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:25.978227 18355 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.978267 18355 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:25.978363 18354 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:25.978399 18354 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.978448 18354 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:25.978602 18356 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:25.978629 18356 heartbeater.cc:425] Registering TS with master... I0301 23:04:25.978657 18356 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:25.981706 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 18225 I0301 23:04:25.981930 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data --block_manager=log --rpc_bind_addresses=127.0.22.141:41515 --local_ip_for_outbound_sockets=127.0.22.141 --webserver_port=44059 --webserver_interface=127.0.22.141 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:26.004652 16698 ts_manager.cc:98] Registered new tserver with Master: 260a23a01ec64ac59599fca9754bb369 (127.0.22.140:33735) I0301 23:04:26.005511 16698 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.140:56563 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.013923 18364 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.014009 18364 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.015023 18364 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.015048 18364 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.141 I0301 23:04:26.015763 16767 ts_manager.cc:98] Registered new tserver with Master: 260a23a01ec64ac59599fca9754bb369 (127.0.22.140:33735) I0301 23:04:26.019177 18364 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.141:41515 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/info.pb --webserver_interface=127.0.22.141 --webserver_port=44059 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.18364 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.141 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.020015 18364 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:26.024199 18364 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.024291 18364 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.024327 18364 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.025002 18364 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:26.025152 18364 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.025218 18364 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.025759 18364 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.025918 18364 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal uuid: "7cb814db45714c4c861e0ca70033e26a" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.025950 18364 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.033054 16640 ts_manager.cc:98] Registered new tserver with Master: 260a23a01ec64ac59599fca9754bb369 (127.0.22.140:33735) I0301 23:04:26.040959 16698 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:37907 I0301 23:04:26.060220 18364 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.060453 18364 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:26.060519 18364 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:26.064193 18364 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.141:41515 I0301 23:04:26.064239 18364 webserver.cc:175] Starting webserver on 127.0.22.141:44059 I0301 23:04:26.064257 18364 webserver.cc:186] Document root disabled I0301 23:04:26.064407 18364 webserver.cc:313] Webserver started. Bound to: http://127.0.22.141:44059/ I0301 23:04:26.064539 18364 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-12/data/info.pb I0301 23:04:26.064965 18364 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:26.068576 18485 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:26.068594 18485 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.068631 18485 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:26.068789 18483 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:26.068816 18483 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.068823 18484 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:26.068831 18484 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.068850 18483 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:26.068856 18484 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:26.074378 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 18364 I0301 23:04:26.074548 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data --block_manager=log --rpc_bind_addresses=127.0.22.142:33235 --local_ip_for_outbound_sockets=127.0.22.142 --webserver_port=42459 --webserver_interface=127.0.22.142 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.113270 18493 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.113358 18493 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.114049 18493 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.114084 18493 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.142 I0301 23:04:26.115272 18493 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.142:33235 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/info.pb --webserver_interface=127.0.22.142 --webserver_port=42459 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.18493 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.142 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.128536 18493 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:26.128721 18493 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.128811 18493 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.128845 18493 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.136433 18493 fs_manager.cc:399] Time spent opening directory manager: real 0.007s user 0.001s sys 0.000s I0301 23:04:26.136588 18493 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.136664 18493 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.137316 18493 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.137506 18493 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal uuid: "125f195fa3694b589407de1f591f0d1e" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.137543 18493 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.157151 18493 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.157368 18493 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:26.157449 18493 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:26.158061 16640 ts_manager.cc:98] Registered new tserver with Master: 7cb814db45714c4c861e0ca70033e26a (127.0.22.141:41515) I0301 23:04:26.161111 18493 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.142:33235 I0301 23:04:26.161154 18493 webserver.cc:175] Starting webserver on 127.0.22.142:42459 I0301 23:04:26.161159 18493 webserver.cc:186] Document root disabled I0301 23:04:26.161276 18493 webserver.cc:313] Webserver started. Bound to: http://127.0.22.142:42459/ I0301 23:04:26.161427 18493 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-13/data/info.pb I0301 23:04:26.161710 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 18493 I0301 23:04:26.161739 18493 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:26.161885 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data --block_manager=log --rpc_bind_addresses=127.0.22.143:43607 --local_ip_for_outbound_sockets=127.0.22.143 --webserver_port=36561 --webserver_interface=127.0.22.143 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:26.166532 18613 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:26.166559 18612 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:26.166569 18612 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.166558 18613 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.166605 18612 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:26.166646 18614 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:26.166666 18614 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.166714 18614 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:26.166605 18613 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.175861 18619 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.175962 18619 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.177022 18619 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.177048 18619 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.143 I0301 23:04:26.178284 18619 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.143:43607 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/info.pb --webserver_interface=127.0.22.143 --webserver_port=36561 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.18619 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.143 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.179142 18619 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:26.179308 18619 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.179414 18619 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.179443 18619 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.180280 18619 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.180441 18619 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.180510 18619 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.181191 18619 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.181324 18619 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal uuid: "8c1416a176564de683d21f1dcd69d7aa" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.181354 18619 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.201285 16639 ts_manager.cc:98] Registered new tserver with Master: 125f195fa3694b589407de1f591f0d1e (127.0.22.142:33235) I0301 23:04:26.216574 18619 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.216786 18619 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:26.216841 18619 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:26.221330 18619 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.143:43607 I0301 23:04:26.221400 18619 webserver.cc:175] Starting webserver on 127.0.22.143:36561 I0301 23:04:26.221426 18619 webserver.cc:186] Document root disabled I0301 23:04:26.221557 18619 webserver.cc:313] Webserver started. Bound to: http://127.0.22.143:36561/ I0301 23:04:26.221681 18619 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-14/data/info.pb I0301 23:04:26.221962 18619 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:26.223937 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 18619 I0301 23:04:26.224099 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data --block_manager=log --rpc_bind_addresses=127.0.22.144:33027 --local_ip_for_outbound_sockets=127.0.22.144 --webserver_port=33355 --webserver_interface=127.0.22.144 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:26.225598 18739 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:26.225625 18739 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.225697 18739 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:26.226271 18740 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:26.226300 18740 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.226333 18740 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:26.230270 18741 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:26.230293 18741 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.230332 18741 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.243228 18746 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.243327 18746 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0301 23:04:26.243983 16698 ts_manager.cc:98] Registered new tserver with Master: 7cb814db45714c4c861e0ca70033e26a (127.0.22.141:41515) I0301 23:04:26.246356 16698 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.141:51797 W0301 23:04:26.247040 18746 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.247071 18746 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.144 I0301 23:04:26.252663 18746 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.144:33027 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/info.pb --webserver_interface=127.0.22.144 --webserver_port=33355 --tserver_master_addrs=127.0.22.190:45973,127.0.22.189:36569,127.0.22.188:46753 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.18746 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.144 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.254436 18746 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:26.254601 18746 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.254688 18746 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.254721 18746 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.264376 18746 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.000s sys 0.000s I0301 23:04:26.264530 18746 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.264600 18746 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.265305 18746 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.265489 18746 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal uuid: "d7c95de99bdc421f9ab5a1f05bd5492c" format_stamp: "Formatted at 2019-03-01 23:04:12 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.265523 18746 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.293428 18746 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.293655 18746 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:26.293717 18746 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:26.295537 16640 ts_manager.cc:98] Registered new tserver with Master: 8c1416a176564de683d21f1dcd69d7aa (127.0.22.143:43607) I0301 23:04:26.299126 16704 ts_manager.cc:98] Registered new tserver with Master: 8c1416a176564de683d21f1dcd69d7aa (127.0.22.143:43607) I0301 23:04:26.300024 18746 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.144:33027 I0301 23:04:26.300074 18746 webserver.cc:175] Starting webserver on 127.0.22.144:33355 I0301 23:04:26.300081 18746 webserver.cc:186] Document root disabled I0301 23:04:26.300318 18746 webserver.cc:313] Webserver started. Bound to: http://127.0.22.144:33355/ I0301 23:04:26.300462 18746 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_6.1551481418399944-90/minicluster-data/ts-15/data/info.pb I0301 23:04:26.300741 18746 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:26.301878 16704 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.143:35749 I0301 23:04:26.306612 18868 heartbeater.cc:345] Connected to a master server at 127.0.22.188:46753 I0301 23:04:26.306639 18868 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.306706 18868 heartbeater.cc:474] Master 127.0.22.188:46753 requested a full tablet report, sending... I0301 23:04:26.306774 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 18746 I0301 23:04:26.308748 18869 heartbeater.cc:345] Connected to a master server at 127.0.22.189:36569 I0301 23:04:26.308805 18869 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.308838 18869 heartbeater.cc:474] Master 127.0.22.189:36569 requested a full tablet report, sending... I0301 23:04:26.309983 18870 heartbeater.cc:345] Connected to a master server at 127.0.22.190:45973 I0301 23:04:26.310000 18870 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.310081 18870 heartbeater.cc:474] Master 127.0.22.190:45973 requested a full tablet report, sending... I0301 23:04:26.320475 16767 ts_manager.cc:98] Registered new tserver with Master: 7cb814db45714c4c861e0ca70033e26a (127.0.22.141:41515) I0301 23:04:26.354714 16696 ts_manager.cc:98] Registered new tserver with Master: 125f195fa3694b589407de1f591f0d1e (127.0.22.142:33235) I0301 23:04:26.355576 16696 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.142:50327 I0301 23:04:26.355670 16698 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.132:46627 I0301 23:04:26.359417 16650 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [term 2 FOLLOWER]: Refusing update from remote peer 9191e9b5d78f4517b68d6a7efbf73301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch) I0301 23:04:26.359724 18239 consensus_queue.cc:984] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s I0301 23:04:26.360306 18879 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9191e9b5d78f4517b68d6a7efbf73301. Latest consensus state: current_term: 2 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:26.360337 18879 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.360852 18239 sys_catalog.cc:337] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:26.360880 18239 sys_catalog.cc:340] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [sys.catalog]: This master's current role is: LEADER I0301 23:04:26.361310 16770 raft_consensus.cc:1181] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [term 2 FOLLOWER]: Refusing update from remote peer 9191e9b5d78f4517b68d6a7efbf73301: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch) I0301 23:04:26.361606 18229 consensus_queue.cc:984] T 00000000000000000000000000000000 P 9191e9b5d78f4517b68d6a7efbf73301 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s I0301 23:04:26.363068 18879 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:26.363230 18879 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4457cd6310c641c4b393d2e151035eb4 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.364326 18882 sys_catalog.cc:337] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9191e9b5d78f4517b68d6a7efbf73301. Latest consensus state: current_term: 2 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:26.364354 18882 sys_catalog.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.364413 18882 sys_catalog.cc:337] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9191e9b5d78f4517b68d6a7efbf73301" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4457cd6310c641c4b393d2e151035eb4" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 45973 } } peers { permanent_uuid: "9191e9b5d78f4517b68d6a7efbf73301" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 36569 } } peers { permanent_uuid: "af574d09abdf44d797ac2b771b578e91" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 46753 } } } I0301 23:04:26.364437 18882 sys_catalog.cc:340] T 00000000000000000000000000000000 P af574d09abdf44d797ac2b771b578e91 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.373013 16639 ts_manager.cc:98] Registered new tserver with Master: d7c95de99bdc421f9ab5a1f05bd5492c (127.0.22.144:33027) I0301 23:04:26.381160 16762 ts_manager.cc:98] Registered new tserver with Master: d7c95de99bdc421f9ab5a1f05bd5492c (127.0.22.144:33027) I0301 23:04:26.397167 16704 ts_manager.cc:98] Registered new tserver with Master: d7c95de99bdc421f9ab5a1f05bd5492c (127.0.22.144:33027) I0301 23:04:26.398218 16695 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:42115 I0301 23:04:26.400135 16704 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.144:33165 I0301 23:04:26.401491 16697 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:58059 I0301 23:04:26.405050 16697 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.133:51491 I0301 23:04:26.422756 16764 ts_manager.cc:98] Registered new tserver with Master: 8c1416a176564de683d21f1dcd69d7aa (127.0.22.143:43607) I0301 23:04:26.452586 16766 ts_manager.cc:98] Registered new tserver with Master: 125f195fa3694b589407de1f591f0d1e (127.0.22.142:33235) I0301 23:04:26.453094 90 external_mini_cluster.cc:623] 16 TS(s) registered with all masters I0301 23:04:26.453774 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 16803 W0301 23:04:26.456682 16621 connection.cc:647] server connection from 127.0.22.129:50287 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:50287): Connection reset by peer (error 104) W0301 23:04:26.456717 16749 connection.cc:647] server connection from 127.0.22.129:48609 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:48609): Connection reset by peer (error 104) W0301 23:04:26.456722 16686 connection.cc:647] server connection from 127.0.22.129:37907 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:37907): Connection reset by peer (error 104) I0301 23:04:26.456784 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 16935 W0301 23:04:26.458962 16621 connection.cc:647] server connection from 127.0.22.130:44449 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:44449): Connection reset by peer (error 104) W0301 23:04:26.458983 16686 connection.cc:647] server connection from 127.0.22.130:58059 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:58059): Connection reset by peer (error 104) W0301 23:04:26.459020 16751 connection.cc:647] server connection from 127.0.22.130:58797 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:58797): Connection reset by peer (error 104) I0301 23:04:26.459069 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 17067 W0301 23:04:26.462000 16624 connection.cc:647] server connection from 127.0.22.131:41105 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:41105): Connection reset by peer (error 104) W0301 23:04:26.462009 16686 connection.cc:647] server connection from 127.0.22.131:42115 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:42115): Connection reset by peer (error 104) W0301 23:04:26.462039 16752 connection.cc:647] server connection from 127.0.22.131:43165 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:43165): Connection reset by peer (error 104) I0301 23:04:26.462095 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 17193 W0301 23:04:26.464689 16622 connection.cc:647] server connection from 127.0.22.132:57591 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:57591): Connection reset by peer (error 104) W0301 23:04:26.464725 16688 connection.cc:647] server connection from 127.0.22.132:46627 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:46627): Connection reset by peer (error 104) W0301 23:04:26.464820 16750 connection.cc:647] server connection from 127.0.22.132:36041 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:36041): Connection reset by peer (error 104) I0301 23:04:26.464820 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 17325 W0301 23:04:26.467193 16622 connection.cc:647] server connection from 127.0.22.133:44207 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:44207): Connection reset by peer (error 104) W0301 23:04:26.467221 16686 connection.cc:647] server connection from 127.0.22.133:51491 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:51491): Connection reset by peer (error 104) W0301 23:04:26.467243 16750 connection.cc:647] server connection from 127.0.22.133:51127 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:51127): Connection reset by peer (error 104) I0301 23:04:26.467339 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 17454 W0301 23:04:26.469558 16688 connection.cc:647] server connection from 127.0.22.134:55339 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:55339): Connection reset by peer (error 104) W0301 23:04:26.469573 16623 connection.cc:647] server connection from 127.0.22.134:60413 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:60413): Connection reset by peer (error 104) W0301 23:04:26.469578 16749 connection.cc:647] server connection from 127.0.22.134:38489 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:38489): Connection reset by peer (error 104) I0301 23:04:26.469640 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 17583 W0301 23:04:26.471902 16688 connection.cc:647] server connection from 127.0.22.135:42461 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:42461): Connection reset by peer (error 104) W0301 23:04:26.471895 16622 connection.cc:647] server connection from 127.0.22.135:35913 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:35913): Connection reset by peer (error 104) W0301 23:04:26.471927 16749 connection.cc:647] server connection from 127.0.22.135:37561 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:37561): Connection reset by peer (error 104) I0301 23:04:26.472029 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 17709 W0301 23:04:26.474313 16623 connection.cc:647] server connection from 127.0.22.136:42401 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:42401): Connection reset by peer (error 104) W0301 23:04:26.474349 16687 connection.cc:647] server connection from 127.0.22.136:35795 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:35795): Connection reset by peer (error 104) W0301 23:04:26.474354 16750 connection.cc:647] server connection from 127.0.22.136:56221 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:56221): Connection reset by peer (error 104) I0301 23:04:26.474434 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 17841 W0301 23:04:26.476682 16621 connection.cc:647] server connection from 127.0.22.137:32897 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:32897): Connection reset by peer (error 104) W0301 23:04:26.476717 16685 connection.cc:647] server connection from 127.0.22.137:46959 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:46959): Connection reset by peer (error 104) W0301 23:04:26.476725 16752 connection.cc:647] server connection from 127.0.22.137:53951 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:53951): Connection reset by peer (error 104) I0301 23:04:26.476822 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 17970 W0301 23:04:26.479207 16621 connection.cc:647] server connection from 127.0.22.138:39077 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:39077): Connection reset by peer (error 104) W0301 23:04:26.479212 16686 connection.cc:647] server connection from 127.0.22.138:55401 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:55401): Connection reset by peer (error 104) W0301 23:04:26.479234 16751 connection.cc:647] server connection from 127.0.22.138:45419 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:45419): Connection reset by peer (error 104) I0301 23:04:26.479298 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 18096 W0301 23:04:26.481628 16621 connection.cc:647] server connection from 127.0.22.139:38155 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:38155): Connection reset by peer (error 104) W0301 23:04:26.481649 16685 connection.cc:647] server connection from 127.0.22.139:34559 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:34559): Connection reset by peer (error 104) W0301 23:04:26.481667 16749 connection.cc:647] server connection from 127.0.22.139:37569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:37569): Connection reset by peer (error 104) I0301 23:04:26.481729 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 18225 W0301 23:04:26.484648 16687 connection.cc:647] server connection from 127.0.22.140:56563 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:56563): Connection reset by peer (error 104) W0301 23:04:26.484663 16752 connection.cc:647] server connection from 127.0.22.140:60339 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:60339): Connection reset by peer (error 104) I0301 23:04:26.484724 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 18364 W0301 23:04:26.485751 16623 connection.cc:647] server connection from 127.0.22.140:52671 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:52671): Connection reset by peer (error 104) W0301 23:04:26.486943 16624 connection.cc:647] server connection from 127.0.22.141:36585 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:36585): Connection reset by peer (error 104) W0301 23:04:26.486954 16688 connection.cc:647] server connection from 127.0.22.141:51797 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:51797): Connection reset by peer (error 104) W0301 23:04:26.486975 16749 connection.cc:647] server connection from 127.0.22.141:45245 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:45245): Connection reset by peer (error 104) I0301 23:04:26.487028 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 18493 W0301 23:04:26.489226 16624 connection.cc:647] server connection from 127.0.22.142:53255 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:53255): Connection reset by peer (error 104) W0301 23:04:26.489256 16688 connection.cc:647] server connection from 127.0.22.142:50327 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:50327): Connection reset by peer (error 104) W0301 23:04:26.489282 16752 connection.cc:647] server connection from 127.0.22.142:42407 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:42407): Connection reset by peer (error 104) I0301 23:04:26.489377 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 18619 W0301 23:04:26.491626 16622 connection.cc:647] server connection from 127.0.22.143:36575 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:36575): Connection reset by peer (error 104) W0301 23:04:26.491631 16751 connection.cc:647] server connection from 127.0.22.143:45965 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:45965): Connection reset by peer (error 104) W0301 23:04:26.491657 16685 connection.cc:647] server connection from 127.0.22.143:35749 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:35749): Connection reset by peer (error 104) I0301 23:04:26.491711 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 18746 W0301 23:04:26.493916 16624 connection.cc:647] server connection from 127.0.22.144:35279 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:35279): Connection reset by peer (error 104) W0301 23:04:26.493937 16688 connection.cc:647] server connection from 127.0.22.144:33165 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:33165): Connection reset by peer (error 104) W0301 23:04:26.494014 16750 connection.cc:647] server connection from 127.0.22.144:36943 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:36943): Connection reset by peer (error 104) I0301 23:04:26.494065 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 16614 W0301 23:04:26.497431 14321 connection.cc:647] client connection to 127.0.22.190:45973 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:45973): Connection reset by peer (error 104) W0301 23:04:26.497436 16685 connection.cc:647] client connection to 127.0.22.190:45973 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:45973): Connection reset by peer (error 104) I0301 23:04:26.497555 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 16674 W0301 23:04:26.499871 14321 connection.cc:647] client connection to 127.0.22.189:36569 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:36569): Connection reset by peer (error 104) W0301 23:04:26.499913 16749 connection.cc:647] server connection from 127.0.0.1:54954 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:54954): Connection reset by peer (error 104) I0301 23:04:26.500021 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 16738 W0301 23:04:26.502292 14321 connection.cc:647] client connection to 127.0.22.188:46753 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.188:46753): Connection reset by peer (error 104) [ OK ] TsLocationAssignmentITest.Basic/6 (15592 ms) [ RUN ] TsLocationAssignmentITest.Basic/7 I0301 23:04:26.510968 90 test_util.cc:212] Using random seed: 1840242295 I0301 23:04:26.511400 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:40937 --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.522053 18890 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.522135 18890 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.522922 18890 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:26.522943 18890 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.522946 18890 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:26.522950 18890 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:26.523957 18890 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:40937 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.18890 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.524761 18890 master_main.cc:80] Initializing master server... I0301 23:04:26.524899 18890 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.525005 18890 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.525032 18890 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.525068 18890 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:26.525085 18890 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:26.525626 18890 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/instance: uuid: "4821875d4f024436a7bad3af9f50cfa0" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.525782 18890 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal/instance: uuid: "4821875d4f024436a7bad3af9f50cfa0" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.526741 18890 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:26.526964 18890 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.527031 18890 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.527550 18890 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.527576 18890 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal uuid: "4821875d4f024436a7bad3af9f50cfa0" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.527595 18890 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.551342 18890 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.551510 18890 master_main.cc:83] Starting Master server... I0301 23:04:26.553584 18890 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:40937 I0301 23:04:26.553633 18890 webserver.cc:175] Starting webserver on 127.0.22.190:0 I0301 23:04:26.553640 18890 webserver.cc:186] Document root disabled I0301 23:04:26.553969 18890 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:41845/ I0301 23:04:26.554077 18890 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:04:26.554286 18949 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:26.555660 18949 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:26.558763 18949 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:26.559006 18949 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.189:40771: Network error: Client connection negotiation failed: client connection to 127.0.22.189:40771: connect: Connection refused (error 111) I0301 23:04:26.563444 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 18890 I0301 23:04:26.563648 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:40771 --webserver_interface=127.0.22.189 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.574504 18952 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.574585 18952 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.575371 18952 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:26.575404 18952 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.575412 18952 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:26.575414 18952 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:26.576436 18952 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:40771 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/info.pb --webserver_interface=127.0.22.189 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.18952 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.577198 18952 master_main.cc:80] Initializing master server... I0301 23:04:26.577333 18952 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.577448 18952 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.577473 18952 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.577510 18952 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:26.577538 18952 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:26.578083 18952 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/instance: uuid: "78ca695677d34addb25f9e1b667f9608" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.578157 18949 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } attempt: 1 I0301 23:04:26.578254 18952 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal/instance: uuid: "78ca695677d34addb25f9e1b667f9608" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" W0301 23:04:26.578455 18949 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.189:40771: Network error: Client connection negotiation failed: client connection to 127.0.22.189:40771: connect: Connection refused (error 111) I0301 23:04:26.579267 18952 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:04:26.579495 18952 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.579566 18952 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.580078 18952 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.580106 18952 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal uuid: "78ca695677d34addb25f9e1b667f9608" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.580124 18952 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.605221 18952 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.605367 18952 master_main.cc:83] Starting Master server... I0301 23:04:26.607851 18952 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.189:40771 I0301 23:04:26.607908 18952 webserver.cc:175] Starting webserver on 127.0.22.189:0 I0301 23:04:26.607915 18952 webserver.cc:186] Document root disabled I0301 23:04:26.608042 18952 webserver.cc:313] Webserver started. Bound to: http://127.0.22.189:46045/ I0301 23:04:26.608144 18952 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/info.pb I0301 23:04:26.608376 19011 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:26.609652 19011 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:26.612118 19011 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:26.614312 19011 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:26.614562 19011 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:41299: Network error: Client connection negotiation failed: client connection to 127.0.22.188:41299: connect: Connection refused (error 111) I0301 23:04:26.615620 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 18952 I0301 23:04:26.615799 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:41299 --webserver_interface=127.0.22.188 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.626134 19014 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.626217 19014 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0301 23:04:26.626580 18949 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } attempt: 2 W0301 23:04:26.627104 19014 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:26.627130 19014 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.627138 19014 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:26.627144 19014 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:26.628526 19014 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:41299 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/info.pb --webserver_interface=127.0.22.188 --webserver_port=0 --never_fsync=true --heap_profile_path=/tmp/kudu-master.19014 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.628996 18949 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } has no permanent_uuid. Determining permanent_uuid... W0301 23:04:26.629191 18949 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:41299: Network error: Client connection negotiation failed: client connection to 127.0.22.188:41299: connect: Connection refused (error 111) I0301 23:04:26.629534 19014 master_main.cc:80] Initializing master server... I0301 23:04:26.629657 19014 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.629732 19014 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.629755 19014 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.629781 19014 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:26.629784 19014 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:26.630340 19014 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/instance: uuid: "0c06f2d078ab4153a85d26a82e136b78" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.630496 19014 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal/instance: uuid: "0c06f2d078ab4153a85d26a82e136b78" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.631443 19014 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:26.631611 19014 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.631666 19014 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.632134 19014 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.632160 19014 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal uuid: "0c06f2d078ab4153a85d26a82e136b78" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.632230 19014 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.633682 19011 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } attempt: 1 W0301 23:04:26.633944 19011 consensus_peers.cc:599] Error getting permanent uuid from config peer 127.0.22.188:41299: Network error: Client connection negotiation failed: client connection to 127.0.22.188:41299: connect: Connection refused (error 111) I0301 23:04:26.654325 19014 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.654475 19014 master_main.cc:83] Starting Master server... I0301 23:04:26.656600 19014 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.188:41299 I0301 23:04:26.656651 19014 webserver.cc:175] Starting webserver on 127.0.22.188:0 I0301 23:04:26.656667 19014 webserver.cc:186] Document root disabled I0301 23:04:26.656769 19014 webserver.cc:313] Webserver started. Bound to: http://127.0.22.188:46663/ I0301 23:04:26.656868 19014 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/info.pb I0301 23:04:26.657153 19073 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0301 23:04:26.657532 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 19014 I0301 23:04:26.657783 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:0 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:26.658846 19073 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:26.661625 19073 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:26.663681 19073 sys_catalog.cc:304] member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } has no permanent_uuid. Determining permanent_uuid... I0301 23:04:26.666819 19073 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: Bootstrap starting. I0301 23:04:26.667116 19073 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: No blocks or log segments found. Creating new log. I0301 23:04:26.667285 19073 log.cc:525] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: Log is configured to *not* fsync() on all Append() calls I0301 23:04:26.667577 19073 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: No bootstrap required, opened a new log I0301 23:04:26.668494 19073 raft_consensus.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.668522 19073 raft_consensus.cc:366] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:26.668531 19073 raft_consensus.cc:705] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c06f2d078ab4153a85d26a82e136b78, State: Initialized, Role: FOLLOWER I0301 23:04:26.668589 19073 consensus_queue.cc:229] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.668681 19073 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.668701 19073 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.668746 19073 sys_catalog.cc:424] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:26.668996 19014 master_main.cc:86] Master server successfully started. W0301 23:04:26.669037 19079 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:26.669064 19079 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:26.669593 19078 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.669623 19078 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: FOLLOWER WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.670624 19074 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.670724 19074 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.671746 19074 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.671787 19074 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:04:26.673058 19074 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.19074 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.674243 19074 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:26.674700 19074 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.674795 19074 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.674830 19074 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.674875 19074 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:26.674896 19074 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:26.675626 19074 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/instance: uuid: "9372ea079b17477c88e757060a70ac25" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.675817 19074 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal/instance: uuid: "9372ea079b17477c88e757060a70ac25" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.677331 19074 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s I0301 23:04:26.677573 19074 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.677651 19074 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.678164 19074 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.678196 19074 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal uuid: "9372ea079b17477c88e757060a70ac25" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.678221 19074 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.679834 19078 raft_consensus.cc:472] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0301 23:04:26.679917 19078 raft_consensus.cc:494] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.679994 19078 leader_election.cc:292] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4821875d4f024436a7bad3af9f50cfa0 (127.0.22.190:40937), 78ca695677d34addb25f9e1b667f9608 (127.0.22.189:40771) I0301 23:04:26.682054 19011 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } attempt: 2 I0301 23:04:26.685082 19011 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: Bootstrap starting. I0301 23:04:26.685358 19011 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: No blocks or log segments found. Creating new log. I0301 23:04:26.685534 19011 log.cc:525] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: Log is configured to *not* fsync() on all Append() calls I0301 23:04:26.685978 19011 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: No bootstrap required, opened a new log I0301 23:04:26.687168 19011 raft_consensus.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.687196 19011 raft_consensus.cc:366] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:26.687202 19011 raft_consensus.cc:705] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78ca695677d34addb25f9e1b667f9608, State: Initialized, Role: FOLLOWER I0301 23:04:26.687250 19011 consensus_queue.cc:229] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.687346 19011 sys_catalog.cc:337] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.687368 19011 sys_catalog.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.687419 19011 sys_catalog.cc:424] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:26.687561 18952 master_main.cc:86] Master server successfully started. I0301 23:04:26.687726 18988 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c06f2d078ab4153a85d26a82e136b78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78ca695677d34addb25f9e1b667f9608" is_pre_election: true I0301 23:04:26.687749 18988 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0c06f2d078ab4153a85d26a82e136b78 in term 0. I0301 23:04:26.687937 19023 leader_election.cc:306] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c06f2d078ab4153a85d26a82e136b78, 78ca695677d34addb25f9e1b667f9608; no voters: I0301 23:04:26.688006 19078 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0301 23:04:26.688006 19092 sys_catalog.cc:337] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.688028 19078 raft_consensus.cc:472] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0301 23:04:26.688036 19078 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:26.688066 19092 sys_catalog.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: This master's current role is: FOLLOWER W0301 23:04:26.688210 19093 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:26.688256 19093 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:26.688614 19078 raft_consensus.cc:494] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.688675 19078 leader_election.cc:292] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [CANDIDATE]: Term 1 election: Requested vote from peers 4821875d4f024436a7bad3af9f50cfa0 (127.0.22.190:40937), 78ca695677d34addb25f9e1b667f9608 (127.0.22.189:40771) I0301 23:04:26.689105 18988 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c06f2d078ab4153a85d26a82e136b78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78ca695677d34addb25f9e1b667f9608" I0301 23:04:26.689129 18988 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:26.689627 18988 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c06f2d078ab4153a85d26a82e136b78 in term 1. I0301 23:04:26.689877 19023 leader_election.cc:306] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c06f2d078ab4153a85d26a82e136b78, 78ca695677d34addb25f9e1b667f9608; no voters: I0301 23:04:26.689939 19078 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 1 FOLLOWER]: Leader election won for term 1 I0301 23:04:26.690007 19078 raft_consensus.cc:667] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 1 LEADER]: Becoming Leader. State: Replica: 0c06f2d078ab4153a85d26a82e136b78, State: Running, Role: LEADER I0301 23:04:26.690057 19078 consensus_queue.cc:206] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.690204 19078 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c06f2d078ab4153a85d26a82e136b78. Latest consensus state: current_term: 1 leader_uuid: "0c06f2d078ab4153a85d26a82e136b78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.690227 19078 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: LEADER I0301 23:04:26.690522 19097 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:04:26.691154 19097 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:04:26.692297 18949 consensus_peers.cc:609] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } attempt: 1 I0301 23:04:26.695184 18949 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: Bootstrap starting. I0301 23:04:26.695466 18949 tablet_bootstrap.cc:593] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: No blocks or log segments found. Creating new log. I0301 23:04:26.695622 18949 log.cc:525] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: Log is configured to *not* fsync() on all Append() calls I0301 23:04:26.696429 18949 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: No bootstrap required, opened a new log I0301 23:04:26.697634 18949 raft_consensus.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.697662 18949 raft_consensus.cc:366] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0301 23:04:26.697669 18949 raft_consensus.cc:705] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4821875d4f024436a7bad3af9f50cfa0, State: Initialized, Role: FOLLOWER I0301 23:04:26.697715 18949 consensus_queue.cc:229] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:26.697808 18949 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.697829 18949 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.697859 18949 sys_catalog.cc:424] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:26.697942 18926 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c06f2d078ab4153a85d26a82e136b78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4821875d4f024436a7bad3af9f50cfa0" is_pre_election: true I0301 23:04:26.697995 18925 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0c06f2d078ab4153a85d26a82e136b78" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4821875d4f024436a7bad3af9f50cfa0" I0301 23:04:26.698108 18925 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 0 FOLLOWER]: Advancing to term 1 I0301 23:04:26.698607 18925 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0c06f2d078ab4153a85d26a82e136b78 in term 1. I0301 23:04:26.698086 18890 master_main.cc:86] Master server successfully started. I0301 23:04:26.698815 18926 raft_consensus.cc:2321] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0c06f2d078ab4153a85d26a82e136b78 for term 1 because replica is already servicing an update from a current leader or another vote. I0301 23:04:26.700258 19099 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.700286 19099 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: FOLLOWER W0301 23:04:26.700462 19100 catalog_manager.cc:1104] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0301 23:04:26.700485 19100 catalog_manager.cc:587] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0301 23:04:26.710841 19074 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.711046 19074 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:26.711107 19074 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:26.714781 19074 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:39109 I0301 23:04:26.714839 19074 webserver.cc:175] Starting webserver on 127.0.22.129:0 I0301 23:04:26.714850 19074 webserver.cc:186] Document root disabled I0301 23:04:26.714977 19074 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:38775/ I0301 23:04:26.715083 19074 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:04:26.716797 19074 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:26.720108 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 19074 I0301 23:04:26.720299 19210 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:26.720346 19210 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.720376 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:0 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:26.720502 19210 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:26.726336 19211 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:26.726362 19211 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.726414 19211 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:26.726470 19213 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:26.726585 19213 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.726621 19213 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:26.739291 18926 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Refusing update from remote peer 0c06f2d078ab4153a85d26a82e136b78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0301 23:04:26.739507 18988 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 1 FOLLOWER]: Refusing update from remote peer 0c06f2d078ab4153a85d26a82e136b78: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0301 23:04:26.739569 19095 consensus_queue.cc:984] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0301 23:04:26.739956 19095 consensus_queue.cc:984] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0301 23:04:26.740512 19099 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c06f2d078ab4153a85d26a82e136b78. Latest consensus state: current_term: 1 leader_uuid: "0c06f2d078ab4153a85d26a82e136b78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.740538 19099 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.742206 19092 sys_catalog.cc:337] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0c06f2d078ab4153a85d26a82e136b78. Latest consensus state: current_term: 1 leader_uuid: "0c06f2d078ab4153a85d26a82e136b78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.742225 19092 sys_catalog.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.745038 19078 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c06f2d078ab4153a85d26a82e136b78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.745061 19078 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: LEADER I0301 23:04:26.745220 19221 mvcc.cc:203] Tried to move safe_time back from 6354868087761432576 to 6354868087562706944. Current Snapshot: MvccSnapshot[committed={T|T < 6354868087761432576}] I0301 23:04:26.745443 19092 sys_catalog.cc:337] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c06f2d078ab4153a85d26a82e136b78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.745457 19092 sys_catalog.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.745637 19224 mvcc.cc:203] Tried to move safe_time back from 6354868087761432576 to 6354868087562706944. Current Snapshot: MvccSnapshot[committed={T|T < 6354868087761432576}] I0301 23:04:26.760932 19078 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0c06f2d078ab4153a85d26a82e136b78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.760949 19078 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: LEADER I0301 23:04:26.761226 19099 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0c06f2d078ab4153a85d26a82e136b78" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:26.761243 19099 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:26.761315 19222 mvcc.cc:203] Tried to move safe_time back from 6354868087761432576 to 6354868087562706944. Current Snapshot: MvccSnapshot[committed={T|T < 6354868087761432576}] I0301 23:04:26.764292 19097 catalog_manager.cc:941] Generated new certificate authority record I0301 23:04:26.765245 19097 catalog_manager.cc:1066] Loading token signing keys... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.793027 19217 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.793145 19217 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.794215 19217 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.794261 19217 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:04:26.795539 19217 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.19217 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.810864 19097 catalog_manager.cc:4095] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: Generated new TSK 0 I0301 23:04:26.812816 19217 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:26.813040 19217 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.813148 19217 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.813184 19217 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.813236 19217 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:26.813258 19217 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:26.814059 19217 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/instance: uuid: "1e01396338ed4503bfc9089554272f8a" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.814261 19217 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal/instance: uuid: "1e01396338ed4503bfc9089554272f8a" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.820413 19217 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.002s sys 0.001s I0301 23:04:26.820634 19217 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.820716 19217 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.821245 19217 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.821277 19217 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal uuid: "1e01396338ed4503bfc9089554272f8a" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.821308 19217 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.844481 19217 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.844681 19217 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:26.844741 19217 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:26.848706 19217 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:45379 I0301 23:04:26.848754 19217 webserver.cc:175] Starting webserver on 127.0.22.130:0 I0301 23:04:26.848764 19217 webserver.cc:186] Document root disabled I0301 23:04:26.848875 19217 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:38259/ I0301 23:04:26.848985 19217 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:04:26.849292 19217 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:26.853567 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 19217 I0301 23:04:26.853821 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:0 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:26.856082 19347 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:26.856108 19347 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.856146 19347 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:26.858642 19348 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:26.858669 19348 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.858703 19348 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:26.859238 19349 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:26.859261 19349 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.859292 19349 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.870959 19354 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.871062 19354 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.872069 19354 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.872110 19354 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:04:26.873404 19354 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.19354 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.874560 19354 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:26.874752 19354 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.874837 19354 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.874871 19354 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.874933 19354 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:26.874954 19354 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:26.875684 19354 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/instance: uuid: "6f458d9b7bc04774935e3e8a7e68343e" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.875885 19354 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal/instance: uuid: "6f458d9b7bc04774935e3e8a7e68343e" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.877318 19354 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.003s I0301 23:04:26.877607 19354 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.877683 19354 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.878355 19354 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.878437 19354 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal uuid: "6f458d9b7bc04774935e3e8a7e68343e" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.878497 19354 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:26.891573 18916 ts_manager.cc:98] Registered new tserver with Master: 9372ea079b17477c88e757060a70ac25 (127.0.22.129:39109) I0301 23:04:26.895138 19040 ts_manager.cc:98] Registered new tserver with Master: 9372ea079b17477c88e757060a70ac25 (127.0.22.129:39109) I0301 23:04:26.903722 18978 ts_manager.cc:98] Registered new tserver with Master: 9372ea079b17477c88e757060a70ac25 (127.0.22.129:39109) I0301 23:04:26.904884 19354 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:26.905076 19354 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:26.905115 19354 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:26.907783 19354 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:35325 I0301 23:04:26.907831 19354 webserver.cc:175] Starting webserver on 127.0.22.131:0 I0301 23:04:26.907840 19354 webserver.cc:186] Document root disabled I0301 23:04:26.907953 19354 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:43655/ I0301 23:04:26.908061 19354 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:04:26.909029 19354 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:26.917942 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 19354 I0301 23:04:26.918191 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:0 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:26.919780 19477 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:26.919798 19477 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.919833 19477 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:26.920912 19476 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:26.920938 19476 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.920969 19476 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:26.938712 19478 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:26.938738 19478 heartbeater.cc:425] Registering TS with master... I0301 23:04:26.938777 19478 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:26.967761 19482 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:26.967875 19482 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:26.980933 19482 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:26.980979 19482 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:04:26.983327 19482 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.19482 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:26.988667 19482 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:26.988863 19482 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49016us I0301 23:04:26.988947 19482 fs_manager.cc:263] Metadata directory not provided I0301 23:04:26.988977 19482 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:26.989023 19482 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:26.989040 19482 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:26.989775 19482 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/instance: uuid: "9be02b18019d4208a726de5b4ff80007" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.989954 19482 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal/instance: uuid: "9be02b18019d4208a726de5b4ff80007" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.996368 19482 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.001s sys 0.001s I0301 23:04:26.996659 19482 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:26.996742 19482 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:26.997447 19482 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:26.997474 19482 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal uuid: "9be02b18019d4208a726de5b4ff80007" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:26.997501 19482 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.024345 18915 ts_manager.cc:98] Registered new tserver with Master: 1e01396338ed4503bfc9089554272f8a (127.0.22.130:45379) I0301 23:04:27.024370 19039 ts_manager.cc:98] Registered new tserver with Master: 1e01396338ed4503bfc9089554272f8a (127.0.22.130:45379) I0301 23:04:27.025622 19039 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:38709 I0301 23:04:27.026365 18977 ts_manager.cc:98] Registered new tserver with Master: 1e01396338ed4503bfc9089554272f8a (127.0.22.130:45379) I0301 23:04:27.110126 18978 ts_manager.cc:98] Registered new tserver with Master: 6f458d9b7bc04774935e3e8a7e68343e (127.0.22.131:35325) I0301 23:04:27.114943 19040 ts_manager.cc:98] Registered new tserver with Master: 6f458d9b7bc04774935e3e8a7e68343e (127.0.22.131:35325) I0301 23:04:27.115576 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:52099 I0301 23:04:27.115928 18916 ts_manager.cc:98] Registered new tserver with Master: 6f458d9b7bc04774935e3e8a7e68343e (127.0.22.131:35325) I0301 23:04:27.161438 19482 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.161670 19482 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.161731 19482 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.165680 19482 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:35241 I0301 23:04:27.165724 19482 webserver.cc:175] Starting webserver on 127.0.22.132:0 I0301 23:04:27.165730 19482 webserver.cc:186] Document root disabled I0301 23:04:27.165864 19482 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:43723/ I0301 23:04:27.165993 19482 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:04:27.166477 19482 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.170167 19605 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.170194 19605 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.170241 19605 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:27.170282 19606 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.170305 19606 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.170332 19606 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.170369 19604 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.170400 19604 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.170454 19604 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:27.173316 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 19482 I0301 23:04:27.173589 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:0 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.192406 19614 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.192492 19614 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:27.193168 19614 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.193203 19614 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:04:27.194054 19614 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.19614 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.194869 19614 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.195041 19614 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.195128 19614 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.195155 19614 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.195199 19614 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.195222 19614 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.195780 19614 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/instance: uuid: "5606457608894cb4b4fb65a81f586fa3" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.195940 19614 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal/instance: uuid: "5606457608894cb4b4fb65a81f586fa3" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.204370 19614 fs_manager.cc:503] Time spent creating directory manager: real 0.008s user 0.002s sys 0.000s I0301 23:04:27.204664 19614 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.204744 19614 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.205485 19614 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.205521 19614 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal uuid: "5606457608894cb4b4fb65a81f586fa3" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.205579 19614 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.213765 18978 ts_manager.cc:98] Registered new tserver with Master: 9be02b18019d4208a726de5b4ff80007 (127.0.22.132:35241) I0301 23:04:27.216807 18916 ts_manager.cc:98] Registered new tserver with Master: 9be02b18019d4208a726de5b4ff80007 (127.0.22.132:35241) I0301 23:04:27.220062 19040 ts_manager.cc:98] Registered new tserver with Master: 9be02b18019d4208a726de5b4ff80007 (127.0.22.132:35241) I0301 23:04:27.220741 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.132:37445 I0301 23:04:27.243780 19614 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.243983 19614 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.244045 19614 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.247530 19614 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:44473 I0301 23:04:27.247582 19614 webserver.cc:175] Starting webserver on 127.0.22.133:0 I0301 23:04:27.247601 19614 webserver.cc:186] Document root disabled I0301 23:04:27.247732 19614 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:40823/ I0301 23:04:27.247858 19614 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:04:27.248317 19614 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.251343 19735 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.251370 19735 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.251422 19734 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.251432 19735 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.251456 19734 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.251525 19734 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:27.251648 19733 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.251664 19733 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.251693 19733 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:27.258002 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 19614 I0301 23:04:27.258209 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:0 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.289901 19743 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.289983 19743 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:27.290745 19743 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.290776 19743 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:04:27.291695 19743 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.19743 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.304620 19743 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.304788 19743 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.304872 19743 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.304910 19743 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.304958 19743 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.304975 19743 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.305546 19743 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/instance: uuid: "ac6f7439d58b46d7a566ff1a9b44101a" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.305716 19743 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal/instance: uuid: "ac6f7439d58b46d7a566ff1a9b44101a" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.306722 19743 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:27.306928 19743 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.307005 19743 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.307549 19743 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.307592 19743 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal uuid: "ac6f7439d58b46d7a566ff1a9b44101a" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.307639 19743 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.325022 19743 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.325239 19743 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.325301 19743 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.329699 19743 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:38783 I0301 23:04:27.329756 19743 webserver.cc:175] Starting webserver on 127.0.22.134:0 I0301 23:04:27.329778 19743 webserver.cc:186] Document root disabled I0301 23:04:27.329932 19743 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:41657/ I0301 23:04:27.330039 19743 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:04:27.330415 19743 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.334798 19862 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.334851 19862 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.334933 19862 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:27.335085 19863 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.335129 19863 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.335186 19863 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:27.335263 19864 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.335302 19864 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.335345 19864 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.335638 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 19743 I0301 23:04:27.335887 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:0 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:27.338908 18916 ts_manager.cc:98] Registered new tserver with Master: 5606457608894cb4b4fb65a81f586fa3 (127.0.22.133:44473) I0301 23:04:27.345571 18978 ts_manager.cc:98] Registered new tserver with Master: 5606457608894cb4b4fb65a81f586fa3 (127.0.22.133:44473) I0301 23:04:27.352463 19040 ts_manager.cc:98] Registered new tserver with Master: 5606457608894cb4b4fb65a81f586fa3 (127.0.22.133:44473) I0301 23:04:27.354255 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.133:48783 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.365815 19870 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.365921 19870 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:27.366634 19870 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.366669 19870 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:04:27.367532 19870 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.19870 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.368417 19870 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.368582 19870 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.368667 19870 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.368695 19870 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.368741 19870 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.368763 19870 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.369304 19870 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/instance: uuid: "f9006ac6f5b94d13991a9c3db920c8e0" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.369484 19870 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal/instance: uuid: "f9006ac6f5b94d13991a9c3db920c8e0" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.370436 19870 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:27.370633 19870 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.370697 19870 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.371232 19870 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.371258 19870 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal uuid: "f9006ac6f5b94d13991a9c3db920c8e0" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.371275 19870 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.382767 19870 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.383033 19870 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.383088 19870 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.386242 19870 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:33501 I0301 23:04:27.386308 19870 webserver.cc:175] Starting webserver on 127.0.22.135:0 I0301 23:04:27.386324 19870 webserver.cc:186] Document root disabled I0301 23:04:27.386502 19870 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:46057/ I0301 23:04:27.386628 19870 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:04:27.387498 19870 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.390206 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 19870 I0301 23:04:27.390481 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:0 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:27.390980 19994 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.390995 19994 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.391028 19994 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:27.391579 19995 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.391603 19995 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.391666 19995 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.391816 19993 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.391844 19993 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.391880 19993 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.442184 20000 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.442278 20000 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:27.443276 20000 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.443310 20000 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:04:27.444612 20000 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.20000 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.445802 20000 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.445997 20000 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.446085 20000 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.446112 20000 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.446169 20000 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.446185 20000 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.446885 20000 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/instance: uuid: "3ccb825be2af42b39758c9b7117513b1" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.447067 20000 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal/instance: uuid: "3ccb825be2af42b39758c9b7117513b1" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.448484 20000 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s I0301 23:04:27.448773 20000 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.448851 20000 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.449578 20000 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.449610 20000 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal uuid: "3ccb825be2af42b39758c9b7117513b1" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.449637 20000 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.451354 18915 ts_manager.cc:98] Registered new tserver with Master: ac6f7439d58b46d7a566ff1a9b44101a (127.0.22.134:38783) I0301 23:04:27.477957 18916 ts_manager.cc:98] Registered new tserver with Master: f9006ac6f5b94d13991a9c3db920c8e0 (127.0.22.135:33501) I0301 23:04:27.505795 20000 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.506069 20000 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.506126 20000 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.511106 20000 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:37999 I0301 23:04:27.511162 20000 webserver.cc:175] Starting webserver on 127.0.22.136:0 I0301 23:04:27.511178 20000 webserver.cc:186] Document root disabled I0301 23:04:27.511309 20000 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:40931/ I0301 23:04:27.511461 20000 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:04:27.511899 20000 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.513958 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 20000 I0301 23:04:27.514205 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data --block_manager=log --rpc_bind_addresses=127.0.22.137:0 --local_ip_for_outbound_sockets=127.0.22.137 --webserver_interface=127.0.22.137 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:27.515636 20122 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.515663 20122 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.515667 20121 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.515681 20121 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.515702 20122 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.515714 20121 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:27.516376 20120 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.516423 20120 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.516455 20120 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:27.527726 19039 ts_manager.cc:98] Registered new tserver with Master: ac6f7439d58b46d7a566ff1a9b44101a (127.0.22.134:38783) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.528403 20127 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.528486 20127 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0301 23:04:27.528568 19039 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.134:51153 W0301 23:04:27.529212 20127 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.529239 20127 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.137 I0301 23:04:27.529304 18977 ts_manager.cc:98] Registered new tserver with Master: ac6f7439d58b46d7a566ff1a9b44101a (127.0.22.134:38783) I0301 23:04:27.530270 20127 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.137:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/info.pb --webserver_interface=127.0.22.137 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.20127 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.137 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.531152 20127 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.531307 20127 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.531399 20127 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.531428 20127 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.531502 20127 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.531525 20127 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.532063 20127 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/instance: uuid: "d82637cdddb54ef38463de251eec3be2" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.540340 20127 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal/instance: uuid: "d82637cdddb54ef38463de251eec3be2" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.541311 20127 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:27.541610 20127 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.541684 20127 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.542359 20127 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.542418 20127 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal uuid: "d82637cdddb54ef38463de251eec3be2" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.542450 20127 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.554693 18916 ts_manager.cc:98] Registered new tserver with Master: 3ccb825be2af42b39758c9b7117513b1 (127.0.22.136:37999) I0301 23:04:27.565930 20127 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.566174 20127 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.566249 20127 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.570341 20127 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.137:42289 I0301 23:04:27.570417 20127 webserver.cc:175] Starting webserver on 127.0.22.137:0 I0301 23:04:27.570436 20127 webserver.cc:186] Document root disabled I0301 23:04:27.570562 20127 webserver.cc:313] Webserver started. Bound to: http://127.0.22.137:40891/ I0301 23:04:27.570684 20127 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/info.pb I0301 23:04:27.570991 20127 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.575539 20250 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.575564 20250 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.575584 20251 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.575598 20251 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.575604 20250 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:27.575654 20251 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.576735 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 20127 I0301 23:04:27.576987 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data --block_manager=log --rpc_bind_addresses=127.0.22.138:0 --local_ip_for_outbound_sockets=127.0.22.138 --webserver_interface=127.0.22.138 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:27.577814 20249 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.577877 20249 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.577977 20249 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:27.612210 18976 ts_manager.cc:98] Registered new tserver with Master: 3ccb825be2af42b39758c9b7117513b1 (127.0.22.136:37999) I0301 23:04:27.613624 19038 ts_manager.cc:98] Registered new tserver with Master: 3ccb825be2af42b39758c9b7117513b1 (127.0.22.136:37999) I0301 23:04:27.615851 19038 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.136:33351 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.625600 20257 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.625702 20257 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:27.626709 20257 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.626749 20257 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.138 I0301 23:04:27.627987 20257 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.138:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/info.pb --webserver_interface=127.0.22.138 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.20257 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.138 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.633322 20257 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.633525 20257 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.633621 20257 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.633653 20257 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.633699 20257 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.633718 20257 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.634457 20257 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/instance: uuid: "8ee77f2f83d545ef96153a77aac9e5a3" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.634639 20257 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal/instance: uuid: "8ee77f2f83d545ef96153a77aac9e5a3" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.641232 20257 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.001s sys 0.002s I0301 23:04:27.642323 20257 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.642551 20257 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.644752 20257 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.644891 20257 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal uuid: "8ee77f2f83d545ef96153a77aac9e5a3" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.645032 20257 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.651491 19039 ts_manager.cc:98] Registered new tserver with Master: d82637cdddb54ef38463de251eec3be2 (127.0.22.137:42289) I0301 23:04:27.653781 19039 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.137:45509 I0301 23:04:27.686028 18977 ts_manager.cc:98] Registered new tserver with Master: d82637cdddb54ef38463de251eec3be2 (127.0.22.137:42289) I0301 23:04:27.690213 19093 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: acquiring CA information for follower catalog manager: success I0301 23:04:27.690403 19093 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0301 23:04:27.702184 19100 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: acquiring CA information for follower catalog manager: success I0301 23:04:27.702327 19100 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0301 23:04:27.733677 19040 ts_manager.cc:98] Registered new tserver with Master: f9006ac6f5b94d13991a9c3db920c8e0 (127.0.22.135:33501) I0301 23:04:27.734437 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.135:53185 I0301 23:04:27.736572 18916 ts_manager.cc:98] Registered new tserver with Master: d82637cdddb54ef38463de251eec3be2 (127.0.22.137:42289) I0301 23:04:27.741699 20257 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.741914 20257 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.741974 20257 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.745242 20257 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.138:45883 I0301 23:04:27.745292 20257 webserver.cc:175] Starting webserver on 127.0.22.138:0 I0301 23:04:27.745298 20257 webserver.cc:186] Document root disabled I0301 23:04:27.745434 20257 webserver.cc:313] Webserver started. Bound to: http://127.0.22.138:43041/ I0301 23:04:27.745549 20257 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/info.pb I0301 23:04:27.745910 20257 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.746073 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 20257 I0301 23:04:27.746337 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data --block_manager=log --rpc_bind_addresses=127.0.22.139:0 --local_ip_for_outbound_sockets=127.0.22.139 --webserver_interface=127.0.22.139 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:27.746598 18978 ts_manager.cc:98] Registered new tserver with Master: f9006ac6f5b94d13991a9c3db920c8e0 (127.0.22.135:33501) I0301 23:04:27.750452 20380 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.750469 20380 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.750504 20380 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:27.750841 20382 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.750856 20382 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.750864 20381 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.750877 20381 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.750885 20382 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.750922 20381 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.767259 20385 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.767338 20385 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:27.768038 20385 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.768067 20385 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.139 I0301 23:04:27.776702 18916 ts_manager.cc:98] Registered new tserver with Master: 8ee77f2f83d545ef96153a77aac9e5a3 (127.0.22.138:45883) I0301 23:04:27.777079 20385 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.139:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/info.pb --webserver_interface=127.0.22.139 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.20385 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.139 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.777863 20385 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.777999 20385 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.778064 20385 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.778085 20385 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.778116 20385 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.778129 20385 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.778654 20385 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/instance: uuid: "699a11f3afb9486ca3411c4c15d6f42b" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.778789 20385 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal/instance: uuid: "699a11f3afb9486ca3411c4c15d6f42b" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.788414 20385 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.002s sys 0.000s I0301 23:04:27.788626 20385 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.788702 20385 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.789233 20385 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.789264 20385 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal uuid: "699a11f3afb9486ca3411c4c15d6f42b" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.789289 20385 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.802399 20385 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.802601 20385 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.802659 20385 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.806809 20385 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.139:41897 I0301 23:04:27.806860 20385 webserver.cc:175] Starting webserver on 127.0.22.139:0 I0301 23:04:27.806880 20385 webserver.cc:186] Document root disabled I0301 23:04:27.807003 20385 webserver.cc:313] Webserver started. Bound to: http://127.0.22.139:45597/ I0301 23:04:27.807080 19040 ts_manager.cc:98] Registered new tserver with Master: 8ee77f2f83d545ef96153a77aac9e5a3 (127.0.22.138:45883) I0301 23:04:27.807109 20385 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/info.pb I0301 23:04:27.807513 20385 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.807852 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.138:33141 I0301 23:04:27.807982 18978 ts_manager.cc:98] Registered new tserver with Master: 8ee77f2f83d545ef96153a77aac9e5a3 (127.0.22.138:45883) I0301 23:04:27.809516 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 20385 I0301 23:04:27.809764 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data --block_manager=log --rpc_bind_addresses=127.0.22.140:0 --local_ip_for_outbound_sockets=127.0.22.140 --webserver_interface=127.0.22.140 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:27.811977 20511 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.811995 20511 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.812031 20511 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.812295 20510 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.812322 20510 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.812357 20510 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:27.813303 20509 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.813350 20509 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.813434 20509 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.844914 20516 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.845001 20516 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:27.845702 20516 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.845732 20516 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.140 I0301 23:04:27.846638 20516 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.140:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/info.pb --webserver_interface=127.0.22.140 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.20516 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.140 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.847486 20516 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.847648 20516 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.847731 20516 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.847757 20516 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.847800 20516 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.847817 20516 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.860474 20516 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/instance: uuid: "30ffaef5ca2e465aa669c0105befbd8e" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.860635 20516 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal/instance: uuid: "30ffaef5ca2e465aa669c0105befbd8e" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.861629 20516 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:27.861930 20516 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.862009 20516 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.862704 20516 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.862741 20516 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal uuid: "30ffaef5ca2e465aa669c0105befbd8e" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.862766 20516 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:27.894511 18978 ts_manager.cc:98] Registered new tserver with Master: 699a11f3afb9486ca3411c4c15d6f42b (127.0.22.139:41897) I0301 23:04:27.899873 18916 ts_manager.cc:98] Registered new tserver with Master: 699a11f3afb9486ca3411c4c15d6f42b (127.0.22.139:41897) I0301 23:04:27.903944 19040 ts_manager.cc:98] Registered new tserver with Master: 699a11f3afb9486ca3411c4c15d6f42b (127.0.22.139:41897) I0301 23:04:27.904703 19039 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:33467 I0301 23:04:27.904865 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.139:36993 I0301 23:04:27.933928 20516 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:27.934139 20516 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:27.934192 20516 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:27.938956 20516 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.140:39563 I0301 23:04:27.939007 20516 webserver.cc:175] Starting webserver on 127.0.22.140:0 I0301 23:04:27.939011 20516 webserver.cc:186] Document root disabled I0301 23:04:27.939123 20516 webserver.cc:313] Webserver started. Bound to: http://127.0.22.140:37733/ I0301 23:04:27.939239 20516 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/info.pb I0301 23:04:27.939637 20516 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:27.942975 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 20516 I0301 23:04:27.943249 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data --block_manager=log --rpc_bind_addresses=127.0.22.141:0 --local_ip_for_outbound_sockets=127.0.22.141 --webserver_interface=127.0.22.141 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:27.943558 20640 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:27.943586 20640 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.943625 20640 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:27.944200 20638 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:27.944227 20638 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.944245 20639 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:27.944260 20638 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:27.944278 20639 heartbeater.cc:425] Registering TS with master... I0301 23:04:27.944330 20639 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:27.980397 20645 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:27.981566 20645 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:27.984365 20645 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:27.984454 20645 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.141 I0301 23:04:27.985754 20645 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.141:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/info.pb --webserver_interface=127.0.22.141 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.20645 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.141 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:27.991601 20645 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:27.991819 20645 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 49516us I0301 23:04:27.991955 20645 fs_manager.cc:263] Metadata directory not provided I0301 23:04:27.992010 20645 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:27.992091 20645 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:27.992130 20645 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:27.993021 20645 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/instance: uuid: "7612132055d74594899895a5eeb4253f" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.993247 20645 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal/instance: uuid: "7612132055d74594899895a5eeb4253f" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.995704 18978 ts_manager.cc:98] Registered new tserver with Master: 30ffaef5ca2e465aa669c0105befbd8e (127.0.22.140:39563) I0301 23:04:27.996378 20645 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.001s sys 0.000s I0301 23:04:27.996611 20645 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:27.996686 20645 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:27.997258 20645 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:27.997284 20645 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal uuid: "7612132055d74594899895a5eeb4253f" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:27.997309 20645 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.001601 19040 ts_manager.cc:98] Registered new tserver with Master: 30ffaef5ca2e465aa669c0105befbd8e (127.0.22.140:39563) I0301 23:04:28.002513 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.140:53545 I0301 23:04:28.010440 18915 ts_manager.cc:98] Registered new tserver with Master: 30ffaef5ca2e465aa669c0105befbd8e (127.0.22.140:39563) I0301 23:04:28.026319 19347 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.052902 20645 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.053146 20645 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.053206 20645 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.057943 20645 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.141:35933 I0301 23:04:28.057998 20645 webserver.cc:175] Starting webserver on 127.0.22.141:0 I0301 23:04:28.058020 20645 webserver.cc:186] Document root disabled I0301 23:04:28.058159 20645 webserver.cc:313] Webserver started. Bound to: http://127.0.22.141:46309/ I0301 23:04:28.058274 20645 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/info.pb I0301 23:04:28.058912 20645 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.062312 20768 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.062312 20769 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.062363 20768 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.062330 20767 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.062376 20769 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.062399 20767 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.062428 20768 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.062450 20767 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:28.062428 20769 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:28.067500 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 20645 I0301 23:04:28.067812 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data --block_manager=log --rpc_bind_addresses=127.0.22.142:0 --local_ip_for_outbound_sockets=127.0.22.142 --webserver_interface=127.0.22.142 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.106673 20777 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.106770 20777 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:28.107568 20777 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.107602 20777 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.142 I0301 23:04:28.112673 20777 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.142:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/info.pb --webserver_interface=127.0.22.142 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.20777 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.142 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:28.113864 20777 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:28.114058 20777 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0301 23:04:28.114145 20777 fs_manager.cc:263] Metadata directory not provided I0301 23:04:28.114172 20777 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:28.114213 20777 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:28.114234 20777 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:28.114948 20777 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/instance: uuid: "24429722b62a4bfda2c0d772df9fc71a" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.115124 20777 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal/instance: uuid: "24429722b62a4bfda2c0d772df9fc71a" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.116353 19476 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.128533 20777 fs_manager.cc:503] Time spent creating directory manager: real 0.013s user 0.002s sys 0.000s I0301 23:04:28.128823 20777 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:28.128886 20777 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:28.129603 20777 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:28.129633 20777 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal uuid: "24429722b62a4bfda2c0d772df9fc71a" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.129658 20777 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.151228 18915 ts_manager.cc:98] Registered new tserver with Master: 7612132055d74594899895a5eeb4253f (127.0.22.141:35933) I0301 23:04:28.153846 18978 ts_manager.cc:98] Registered new tserver with Master: 7612132055d74594899895a5eeb4253f (127.0.22.141:35933) I0301 23:04:28.154341 19040 ts_manager.cc:98] Registered new tserver with Master: 7612132055d74594899895a5eeb4253f (127.0.22.141:35933) I0301 23:04:28.154978 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.141:44389 I0301 23:04:28.169596 20777 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.169818 20777 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.169885 20777 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.173322 20777 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.142:35923 I0301 23:04:28.173373 20777 webserver.cc:175] Starting webserver on 127.0.22.142:0 I0301 23:04:28.173393 20777 webserver.cc:186] Document root disabled I0301 23:04:28.173522 20777 webserver.cc:313] Webserver started. Bound to: http://127.0.22.142:44225/ I0301 23:04:28.173622 20777 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/info.pb I0301 23:04:28.173933 20777 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.177615 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 20777 I0301 23:04:28.177871 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data --block_manager=log --rpc_bind_addresses=127.0.22.143:0 --local_ip_for_outbound_sockets=127.0.22.143 --webserver_interface=127.0.22.143 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:28.178064 20897 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.178104 20897 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.178143 20897 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.178524 20896 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.178546 20896 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.178577 20896 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:28.179445 20898 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.179471 20898 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.179505 20898 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.194640 20903 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.194730 20903 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:28.195438 20903 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.195473 20903 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.143 I0301 23:04:28.196435 20903 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.143:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/info.pb --webserver_interface=127.0.22.143 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.20903 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.143 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:28.197281 20903 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:28.197461 20903 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0301 23:04:28.197549 20903 fs_manager.cc:263] Metadata directory not provided I0301 23:04:28.197578 20903 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:28.197623 20903 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:28.197641 20903 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:28.198169 20903 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/instance: uuid: "a2e75444df734432b1634d0d658460b9" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.198326 20903 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal/instance: uuid: "a2e75444df734432b1634d0d658460b9" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.204421 20903 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.001s sys 0.001s I0301 23:04:28.204622 20903 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:28.204696 20903 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:28.205261 20903 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:28.205293 20903 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal uuid: "a2e75444df734432b1634d0d658460b9" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.205318 20903 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.218675 19040 ts_manager.cc:98] Registered new tserver with Master: 24429722b62a4bfda2c0d772df9fc71a (127.0.22.142:35923) I0301 23:04:28.219499 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.142:44197 I0301 23:04:28.221361 19604 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.234616 18977 ts_manager.cc:98] Registered new tserver with Master: 24429722b62a4bfda2c0d772df9fc71a (127.0.22.142:35923) I0301 23:04:28.236996 20903 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.237213 20903 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.237275 20903 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.237996 18916 ts_manager.cc:98] Registered new tserver with Master: 24429722b62a4bfda2c0d772df9fc71a (127.0.22.142:35923) I0301 23:04:28.240864 20903 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.143:39163 I0301 23:04:28.240914 20903 webserver.cc:175] Starting webserver on 127.0.22.143:0 I0301 23:04:28.240962 20903 webserver.cc:186] Document root disabled I0301 23:04:28.241102 20903 webserver.cc:313] Webserver started. Bound to: http://127.0.22.143:46623/ I0301 23:04:28.241216 20903 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/info.pb I0301 23:04:28.241834 20903 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.245512 21026 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.245537 21026 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.245575 21026 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.245664 21025 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.245682 21025 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.245709 21025 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:28.245841 21027 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.245854 21027 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.245920 21027 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:28.251001 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 20903 I0301 23:04:28.251219 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data --block_manager=log --rpc_bind_addresses=127.0.22.144:0 --local_ip_for_outbound_sockets=127.0.22.144 --webserver_interface=127.0.22.144 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:28.282126 18978 ts_manager.cc:98] Registered new tserver with Master: a2e75444df734432b1634d0d658460b9 (127.0.22.143:39163) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.286351 21035 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.286459 21035 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:28.287130 21035 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.287160 21035 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.144 I0301 23:04:28.288066 21035 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.144:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/info.pb --webserver_interface=127.0.22.144 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.21035 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.144 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:28.296931 21035 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:28.297080 21035 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0301 23:04:28.297164 21035 fs_manager.cc:263] Metadata directory not provided I0301 23:04:28.297191 21035 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:28.297235 21035 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:28.297255 21035 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:28.297813 21035 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/instance: uuid: "5aa30ad144e94b9290474b283d15239b" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.297971 21035 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal/instance: uuid: "5aa30ad144e94b9290474b283d15239b" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.298949 21035 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:28.299194 21035 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:28.299269 21035 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:28.299973 21035 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:28.300007 21035 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal uuid: "5aa30ad144e94b9290474b283d15239b" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.300031 21035 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.327003 19040 ts_manager.cc:98] Registered new tserver with Master: a2e75444df734432b1634d0d658460b9 (127.0.22.143:39163) I0301 23:04:28.327584 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.143:36741 I0301 23:04:28.327951 18915 ts_manager.cc:98] Registered new tserver with Master: a2e75444df734432b1634d0d658460b9 (127.0.22.143:39163) I0301 23:04:28.355077 19733 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.357466 21035 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.357695 21035 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.357758 21035 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.361327 21035 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.144:36407 I0301 23:04:28.361377 21035 webserver.cc:175] Starting webserver on 127.0.22.144:0 I0301 23:04:28.361413 21035 webserver.cc:186] Document root disabled I0301 23:04:28.361527 21035 webserver.cc:313] Webserver started. Bound to: http://127.0.22.144:34645/ I0301 23:04:28.361616 21035 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/info.pb I0301 23:04:28.361888 21035 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.365291 21156 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.365309 21156 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.365347 21156 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:28.365483 21154 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.365495 21154 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.365528 21154 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:28.365710 21155 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.365733 21155 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.365762 21155 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.367175 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 21035 I0301 23:04:28.367473 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data --block_manager=log --rpc_bind_addresses=127.0.22.145:0 --local_ip_for_outbound_sockets=127.0.22.145 --webserver_interface=127.0.22.145 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.410274 21164 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.410403 21164 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:28.411427 21164 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.411469 21164 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.145 I0301 23:04:28.420759 21164 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.145:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/info.pb --webserver_interface=127.0.22.145 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.21164 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.145 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:28.421996 21164 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:28.422194 21164 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0301 23:04:28.422292 21164 fs_manager.cc:263] Metadata directory not provided I0301 23:04:28.422327 21164 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:28.422375 21164 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:28.422413 21164 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:28.423135 21164 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/instance: uuid: "0365389cd1e7443fa3125e104740a028" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.423360 21164 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal/instance: uuid: "0365389cd1e7443fa3125e104740a028" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.426112 18978 ts_manager.cc:98] Registered new tserver with Master: 5aa30ad144e94b9290474b283d15239b (127.0.22.144:36407) I0301 23:04:28.432641 21164 fs_manager.cc:503] Time spent creating directory manager: real 0.009s user 0.000s sys 0.003s I0301 23:04:28.432886 21164 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:28.432965 21164 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:28.433504 21164 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:28.433532 21164 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal uuid: "0365389cd1e7443fa3125e104740a028" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.433552 21164 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.444695 18915 ts_manager.cc:98] Registered new tserver with Master: 5aa30ad144e94b9290474b283d15239b (127.0.22.144:36407) I0301 23:04:28.445086 19040 ts_manager.cc:98] Registered new tserver with Master: 5aa30ad144e94b9290474b283d15239b (127.0.22.144:36407) I0301 23:04:28.445631 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.144:36147 I0301 23:04:28.451151 21164 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.451354 21164 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.451426 21164 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.455394 21164 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.145:35473 I0301 23:04:28.455444 21164 webserver.cc:175] Starting webserver on 127.0.22.145:0 I0301 23:04:28.455462 21164 webserver.cc:186] Document root disabled I0301 23:04:28.455605 21164 webserver.cc:313] Webserver started. Bound to: http://127.0.22.145:40751/ I0301 23:04:28.455713 21164 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/info.pb I0301 23:04:28.456094 21164 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.459650 21283 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.459672 21283 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.459710 21283 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:28.459764 21285 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.459781 21285 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.459813 21285 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:28.459964 21284 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.459987 21284 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.460016 21284 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.461465 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 21164 I0301 23:04:28.461675 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data --block_manager=log --rpc_bind_addresses=127.0.22.146:0 --local_ip_for_outbound_sockets=127.0.22.146 --webserver_interface=127.0.22.146 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.497808 21293 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.497890 21293 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:28.498589 21293 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.498620 21293 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.146 I0301 23:04:28.499608 21293 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.146:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/info.pb --webserver_interface=127.0.22.146 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.21293 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.146 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:28.504660 21293 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:28.504856 21293 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0301 23:04:28.504951 21293 fs_manager.cc:263] Metadata directory not provided I0301 23:04:28.504981 21293 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:28.505024 21293 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:28.505043 21293 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:28.508487 21293 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/instance: uuid: "8dae08811aa64ff8890b2f4b2be6ccf4" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.508735 21293 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal/instance: uuid: "8dae08811aa64ff8890b2f4b2be6ccf4" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.510910 21293 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.000s sys 0.001s I0301 23:04:28.511193 21293 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:28.511344 21293 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:28.512595 21293 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:28.512688 21293 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal uuid: "8dae08811aa64ff8890b2f4b2be6ccf4" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.512785 21293 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.523111 18978 ts_manager.cc:98] Registered new tserver with Master: 0365389cd1e7443fa3125e104740a028 (127.0.22.145:35473) I0301 23:04:28.524755 19040 ts_manager.cc:98] Registered new tserver with Master: 0365389cd1e7443fa3125e104740a028 (127.0.22.145:35473) I0301 23:04:28.525422 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.145:40701 I0301 23:04:28.529255 19862 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.575328 21293 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.575606 21293 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.575673 21293 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.581199 21293 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.146:33687 I0301 23:04:28.581277 21293 webserver.cc:175] Starting webserver on 127.0.22.146:0 I0301 23:04:28.581297 21293 webserver.cc:186] Document root disabled I0301 23:04:28.581480 21293 webserver.cc:313] Webserver started. Bound to: http://127.0.22.146:37205/ I0301 23:04:28.581642 21293 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/info.pb I0301 23:04:28.582650 21293 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.586400 21413 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.586418 21413 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.586462 21413 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.586654 21412 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.586689 21412 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.586724 21412 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:28.586777 21414 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.586815 21414 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.586871 21414 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:28.589700 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 21293 I0301 23:04:28.589958 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data --block_manager=log --rpc_bind_addresses=127.0.22.147:0 --local_ip_for_outbound_sockets=127.0.22.147 --webserver_interface=127.0.22.147 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:28.608665 18915 ts_manager.cc:98] Registered new tserver with Master: 0365389cd1e7443fa3125e104740a028 (127.0.22.145:35473) I0301 23:04:28.616595 20120 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.627830 21421 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.627940 21421 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:28.644989 21421 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.645023 21421 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.147 I0301 23:04:28.646281 21421 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.147:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/info.pb --webserver_interface=127.0.22.147 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.21421 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.147 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:28.647500 21421 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:28.647688 21421 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0301 23:04:28.647778 21421 fs_manager.cc:263] Metadata directory not provided I0301 23:04:28.647806 21421 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:28.647863 21421 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:28.647879 21421 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:28.654772 20249 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.656693 21421 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/instance: uuid: "cbd7bbaf5b4f4009824f0d72a28c7a0b" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.656882 21421 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal/instance: uuid: "cbd7bbaf5b4f4009824f0d72a28c7a0b" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.658290 21421 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:04:28.658572 21421 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:28.658651 21421 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:28.659327 21421 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:28.659363 21421 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal uuid: "cbd7bbaf5b4f4009824f0d72a28c7a0b" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.659416 21421 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.681363 21421 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.681707 21421 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.681784 21421 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.689730 21421 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.147:41519 I0301 23:04:28.689837 21421 webserver.cc:175] Starting webserver on 127.0.22.147:0 I0301 23:04:28.689900 21421 webserver.cc:186] Document root disabled I0301 23:04:28.690132 21421 webserver.cc:313] Webserver started. Bound to: http://127.0.22.147:38071/ I0301 23:04:28.690241 21421 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/info.pb I0301 23:04:28.690981 21421 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.696863 21543 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.696995 21541 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.697111 21541 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.696975 21543 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.697204 21541 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:28.697510 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 21421 I0301 23:04:28.697753 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data --block_manager=log --rpc_bind_addresses=127.0.22.148:0 --local_ip_for_outbound_sockets=127.0.22.148 --webserver_interface=127.0.22.148 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:28.698447 21542 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.698524 21542 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.698621 21542 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.698796 21543 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:28.703886 19040 ts_manager.cc:98] Registered new tserver with Master: 8dae08811aa64ff8890b2f4b2be6ccf4 (127.0.22.146:33687) I0301 23:04:28.704540 18978 ts_manager.cc:98] Registered new tserver with Master: 8dae08811aa64ff8890b2f4b2be6ccf4 (127.0.22.146:33687) I0301 23:04:28.706218 19040 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.146:53123 I0301 23:04:28.709826 18913 ts_manager.cc:98] Registered new tserver with Master: 8dae08811aa64ff8890b2f4b2be6ccf4 (127.0.22.146:33687) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.727753 21548 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.727850 21548 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0301 23:04:28.735172 19993 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... W0301 23:04:28.740453 21548 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.740491 21548 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.148 I0301 23:04:28.741709 21548 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.148:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/info.pb --webserver_interface=127.0.22.148 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.21548 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.148 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:28.742854 21548 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:28.743039 21548 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0301 23:04:28.743134 21548 fs_manager.cc:263] Metadata directory not provided I0301 23:04:28.743166 21548 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:28.743211 21548 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:28.743228 21548 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:28.743933 21548 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/instance: uuid: "b8d38d23869b4ab6b8c58ddc0231fc8f" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.744112 21548 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal/instance: uuid: "b8d38d23869b4ab6b8c58ddc0231fc8f" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.760396 21548 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.000s sys 0.001s I0301 23:04:28.760691 21548 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:28.760767 21548 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:28.761422 21548 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:28.761507 21548 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal uuid: "b8d38d23869b4ab6b8c58ddc0231fc8f" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.761600 21548 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.808616 20380 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.812518 18975 ts_manager.cc:98] Registered new tserver with Master: cbd7bbaf5b4f4009824f0d72a28c7a0b (127.0.22.147:41519) I0301 23:04:28.813504 18915 ts_manager.cc:98] Registered new tserver with Master: cbd7bbaf5b4f4009824f0d72a28c7a0b (127.0.22.147:41519) I0301 23:04:28.834358 21548 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.834609 21548 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.834667 21548 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.840188 21548 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.148:35887 I0301 23:04:28.840240 21548 webserver.cc:175] Starting webserver on 127.0.22.148:0 I0301 23:04:28.840250 21548 webserver.cc:186] Document root disabled I0301 23:04:28.840405 21548 webserver.cc:313] Webserver started. Bound to: http://127.0.22.148:33125/ I0301 23:04:28.840528 21548 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/info.pb I0301 23:04:28.842442 21548 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.845002 21672 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.845043 21672 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.845085 21672 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:28.845916 21670 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.845937 21670 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.845970 21671 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.846042 21671 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.846077 21671 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.846127 21670 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:28.850608 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 21548 I0301 23:04:28.850864 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data --block_manager=log --rpc_bind_addresses=127.0.22.149:0 --local_ip_for_outbound_sockets=127.0.22.149 --webserver_interface=127.0.22.149 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.892653 21679 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.892755 21679 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:28.893604 21679 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.893640 21679 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.149 I0301 23:04:28.894515 21679 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.149:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/info.pb --webserver_interface=127.0.22.149 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.21679 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.149 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:28.895083 19037 ts_manager.cc:98] Registered new tserver with Master: cbd7bbaf5b4f4009824f0d72a28c7a0b (127.0.22.147:41519) I0301 23:04:28.897490 19037 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.147:49339 I0301 23:04:28.900877 21679 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:28.901116 21679 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0301 23:04:28.901397 21679 fs_manager.cc:263] Metadata directory not provided I0301 23:04:28.904242 21679 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:28.904331 21679 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:28.904368 21679 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:28.905092 21679 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/instance: uuid: "1809bbd3e6ee4892b4f88f8c4dfc7631" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.905273 21679 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal/instance: uuid: "1809bbd3e6ee4892b4f88f8c4dfc7631" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.905329 19210 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.905522 20509 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:28.906661 21679 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:28.906913 21679 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:28.906987 21679 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:28.907827 21679 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:28.907901 21679 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal uuid: "1809bbd3e6ee4892b4f88f8c4dfc7631" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:28.907964 21679 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:28.938930 18914 ts_manager.cc:98] Registered new tserver with Master: b8d38d23869b4ab6b8c58ddc0231fc8f (127.0.22.148:35887) I0301 23:04:28.940366 18977 ts_manager.cc:98] Registered new tserver with Master: b8d38d23869b4ab6b8c58ddc0231fc8f (127.0.22.148:35887) I0301 23:04:28.944360 21679 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:28.944608 21679 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:28.944669 21679 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:28.948940 21679 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.149:38703 I0301 23:04:28.949038 21679 webserver.cc:175] Starting webserver on 127.0.22.149:0 I0301 23:04:28.949072 21679 webserver.cc:186] Document root disabled I0301 23:04:28.949204 21679 webserver.cc:313] Webserver started. Bound to: http://127.0.22.149:40617/ I0301 23:04:28.949373 21679 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/info.pb I0301 23:04:28.949620 21679 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:28.953591 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 21679 I0301 23:04:28.953842 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data --block_manager=log --rpc_bind_addresses=127.0.22.150:0 --local_ip_for_outbound_sockets=127.0.22.150 --webserver_interface=127.0.22.150 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:28.955929 19035 ts_manager.cc:98] Registered new tserver with Master: b8d38d23869b4ab6b8c58ddc0231fc8f (127.0.22.148:35887) I0301 23:04:28.956763 19035 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.148:49007 I0301 23:04:28.958544 21800 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:28.958590 21800 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.958654 21800 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:28.958840 21801 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:28.958890 21801 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.958964 21801 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:28.960796 21799 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:28.960820 21799 heartbeater.cc:425] Registering TS with master... I0301 23:04:28.960855 21799 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:28.994838 21806 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:28.994930 21806 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:28.995628 21806 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:28.995661 21806 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.150 I0301 23:04:29.003259 20638 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:29.008625 21806 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.150:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/info.pb --webserver_interface=127.0.22.150 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.21806 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.150 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.011092 21806 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.011291 21806 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.011374 21806 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.011412 21806 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.011456 21806 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.011462 21806 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.016438 21806 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/instance: uuid: "ed2cf46582b1444e9f38162d39866c52" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.016638 21806 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal/instance: uuid: "ed2cf46582b1444e9f38162d39866c52" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.020378 21806 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.002s sys 0.000s I0301 23:04:29.020647 21806 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.020707 21806 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.021570 21806 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.021670 21806 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal uuid: "ed2cf46582b1444e9f38162d39866c52" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.021788 21806 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.026983 18976 ts_manager.cc:98] Registered new tserver with Master: 1809bbd3e6ee4892b4f88f8c4dfc7631 (127.0.22.149:38703) I0301 23:04:29.027838 19038 ts_manager.cc:98] Registered new tserver with Master: 1809bbd3e6ee4892b4f88f8c4dfc7631 (127.0.22.149:38703) I0301 23:04:29.028955 19038 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.149:48705 I0301 23:04:29.052645 18913 ts_manager.cc:98] Registered new tserver with Master: 1809bbd3e6ee4892b4f88f8c4dfc7631 (127.0.22.149:38703) I0301 23:04:29.061271 21806 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.061547 21806 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.061609 21806 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.066074 21806 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.150:33415 I0301 23:04:29.066123 21806 webserver.cc:175] Starting webserver on 127.0.22.150:0 I0301 23:04:29.066129 21806 webserver.cc:186] Document root disabled I0301 23:04:29.066264 21806 webserver.cc:313] Webserver started. Bound to: http://127.0.22.150:39433/ I0301 23:04:29.066373 21806 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/info.pb I0301 23:04:29.066733 21806 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.068141 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 21806 I0301 23:04:29.068466 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data --block_manager=log --rpc_bind_addresses=127.0.22.151:0 --local_ip_for_outbound_sockets=127.0.22.151 --webserver_interface=127.0.22.151 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:29.070679 21928 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.070696 21928 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.070736 21928 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.070909 21930 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.070952 21930 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.071005 21930 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.072504 21929 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.072521 21929 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.072552 21929 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.096688 21935 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.096783 21935 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.097810 21935 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.097854 21935 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.151 I0301 23:04:29.099150 21935 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.151:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/info.pb --webserver_interface=127.0.22.151 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.21935 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.151 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.101572 21935 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.101763 21935 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.101861 21935 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.101908 21935 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.101971 21935 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.101990 21935 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.102695 21935 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/instance: uuid: "e245ac87358647788ec155fcd199ec11" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.102931 21935 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal/instance: uuid: "e245ac87358647788ec155fcd199ec11" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.104297 21935 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.003s sys 0.000s I0301 23:04:29.104583 21935 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.104658 21935 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.105341 21935 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.105377 21935 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal uuid: "e245ac87358647788ec155fcd199ec11" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.105440 21935 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.143273 21935 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.143535 21935 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.143606 21935 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.148667 21935 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.151:40697 I0301 23:04:29.148730 21935 webserver.cc:175] Starting webserver on 127.0.22.151:0 I0301 23:04:29.148751 21935 webserver.cc:186] Document root disabled I0301 23:04:29.148903 21935 webserver.cc:313] Webserver started. Bound to: http://127.0.22.151:44909/ I0301 23:04:29.149042 21935 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/info.pb I0301 23:04:29.150192 21935 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.153439 22059 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.153483 22059 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.153522 22059 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.153627 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 21935 I0301 23:04:29.153780 22057 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.153795 22057 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.153831 22057 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.153864 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data --block_manager=log --rpc_bind_addresses=127.0.22.152:0 --local_ip_for_outbound_sockets=127.0.22.152 --webserver_interface=127.0.22.152 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:29.155634 22058 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.155660 22058 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.155692 22058 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:29.155707 20767 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:29.179296 18978 ts_manager.cc:98] Registered new tserver with Master: ed2cf46582b1444e9f38162d39866c52 (127.0.22.150:33415) I0301 23:04:29.180217 19038 ts_manager.cc:98] Registered new tserver with Master: ed2cf46582b1444e9f38162d39866c52 (127.0.22.150:33415) I0301 23:04:29.180248 18912 ts_manager.cc:98] Registered new tserver with Master: ed2cf46582b1444e9f38162d39866c52 (127.0.22.150:33415) I0301 23:04:29.181030 19038 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.150:59379 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.185833 22064 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.185925 22064 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.186894 22064 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.186931 22064 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.152 I0301 23:04:29.188123 22064 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.152:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/info.pb --webserver_interface=127.0.22.152 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.22064 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.152 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.197350 22064 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.197551 22064 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.197643 22064 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.197671 22064 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.197713 22064 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.197729 22064 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.198470 22064 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/instance: uuid: "8173db00a9ce41c0bdf618f89872624e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.198649 22064 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal/instance: uuid: "8173db00a9ce41c0bdf618f89872624e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.200356 22064 fs_manager.cc:503] Time spent creating directory manager: real 0.002s user 0.002s sys 0.000s I0301 23:04:29.201448 22064 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.201681 22064 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.203951 22064 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0301 23:04:29.204074 22064 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal uuid: "8173db00a9ce41c0bdf618f89872624e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.204346 22064 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.208245 19035 ts_manager.cc:98] Registered new tserver with Master: e245ac87358647788ec155fcd199ec11 (127.0.22.151:40697) I0301 23:04:29.209084 19035 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.151:57461 I0301 23:04:29.220649 20896 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:29.249874 22064 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.250123 22064 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.250202 22064 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.256024 18916 ts_manager.cc:98] Registered new tserver with Master: e245ac87358647788ec155fcd199ec11 (127.0.22.151:40697) I0301 23:04:29.256063 18975 ts_manager.cc:98] Registered new tserver with Master: e245ac87358647788ec155fcd199ec11 (127.0.22.151:40697) I0301 23:04:29.256229 22064 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.152:35037 I0301 23:04:29.256275 22064 webserver.cc:175] Starting webserver on 127.0.22.152:0 I0301 23:04:29.256283 22064 webserver.cc:186] Document root disabled I0301 23:04:29.256426 22064 webserver.cc:313] Webserver started. Bound to: http://127.0.22.152:45421/ I0301 23:04:29.256538 22064 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/info.pb I0301 23:04:29.257036 22064 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.257037 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 22064 I0301 23:04:29.257272 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data --block_manager=log --rpc_bind_addresses=127.0.22.153:0 --local_ip_for_outbound_sockets=127.0.22.153 --webserver_interface=127.0.22.153 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:29.261117 22188 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.261147 22188 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.261188 22188 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.261207 22187 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.261219 22187 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.261255 22187 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:29.261191 22186 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.261330 22186 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.261359 22186 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.293241 22193 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.293341 22193 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.294024 22193 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.294054 22193 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.153 I0301 23:04:29.295238 22193 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.153:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/info.pb --webserver_interface=127.0.22.153 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.22193 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.153 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.305810 22193 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.306011 22193 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.306102 22193 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.306130 22193 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.306170 22193 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.306185 22193 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.306915 22193 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/instance: uuid: "e243ad45f06746eea00d461b3e91fa20" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.307093 22193 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal/instance: uuid: "e243ad45f06746eea00d461b3e91fa20" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.311425 22193 fs_manager.cc:503] Time spent creating directory manager: real 0.004s user 0.001s sys 0.001s I0301 23:04:29.311731 22193 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.311808 22193 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.312413 22193 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.312444 22193 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal uuid: "e243ad45f06746eea00d461b3e91fa20" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.312469 22193 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.328289 21025 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:29.347733 22193 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.347961 22193 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.348021 22193 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.353468 19035 ts_manager.cc:98] Registered new tserver with Master: 8173db00a9ce41c0bdf618f89872624e (127.0.22.152:35037) I0301 23:04:29.354157 18978 ts_manager.cc:98] Registered new tserver with Master: 8173db00a9ce41c0bdf618f89872624e (127.0.22.152:35037) I0301 23:04:29.354316 19035 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.152:43503 I0301 23:04:29.354367 22193 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.153:43729 I0301 23:04:29.354512 22193 webserver.cc:175] Starting webserver on 127.0.22.153:0 I0301 23:04:29.354544 22193 webserver.cc:186] Document root disabled I0301 23:04:29.354547 18915 ts_manager.cc:98] Registered new tserver with Master: 8173db00a9ce41c0bdf618f89872624e (127.0.22.152:35037) I0301 23:04:29.354686 22193 webserver.cc:313] Webserver started. Bound to: http://127.0.22.153:35609/ I0301 23:04:29.354792 22193 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/info.pb I0301 23:04:29.355229 22193 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.359519 22317 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.359565 22317 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.359612 22317 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.359773 22315 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.359815 22315 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.359887 22315 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.359961 22316 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.359987 22316 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.360011 22316 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:29.360611 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 22193 I0301 23:04:29.360836 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data --block_manager=log --rpc_bind_addresses=127.0.22.154:0 --local_ip_for_outbound_sockets=127.0.22.154 --webserver_interface=127.0.22.154 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.395444 22324 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.395524 22324 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.400310 22324 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.400353 22324 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.154 I0301 23:04:29.401620 22324 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.154:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/info.pb --webserver_interface=127.0.22.154 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.22324 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.154 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.402828 22324 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.403039 22324 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.403137 22324 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.403170 22324 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.403216 22324 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.403242 22324 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.403990 22324 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/instance: uuid: "a84448f5e0c54e8b8f0a8a38e09fcb8e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.408221 22324 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal/instance: uuid: "a84448f5e0c54e8b8f0a8a38e09fcb8e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.409747 22324 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.000s sys 0.001s I0301 23:04:29.410066 22324 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.410218 22324 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.410948 22324 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.411008 22324 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal uuid: "a84448f5e0c54e8b8f0a8a38e09fcb8e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.411073 22324 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.415153 18912 ts_manager.cc:98] Registered new tserver with Master: e243ad45f06746eea00d461b3e91fa20 (127.0.22.153:43729) I0301 23:04:29.421025 18977 ts_manager.cc:98] Registered new tserver with Master: e243ad45f06746eea00d461b3e91fa20 (127.0.22.153:43729) I0301 23:04:29.423424 19035 ts_manager.cc:98] Registered new tserver with Master: e243ad45f06746eea00d461b3e91fa20 (127.0.22.153:43729) I0301 23:04:29.424052 19035 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.153:58107 I0301 23:04:29.446226 21154 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:29.452636 22324 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.452868 22324 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.452945 22324 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.457820 22324 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.154:35051 I0301 23:04:29.457866 22324 webserver.cc:175] Starting webserver on 127.0.22.154:0 I0301 23:04:29.457871 22324 webserver.cc:186] Document root disabled I0301 23:04:29.458027 22324 webserver.cc:313] Webserver started. Bound to: http://127.0.22.154:43973/ I0301 23:04:29.458179 22324 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/info.pb I0301 23:04:29.458554 22324 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.461812 22446 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.461865 22446 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.461937 22446 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.462200 22445 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.462250 22445 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.462314 22445 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:29.462358 22444 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.462419 22444 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.462448 22444 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.465590 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 22324 I0301 23:04:29.465837 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data --block_manager=log --rpc_bind_addresses=127.0.22.155:0 --local_ip_for_outbound_sockets=127.0.22.155 --webserver_interface=127.0.22.155 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.480845 22454 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.480950 22454 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.482058 22454 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.482101 22454 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.155 I0301 23:04:29.483546 22454 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.155:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/info.pb --webserver_interface=127.0.22.155 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.22454 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.155 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.484835 22454 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.485028 22454 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.485128 22454 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.485162 22454 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.485206 22454 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.485227 22454 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.486054 22454 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/instance: uuid: "6f3042abec074254a3c34d297e3098c9" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.486263 22454 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal/instance: uuid: "6f3042abec074254a3c34d297e3098c9" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.487658 22454 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s I0301 23:04:29.487918 22454 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.487998 22454 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.488718 22454 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.488752 22454 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal uuid: "6f3042abec074254a3c34d297e3098c9" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.488777 22454 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.526190 21283 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:29.541249 22454 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.541505 22454 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.541599 22454 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.547988 22454 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.155:45897 I0301 23:04:29.548063 22454 webserver.cc:175] Starting webserver on 127.0.22.155:0 I0301 23:04:29.548082 22454 webserver.cc:186] Document root disabled I0301 23:04:29.548297 22454 webserver.cc:313] Webserver started. Bound to: http://127.0.22.155:46187/ I0301 23:04:29.548434 22454 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/info.pb I0301 23:04:29.548756 22454 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.553771 22573 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.553794 22573 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.553956 22573 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.555061 22574 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.555106 22574 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.555152 22574 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:29.555804 22575 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.555864 22575 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.555907 22575 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.558460 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 22454 I0301 23:04:29.558723 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data --block_manager=log --rpc_bind_addresses=127.0.22.156:0 --local_ip_for_outbound_sockets=127.0.22.156 --webserver_interface=127.0.22.156 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:29.564327 18977 ts_manager.cc:98] Registered new tserver with Master: a84448f5e0c54e8b8f0a8a38e09fcb8e (127.0.22.154:35051) I0301 23:04:29.564426 18912 ts_manager.cc:98] Registered new tserver with Master: a84448f5e0c54e8b8f0a8a38e09fcb8e (127.0.22.154:35051) I0301 23:04:29.568930 19035 ts_manager.cc:98] Registered new tserver with Master: a84448f5e0c54e8b8f0a8a38e09fcb8e (127.0.22.154:35051) I0301 23:04:29.569583 19035 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.154:40899 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.576088 22580 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.576197 22580 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.577069 22580 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.577105 22580 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.156 I0301 23:04:29.578297 22580 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.156:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/info.pb --webserver_interface=127.0.22.156 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.22580 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.156 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.579483 22580 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.579645 22580 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.579731 22580 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.579756 22580 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.579798 22580 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.579815 22580 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.580499 22580 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/instance: uuid: "9e2aef0791a6458ca6c8cc08cd7b0cde" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.580696 22580 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal/instance: uuid: "9e2aef0791a6458ca6c8cc08cd7b0cde" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.582228 22580 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.000s I0301 23:04:29.582482 22580 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.582552 22580 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.583158 22580 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.583190 22580 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal uuid: "9e2aef0791a6458ca6c8cc08cd7b0cde" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.583236 22580 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.633008 18976 ts_manager.cc:98] Registered new tserver with Master: 6f3042abec074254a3c34d297e3098c9 (127.0.22.155:45897) I0301 23:04:29.635939 22580 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.636195 22580 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.636279 22580 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.641660 22580 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.156:44865 I0301 23:04:29.641724 22580 webserver.cc:175] Starting webserver on 127.0.22.156:0 I0301 23:04:29.641744 22580 webserver.cc:186] Document root disabled I0301 23:04:29.641883 22580 webserver.cc:313] Webserver started. Bound to: http://127.0.22.156:37777/ I0301 23:04:29.642010 22580 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/info.pb I0301 23:04:29.643121 22580 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.646986 22703 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.647042 22703 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.647106 22702 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.647112 22703 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:29.647174 22702 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.647303 22702 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.647559 22704 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.647644 22704 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.647725 22704 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.651455 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 22580 I0301 23:04:29.651724 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data --block_manager=log --rpc_bind_addresses=127.0.22.157:0 --local_ip_for_outbound_sockets=127.0.22.157 --webserver_interface=127.0.22.157 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:29.654753 18914 ts_manager.cc:98] Registered new tserver with Master: 6f3042abec074254a3c34d297e3098c9 (127.0.22.155:45897) I0301 23:04:29.664585 19038 ts_manager.cc:98] Registered new tserver with Master: 6f3042abec074254a3c34d297e3098c9 (127.0.22.155:45897) I0301 23:04:29.667311 19038 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.155:60965 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.681565 22710 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.681668 22710 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.684828 22710 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.684871 22710 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.157 I0301 23:04:29.686128 22710 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.157:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/info.pb --webserver_interface=127.0.22.157 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.22710 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.157 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.687405 22710 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.687604 22710 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.692289 22710 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.692324 22710 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.692369 22710 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.692400 22710 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.693109 22710 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/instance: uuid: "dfef967142f842f6af542671120a564e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.693308 22710 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal/instance: uuid: "dfef967142f842f6af542671120a564e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.699726 22710 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.002s sys 0.001s I0301 23:04:29.700117 22710 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.700224 22710 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.700973 22710 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.701009 22710 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal uuid: "dfef967142f842f6af542671120a564e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.701071 22710 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.707103 21412 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:29.714301 18915 ts_manager.cc:98] Registered new tserver with Master: 9e2aef0791a6458ca6c8cc08cd7b0cde (127.0.22.156:44865) I0301 23:04:29.717495 18974 ts_manager.cc:98] Registered new tserver with Master: 9e2aef0791a6458ca6c8cc08cd7b0cde (127.0.22.156:44865) I0301 23:04:29.723773 19036 ts_manager.cc:98] Registered new tserver with Master: 9e2aef0791a6458ca6c8cc08cd7b0cde (127.0.22.156:44865) I0301 23:04:29.724612 19036 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.156:35151 I0301 23:04:29.728636 22710 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.728878 22710 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.728935 22710 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.733688 22710 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.157:39971 I0301 23:04:29.733745 22710 webserver.cc:175] Starting webserver on 127.0.22.157:0 I0301 23:04:29.733760 22710 webserver.cc:186] Document root disabled I0301 23:04:29.733872 22710 webserver.cc:313] Webserver started. Bound to: http://127.0.22.157:42421/ I0301 23:04:29.733988 22710 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/info.pb I0301 23:04:29.734481 22710 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.738335 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 22710 I0301 23:04:29.738487 22833 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.738498 22833 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.738525 22833 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.738600 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data --block_manager=log --rpc_bind_addresses=127.0.22.158:0 --local_ip_for_outbound_sockets=127.0.22.158 --webserver_interface=127.0.22.158 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:29.738659 22832 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.738670 22832 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.738698 22832 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:29.739408 22831 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.739434 22831 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.739464 22831 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.776914 19036 ts_manager.cc:98] Registered new tserver with Master: dfef967142f842f6af542671120a564e (127.0.22.157:39971) I0301 23:04:29.777493 19036 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.157:36233 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.779335 22838 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.779433 22838 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.780112 22838 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.780148 22838 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.158 I0301 23:04:29.781142 22838 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.158:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/info.pb --webserver_interface=127.0.22.158 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.22838 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.158 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.782018 22838 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.782160 22838 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.782248 22838 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.782276 22838 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.782320 22838 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.782335 22838 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.782996 22838 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/instance: uuid: "68cd2b3e78884927ad0c60e4274be725" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.783164 22838 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal/instance: uuid: "68cd2b3e78884927ad0c60e4274be725" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.784353 22838 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.002s I0301 23:04:29.784646 22838 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.784726 22838 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.785426 22838 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.785462 22838 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal uuid: "68cd2b3e78884927ad0c60e4274be725" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.785487 22838 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.814215 22838 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.814488 22838 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.814570 22838 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.822091 22838 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.158:46635 I0301 23:04:29.822173 22838 webserver.cc:175] Starting webserver on 127.0.22.158:0 I0301 23:04:29.822207 22838 webserver.cc:186] Document root disabled I0301 23:04:29.822345 22838 webserver.cc:313] Webserver started. Bound to: http://127.0.22.158:45633/ I0301 23:04:29.822504 22838 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/info.pb I0301 23:04:29.823050 22838 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.825114 18912 ts_manager.cc:98] Registered new tserver with Master: dfef967142f842f6af542671120a564e (127.0.22.157:39971) I0301 23:04:29.827291 18978 ts_manager.cc:98] Registered new tserver with Master: dfef967142f842f6af542671120a564e (127.0.22.157:39971) I0301 23:04:29.827589 22960 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.827634 22960 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.827697 22960 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.828025 22962 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.828073 22962 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.828127 22962 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.828994 22961 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.829017 22961 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.829051 22961 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:29.831419 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 22838 I0301 23:04:29.831646 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data --block_manager=log --rpc_bind_addresses=127.0.22.159:0 --local_ip_for_outbound_sockets=127.0.22.159 --webserver_interface=127.0.22.159 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.865741 22970 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.865823 22970 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.866616 22970 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.866650 22970 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.159 I0301 23:04:29.867601 22970 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.159:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/info.pb --webserver_interface=127.0.22.159 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.22970 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.159 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.880519 22970 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.880666 22970 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.880753 22970 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.880780 22970 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.880825 22970 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.880848 22970 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.881431 22970 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/instance: uuid: "93811e8b1a554358b588f3a88472e55b" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.881615 22970 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal/instance: uuid: "93811e8b1a554358b588f3a88472e55b" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.882647 22970 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:29.882894 22970 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.882975 22970 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.883585 22970 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.883618 22970 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal uuid: "93811e8b1a554358b588f3a88472e55b" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.883642 22970 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.898499 21541 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:29.921689 18976 ts_manager.cc:98] Registered new tserver with Master: 68cd2b3e78884927ad0c60e4274be725 (127.0.22.158:46635) I0301 23:04:29.922426 22970 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:29.922617 22970 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:29.922677 22970 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:29.923276 18913 ts_manager.cc:98] Registered new tserver with Master: 68cd2b3e78884927ad0c60e4274be725 (127.0.22.158:46635) I0301 23:04:29.924800 19036 ts_manager.cc:98] Registered new tserver with Master: 68cd2b3e78884927ad0c60e4274be725 (127.0.22.158:46635) I0301 23:04:29.925607 19036 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.158:50029 I0301 23:04:29.928086 22970 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.159:42115 I0301 23:04:29.928138 22970 webserver.cc:175] Starting webserver on 127.0.22.159:0 I0301 23:04:29.928145 22970 webserver.cc:186] Document root disabled I0301 23:04:29.928325 22970 webserver.cc:313] Webserver started. Bound to: http://127.0.22.159:41675/ I0301 23:04:29.928473 22970 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/info.pb I0301 23:04:29.929035 22970 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:29.931483 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 22970 I0301 23:04:29.931722 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data --block_manager=log --rpc_bind_addresses=127.0.22.160:0 --local_ip_for_outbound_sockets=127.0.22.160 --webserver_interface=127.0.22.160 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:29.933719 23091 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:29.933744 23091 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.933784 23091 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:29.934271 23089 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:29.934324 23089 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.934419 23089 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:29.934432 23090 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:29.934514 23090 heartbeater.cc:425] Registering TS with master... I0301 23:04:29.934566 23090 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:29.945253 23096 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:29.945346 23096 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:29.946329 23096 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:29.946399 23096 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.160 I0301 23:04:29.948493 23096 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.160:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/info.pb --webserver_interface=127.0.22.160 --webserver_port=0 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.23096 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.160 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:29.949661 23096 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:29.949836 23096 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0301 23:04:29.949939 23096 fs_manager.cc:263] Metadata directory not provided I0301 23:04:29.949967 23096 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:29.950009 23096 server_base.cc:432] Could not load existing FS layout: Not found: could not find a healthy instance file I0301 23:04:29.950026 23096 server_base.cc:433] Attempting to create new FS layout instead I0301 23:04:29.950711 23096 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/instance: uuid: "edf8f151a97949ab9d67d3381c58f99b" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.950894 23096 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal/instance: uuid: "edf8f151a97949ab9d67d3381c58f99b" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.952286 23096 fs_manager.cc:503] Time spent creating directory manager: real 0.001s user 0.002s sys 0.001s I0301 23:04:29.952582 23096 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:29.952654 23096 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:29.953418 23096 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:29.953469 23096 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal uuid: "edf8f151a97949ab9d67d3381c58f99b" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:29.953496 23096 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:29.957442 21670 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:30.000520 23096 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.000774 23096 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:30.000864 23096 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:30.001547 19035 ts_manager.cc:98] Registered new tserver with Master: 93811e8b1a554358b588f3a88472e55b (127.0.22.159:42115) I0301 23:04:30.002363 19035 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.159:37349 I0301 23:04:30.006517 23096 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.160:46103 I0301 23:04:30.006711 23096 webserver.cc:175] Starting webserver on 127.0.22.160:0 I0301 23:04:30.006803 23096 webserver.cc:186] Document root disabled I0301 23:04:30.007308 23096 webserver.cc:313] Webserver started. Bound to: http://127.0.22.160:35159/ I0301 23:04:30.007686 23096 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/info.pb I0301 23:04:30.009223 23096 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:30.010860 18913 ts_manager.cc:98] Registered new tserver with Master: 93811e8b1a554358b588f3a88472e55b (127.0.22.159:42115) I0301 23:04:30.015471 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 23096 I0301 23:04:30.015888 18976 ts_manager.cc:98] Registered new tserver with Master: 93811e8b1a554358b588f3a88472e55b (127.0.22.159:42115) I0301 23:04:30.016686 23221 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:30.016705 23221 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.016742 23221 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:30.017241 23218 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:30.017266 23218 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.017297 23218 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:30.017300 23220 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:30.017449 23220 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.017479 23220 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:30.029672 21799 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... I0301 23:04:30.055332 18911 ts_manager.cc:98] Registered new tserver with Master: edf8f151a97949ab9d67d3381c58f99b (127.0.22.160:46103) I0301 23:04:30.085633 19037 ts_manager.cc:98] Registered new tserver with Master: edf8f151a97949ab9d67d3381c58f99b (127.0.22.160:46103) I0301 23:04:30.086684 19037 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.160:44063 I0301 23:04:30.171169 18974 ts_manager.cc:98] Registered new tserver with Master: edf8f151a97949ab9d67d3381c58f99b (127.0.22.160:46103) I0301 23:04:30.174795 90 external_mini_cluster.cc:623] 32 TS(s) registered with all masters I0301 23:04:30.175808 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 19074 W0301 23:04:30.179098 19021 connection.cc:647] server connection from 127.0.22.129:33467 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:33467): Connection reset by peer (error 104) I0301 23:04:30.179109 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 19217 W0301 23:04:30.180441 18897 connection.cc:647] server connection from 127.0.22.129:60163 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:60163): Connection reset by peer (error 104) W0301 23:04:30.181104 18959 connection.cc:647] server connection from 127.0.22.129:47179 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:47179): Connection reset by peer (error 104) I0301 23:04:30.181746 21928 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... W0301 23:04:30.182214 18899 connection.cc:647] server connection from 127.0.22.130:46457 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:46457): Connection reset by peer (error 104) W0301 23:04:30.182322 18962 connection.cc:647] server connection from 127.0.22.130:58473 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:58473): Connection reset by peer (error 104) I0301 23:04:30.182330 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 19354 W0301 23:04:30.185130 18900 connection.cc:647] server connection from 127.0.22.131:33733 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:33733): Connection reset by peer (error 104) W0301 23:04:30.185144 18962 connection.cc:647] server connection from 127.0.22.131:37837 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:37837): Connection reset by peer (error 104) W0301 23:04:30.185222 19022 connection.cc:647] server connection from 127.0.22.130:38709 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:38709): Connection reset by peer (error 104) W0301 23:04:30.185333 19021 connection.cc:647] server connection from 127.0.22.131:52099 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:52099): Connection reset by peer (error 104) I0301 23:04:30.185478 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 19482 W0301 23:04:30.188112 18959 connection.cc:647] server connection from 127.0.22.132:40589 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:40589): Connection reset by peer (error 104) W0301 23:04:30.188136 18900 connection.cc:647] server connection from 127.0.22.132:51829 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:51829): Connection reset by peer (error 104) W0301 23:04:30.188248 19024 connection.cc:647] server connection from 127.0.22.132:37445 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:37445): Connection reset by peer (error 104) I0301 23:04:30.188433 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 19614 W0301 23:04:30.190732 18959 connection.cc:647] server connection from 127.0.22.133:59397 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:59397): Connection reset by peer (error 104) W0301 23:04:30.190755 18899 connection.cc:647] server connection from 127.0.22.133:47595 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:47595): Connection reset by peer (error 104) I0301 23:04:30.190829 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 19743 W0301 23:04:30.190913 19021 connection.cc:647] server connection from 127.0.22.133:48783 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:48783): Connection reset by peer (error 104) W0301 23:04:30.193243 18898 connection.cc:647] server connection from 127.0.22.134:41239 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:41239): Connection reset by peer (error 104) W0301 23:04:30.193264 18960 connection.cc:647] server connection from 127.0.22.134:38939 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:38939): Connection reset by peer (error 104) W0301 23:04:30.193343 19024 connection.cc:647] server connection from 127.0.22.134:51153 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:51153): Connection reset by peer (error 104) I0301 23:04:30.193550 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 19870 W0301 23:04:30.196228 18961 connection.cc:647] server connection from 127.0.22.135:35613 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:35613): Connection reset by peer (error 104) W0301 23:04:30.196264 19022 connection.cc:647] server connection from 127.0.22.135:53185 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:53185): Connection reset by peer (error 104) I0301 23:04:30.196435 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 20000 W0301 23:04:30.197273 18899 connection.cc:647] server connection from 127.0.22.135:40641 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:40641): Connection reset by peer (error 104) W0301 23:04:30.199398 18960 connection.cc:647] server connection from 127.0.22.136:46737 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:46737): Connection reset by peer (error 104) W0301 23:04:30.199425 18898 connection.cc:647] server connection from 127.0.22.136:50185 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:50185): Connection reset by peer (error 104) W0301 23:04:30.199492 19024 connection.cc:647] server connection from 127.0.22.136:33351 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:33351): Connection reset by peer (error 104) I0301 23:04:30.199656 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 20127 W0301 23:04:30.202641 18960 connection.cc:647] server connection from 127.0.22.137:34503 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:34503): Connection reset by peer (error 104) W0301 23:04:30.202656 18900 connection.cc:647] server connection from 127.0.22.137:34809 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:34809): Connection reset by peer (error 104) W0301 23:04:30.202718 19024 connection.cc:647] server connection from 127.0.22.137:45509 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:45509): Connection reset by peer (error 104) I0301 23:04:30.202852 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 20257 W0301 23:04:30.206403 18898 connection.cc:647] server connection from 127.0.22.138:39755 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:39755): Connection reset by peer (error 104) W0301 23:04:30.206430 18961 connection.cc:647] server connection from 127.0.22.138:34623 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:34623): Connection reset by peer (error 104) W0301 23:04:30.206511 19022 connection.cc:647] server connection from 127.0.22.138:33141 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:33141): Connection reset by peer (error 104) I0301 23:04:30.206624 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 20385 I0301 23:04:30.209869 22057 heartbeater.cc:466] Master 127.0.22.188:41299 was elected leader, sending a full tablet report... W0301 23:04:30.210126 18897 connection.cc:647] server connection from 127.0.22.139:44169 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:44169): Connection reset by peer (error 104) W0301 23:04:30.210212 19023 connection.cc:647] server connection from 127.0.22.139:36993 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:36993): Connection reset by peer (error 104) W0301 23:04:30.210340 18962 connection.cc:647] server connection from 127.0.22.139:34919 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:34919): Connection reset by peer (error 104) I0301 23:04:30.210490 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 20516 W0301 23:04:30.213230 18960 connection.cc:647] server connection from 127.0.22.140:58419 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:58419): Connection reset by peer (error 104) W0301 23:04:30.213258 18897 connection.cc:647] server connection from 127.0.22.140:57907 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:57907): Connection reset by peer (error 104) W0301 23:04:30.213337 19021 connection.cc:647] server connection from 127.0.22.140:53545 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:53545): Connection reset by peer (error 104) I0301 23:04:30.213469 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 20645 W0301 23:04:30.216409 18897 connection.cc:647] server connection from 127.0.22.141:45003 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:45003): Connection reset by peer (error 104) W0301 23:04:30.216439 18959 connection.cc:647] server connection from 127.0.22.141:39147 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:39147): Connection reset by peer (error 104) W0301 23:04:30.216506 19021 connection.cc:647] server connection from 127.0.22.141:44389 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:44389): Connection reset by peer (error 104) I0301 23:04:30.216610 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 20777 W0301 23:04:30.219368 18961 connection.cc:647] server connection from 127.0.22.142:40489 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:40489): Connection reset by peer (error 104) W0301 23:04:30.219403 18897 connection.cc:647] server connection from 127.0.22.142:44679 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:44679): Connection reset by peer (error 104) W0301 23:04:30.219467 19021 connection.cc:647] server connection from 127.0.22.142:44197 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:44197): Connection reset by peer (error 104) I0301 23:04:30.219576 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 20903 W0301 23:04:30.222874 19022 connection.cc:647] server connection from 127.0.22.143:36741 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:36741): Connection reset by peer (error 104) W0301 23:04:30.222888 18898 connection.cc:647] server connection from 127.0.22.143:35911 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:35911): Connection reset by peer (error 104) I0301 23:04:30.222949 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 21035 W0301 23:04:30.223445 18960 connection.cc:647] server connection from 127.0.22.143:55869 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:55869): Connection reset by peer (error 104) W0301 23:04:30.225333 18961 connection.cc:647] server connection from 127.0.22.144:54943 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:54943): Connection reset by peer (error 104) W0301 23:04:30.225358 18900 connection.cc:647] server connection from 127.0.22.144:34377 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:34377): Connection reset by peer (error 104) W0301 23:04:30.225376 19024 connection.cc:647] server connection from 127.0.22.144:36147 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:36147): Connection reset by peer (error 104) I0301 23:04:30.225446 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 21164 W0301 23:04:30.227675 18960 connection.cc:647] server connection from 127.0.22.145:53667 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.145:53667): Connection reset by peer (error 104) W0301 23:04:30.227687 18900 connection.cc:647] server connection from 127.0.22.145:40587 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.145:40587): Connection reset by peer (error 104) W0301 23:04:30.227705 19024 connection.cc:647] server connection from 127.0.22.145:40701 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.145:40701): Connection reset by peer (error 104) I0301 23:04:30.227802 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 21293 W0301 23:04:30.230139 18897 connection.cc:647] server connection from 127.0.22.146:49003 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.146:49003): Connection reset by peer (error 104) W0301 23:04:30.230157 18960 connection.cc:647] server connection from 127.0.22.146:45425 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.146:45425): Connection reset by peer (error 104) W0301 23:04:30.230197 19023 connection.cc:647] server connection from 127.0.22.146:53123 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.146:53123): Connection reset by peer (error 104) I0301 23:04:30.230312 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 21421 W0301 23:04:30.233330 18959 connection.cc:647] server connection from 127.0.22.147:38745 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.147:38745): Connection reset by peer (error 104) W0301 23:04:30.233335 18900 connection.cc:647] server connection from 127.0.22.147:60715 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.147:60715): Connection reset by peer (error 104) W0301 23:04:30.233345 19022 connection.cc:647] server connection from 127.0.22.147:49339 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.147:49339): Connection reset by peer (error 104) I0301 23:04:30.233479 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 21548 W0301 23:04:30.235877 18898 connection.cc:647] server connection from 127.0.22.148:36939 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.148:36939): Connection reset by peer (error 104) W0301 23:04:30.235896 18960 connection.cc:647] server connection from 127.0.22.148:49881 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.148:49881): Connection reset by peer (error 104) I0301 23:04:30.235987 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 21679 W0301 23:04:30.235985 19021 connection.cc:647] server connection from 127.0.22.148:49007 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.148:49007): Connection reset by peer (error 104) W0301 23:04:30.238360 18898 connection.cc:647] server connection from 127.0.22.149:59263 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.149:59263): Connection reset by peer (error 104) W0301 23:04:30.238374 18962 connection.cc:647] server connection from 127.0.22.149:33493 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.149:33493): Connection reset by peer (error 104) W0301 23:04:30.238467 19021 connection.cc:647] server connection from 127.0.22.149:48705 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.149:48705): Connection reset by peer (error 104) I0301 23:04:30.238507 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 21806 W0301 23:04:30.240887 18962 connection.cc:647] server connection from 127.0.22.150:50687 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.150:50687): Connection reset by peer (error 104) W0301 23:04:30.240923 18898 connection.cc:647] server connection from 127.0.22.150:57049 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.150:57049): Connection reset by peer (error 104) W0301 23:04:30.240932 19022 connection.cc:647] server connection from 127.0.22.150:59379 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.150:59379): Connection reset by peer (error 104) I0301 23:04:30.240986 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 21935 W0301 23:04:30.243239 18897 connection.cc:647] server connection from 127.0.22.151:57303 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.151:57303): Connection reset by peer (error 104) W0301 23:04:30.243254 18960 connection.cc:647] server connection from 127.0.22.151:50649 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.151:50649): Connection reset by peer (error 104) W0301 23:04:30.243275 19024 connection.cc:647] server connection from 127.0.22.151:57461 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.151:57461): Connection reset by peer (error 104) I0301 23:04:30.243360 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 22064 W0301 23:04:30.245945 18897 connection.cc:647] server connection from 127.0.22.152:32955 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.152:32955): Connection reset by peer (error 104) W0301 23:04:30.245952 18961 connection.cc:647] server connection from 127.0.22.152:53025 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.152:53025): Connection reset by peer (error 104) W0301 23:04:30.245985 19021 connection.cc:647] server connection from 127.0.22.152:43503 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.152:43503): Connection reset by peer (error 104) I0301 23:04:30.246037 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 22193 W0301 23:04:30.248625 18959 connection.cc:647] server connection from 127.0.22.153:50037 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.153:50037): Connection reset by peer (error 104) W0301 23:04:30.248636 18898 connection.cc:647] server connection from 127.0.22.153:54375 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.153:54375): Connection reset by peer (error 104) W0301 23:04:30.248656 19021 connection.cc:647] server connection from 127.0.22.153:58107 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.153:58107): Connection reset by peer (error 104) I0301 23:04:30.248725 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 22324 W0301 23:04:30.251020 18897 connection.cc:647] server connection from 127.0.22.154:58399 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.154:58399): Connection reset by peer (error 104) W0301 23:04:30.251047 18962 connection.cc:647] server connection from 127.0.22.154:35015 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.154:35015): Connection reset by peer (error 104) W0301 23:04:30.251108 19022 connection.cc:647] server connection from 127.0.22.154:40899 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.154:40899): Connection reset by peer (error 104) I0301 23:04:30.251128 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 22454 W0301 23:04:30.253252 18898 connection.cc:647] server connection from 127.0.22.155:50967 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.155:50967): Connection reset by peer (error 104) W0301 23:04:30.253252 18960 connection.cc:647] server connection from 127.0.22.155:44599 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.155:44599): Connection reset by peer (error 104) W0301 23:04:30.253263 19024 connection.cc:647] server connection from 127.0.22.155:60965 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.155:60965): Connection reset by peer (error 104) I0301 23:04:30.253368 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 22580 W0301 23:04:30.255774 18898 connection.cc:647] server connection from 127.0.22.156:49503 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.156:49503): Connection reset by peer (error 104) W0301 23:04:30.255796 18959 connection.cc:647] server connection from 127.0.22.156:50763 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.156:50763): Connection reset by peer (error 104) W0301 23:04:30.255820 19021 connection.cc:647] server connection from 127.0.22.156:35151 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.156:35151): Connection reset by peer (error 104) I0301 23:04:30.255875 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 22710 W0301 23:04:30.258216 18899 connection.cc:647] server connection from 127.0.22.157:43521 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.157:43521): Connection reset by peer (error 104) W0301 23:04:30.258234 18962 connection.cc:647] server connection from 127.0.22.157:50853 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.157:50853): Connection reset by peer (error 104) W0301 23:04:30.258260 19024 connection.cc:647] server connection from 127.0.22.157:36233 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.157:36233): Connection reset by peer (error 104) I0301 23:04:30.258399 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 22838 W0301 23:04:30.261240 19024 connection.cc:647] server connection from 127.0.22.158:50029 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.158:50029): Connection reset by peer (error 104) W0301 23:04:30.261241 18897 connection.cc:647] server connection from 127.0.22.158:56489 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.158:56489): Connection reset by peer (error 104) W0301 23:04:30.261243 18962 connection.cc:647] server connection from 127.0.22.158:51921 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.158:51921): Connection reset by peer (error 104) I0301 23:04:30.261302 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 22970 W0301 23:04:30.263507 18959 connection.cc:647] server connection from 127.0.22.159:39967 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.159:39967): Connection reset by peer (error 104) W0301 23:04:30.263522 18897 connection.cc:647] server connection from 127.0.22.159:58241 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.159:58241): Connection reset by peer (error 104) W0301 23:04:30.263545 19022 connection.cc:647] server connection from 127.0.22.159:37349 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.159:37349): Connection reset by peer (error 104) I0301 23:04:30.263635 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 23096 W0301 23:04:30.266180 18900 connection.cc:647] server connection from 127.0.22.160:33079 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.160:33079): Connection reset by peer (error 104) W0301 23:04:30.266189 18959 connection.cc:647] server connection from 127.0.22.160:59789 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.160:59789): Connection reset by peer (error 104) W0301 23:04:30.266245 19024 connection.cc:647] server connection from 127.0.22.160:44063 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.160:44063): Connection reset by peer (error 104) I0301 23:04:30.266258 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 18890 W0301 23:04:30.269397 18889 connection.cc:647] client connection to 127.0.22.190:40937 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:40937): Connection reset by peer (error 104) W0301 23:04:30.269409 19023 connection.cc:647] server connection from 127.0.0.1:52544 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:52544): Connection reset by peer (error 104) W0301 23:04:30.269454 18959 connection.cc:647] client connection to 127.0.22.190:40937 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:40937): Connection reset by peer (error 104) W0301 23:04:30.269412 19021 connection.cc:647] client connection to 127.0.22.190:40937 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:40937): Connection reset by peer (error 104) W0301 23:04:30.269572 18959 connection.cc:647] server connection from 127.0.0.1:36950 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36950): Connection reset by peer (error 104) I0301 23:04:30.269621 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 18952 W0301 23:04:30.272106 18889 connection.cc:647] client connection to 127.0.22.189:40771 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:40771): Connection reset by peer (error 104) W0301 23:04:30.272135 19022 connection.cc:647] server connection from 127.0.0.1:52542 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:52542): Connection reset by peer (error 104) W0301 23:04:30.272163 19023 connection.cc:647] client connection to 127.0.22.189:40771 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:40771): Connection reset by peer (error 104) I0301 23:04:30.272395 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 19014 W0301 23:04:30.274724 18889 connection.cc:647] client connection to 127.0.22.188:41299 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.188:41299): Connection reset by peer (error 104) I0301 23:04:30.275002 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:40937 --webserver_interface=127.0.22.190 --webserver_port=41845 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.285646 23230 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.285732 23230 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:30.286514 23230 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:30.286535 23230 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.286538 23230 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:30.286541 23230 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:30.287531 23230 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.190:40937 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.22.190 --webserver_port=41845 --never_fsync=true --heap_profile_path=/tmp/kudu-master.23230 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.288313 23230 master_main.cc:80] Initializing master server... I0301 23:04:30.288470 23230 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.288566 23230 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.288597 23230 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.289255 23230 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.289463 23230 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.289527 23230 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.290045 23230 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.290177 23230 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal uuid: "4821875d4f024436a7bad3af9f50cfa0" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.290210 23230 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.307921 23230 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.308064 23230 master_main.cc:83] Starting Master server... I0301 23:04:30.309509 23230 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.190:40937 I0301 23:04:30.309551 23230 webserver.cc:175] Starting webserver on 127.0.22.190:41845 I0301 23:04:30.309556 23230 webserver.cc:186] Document root disabled I0301 23:04:30.309660 23230 webserver.cc:313] Webserver started. Bound to: http://127.0.22.190:41845/ I0301 23:04:30.309783 23230 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-0/data/info.pb I0301 23:04:30.310343 23289 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:30.310601 23289 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: Bootstrap starting. I0301 23:04:30.316102 23289 log.cc:525] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: Log is configured to *not* fsync() on all Append() calls I0301 23:04:30.316623 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 23230 I0301 23:04:30.316754 23289 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:30.316790 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:40771 --webserver_interface=127.0.22.189 --webserver_port=46045 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 with env {} I0301 23:04:30.316977 23289 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: Bootstrap complete. I0301 23:04:30.319202 23289 raft_consensus.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:30.319229 23289 raft_consensus.cc:705] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4821875d4f024436a7bad3af9f50cfa0, State: Initialized, Role: FOLLOWER I0301 23:04:30.319286 23289 consensus_queue.cc:229] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:30.319370 23289 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:30.319399 23289 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:30.319427 23289 sys_catalog.cc:424] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:30.319710 23230 master_main.cc:86] Master server successfully started. I0301 23:04:30.324250 23292 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:30.324275 23292 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:30.325224 23293 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: acquiring CA information for follower catalog manager: success I0301 23:04:30.325338 23293 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.340329 23291 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.340426 23291 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:30.341199 23291 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:30.341223 23291 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.341229 23291 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:30.341235 23291 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:30.342263 23291 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.189:40771 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/info.pb --webserver_interface=127.0.22.189 --webserver_port=46045 --never_fsync=true --heap_profile_path=/tmp/kudu-master.23291 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.343027 23291 master_main.cc:80] Initializing master server... I0301 23:04:30.343163 23291 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.343257 23291 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.343291 23291 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.343981 23291 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:30.344207 23291 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.344295 23291 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.344822 23291 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.344947 23291 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal uuid: "78ca695677d34addb25f9e1b667f9608" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.344976 23291 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.382897 23291 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.383039 23291 master_main.cc:83] Starting Master server... I0301 23:04:30.385221 23291 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.189:40771 I0301 23:04:30.385272 23291 webserver.cc:175] Starting webserver on 127.0.22.189:46045 I0301 23:04:30.385277 23291 webserver.cc:186] Document root disabled I0301 23:04:30.385416 23291 webserver.cc:313] Webserver started. Bound to: http://127.0.22.189:46045/ I0301 23:04:30.385545 23291 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-1/data/info.pb I0301 23:04:30.386004 23353 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:30.386255 23353 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: Bootstrap starting. I0301 23:04:30.391695 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 23291 I0301 23:04:30.391707 23353 log.cc:525] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: Log is configured to *not* fsync() on all Append() calls I0301 23:04:30.391883 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:41299 --webserver_interface=127.0.22.188 --webserver_port=46663 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 with env {} I0301 23:04:30.392359 23353 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:30.392590 23353 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: Bootstrap complete. I0301 23:04:30.394830 23353 raft_consensus.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:30.394861 23353 raft_consensus.cc:705] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78ca695677d34addb25f9e1b667f9608, State: Initialized, Role: FOLLOWER I0301 23:04:30.394934 23353 consensus_queue.cc:229] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:30.395041 23353 sys_catalog.cc:337] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:30.395052 23356 sys_catalog.cc:337] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:30.395076 23353 sys_catalog.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:30.395081 23356 sys_catalog.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:30.395109 23353 sys_catalog.cc:424] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:30.395361 23291 master_main.cc:86] Master server successfully started. I0301 23:04:30.396948 23357 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: acquiring CA information for follower catalog manager: success I0301 23:04:30.397068 23357 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.413635 23355 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.413725 23355 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:30.414527 23355 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0301 23:04:30.414551 23355 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.414557 23355 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0301 23:04:30.414563 23355 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0301 23:04:30.415560 23355 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal --ipki_ca_key_size=1024 --master_addresses=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --location_mapping_cmd=/tmp/dist-test-task3pD_4V/build/release/bin/testdata/assign-location.py --state_store=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/location-assignment.state --map /L0:3 --map /L1:19 --map /L2:1 --map /L3:2 --map /L4:6 --map /L5:1 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.22.188:41299 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/info.pb --webserver_interface=127.0.22.188 --webserver_port=46663 --never_fsync=true --heap_profile_path=/tmp/kudu-master.23355 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.420408 23355 master_main.cc:80] Initializing master server... I0301 23:04:30.420552 23355 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.420652 23355 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.420689 23355 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.424404 23355 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.001s sys 0.000s I0301 23:04:30.424630 23355 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.424708 23355 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.425444 23355 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.425590 23355 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal uuid: "0c06f2d078ab4153a85d26a82e136b78" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.425631 23355 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.481474 23355 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.481649 23355 master_main.cc:83] Starting Master server... I0301 23:04:30.484310 23355 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.188:41299 I0301 23:04:30.484374 23355 webserver.cc:175] Starting webserver on 127.0.22.188:46663 I0301 23:04:30.484402 23355 webserver.cc:186] Document root disabled I0301 23:04:30.484526 23355 webserver.cc:313] Webserver started. Bound to: http://127.0.22.188:46663/ I0301 23:04:30.484678 23355 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/master-2/data/info.pb I0301 23:04:30.487681 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master as pid 23355 I0301 23:04:30.487838 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.22.129:39109 --local_ip_for_outbound_sockets=127.0.22.129 --webserver_port=38775 --webserver_interface=127.0.22.129 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:30.488801 23417 sys_catalog.cc:188] Verifying existing consensus state I0301 23:04:30.489140 23417 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: Bootstrap starting. I0301 23:04:30.502569 23417 log.cc:525] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: Log is configured to *not* fsync() on all Append() calls I0301 23:04:30.508693 23417 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=2 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0301 23:04:30.508873 23417 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: Bootstrap complete. I0301 23:04:30.510987 23417 raft_consensus.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:30.511013 23417 raft_consensus.cc:705] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c06f2d078ab4153a85d26a82e136b78, State: Initialized, Role: FOLLOWER I0301 23:04:30.511075 23417 consensus_queue.cc:229] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:30.511183 23417 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:30.511206 23417 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:30.511236 23417 sys_catalog.cc:424] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: configured and running, proceeding with master startup. I0301 23:04:30.511584 23355 master_main.cc:86] Master server successfully started. WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.512436 23418 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.512529 23418 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:30.513204 23418 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.513231 23418 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.129 I0301 23:04:30.514081 23418 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.129:39109 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.22.129 --webserver_port=38775 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.23418 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.129 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.514873 23418 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:30.515005 23418 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.515071 23418 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.515099 23418 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.515650 23420 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:30.515673 23420 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:30.520664 23421 catalog_manager.cc:1102] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: acquiring CA information for follower catalog manager: success I0301 23:04:30.520771 23421 catalog_manager.cc:1130] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0 I0301 23:04:30.524392 23418 fs_manager.cc:399] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s I0301 23:04:30.524529 23418 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.524605 23418 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.525177 23418 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.525324 23418 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal uuid: "9372ea079b17477c88e757060a70ac25" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.525360 23418 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.546600 23418 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.546794 23418 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:30.546855 23418 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:30.551007 23418 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.129:39109 I0301 23:04:30.551059 23418 webserver.cc:175] Starting webserver on 127.0.22.129:38775 I0301 23:04:30.551074 23418 webserver.cc:186] Document root disabled I0301 23:04:30.551203 23418 webserver.cc:313] Webserver started. Bound to: http://127.0.22.129:38775/ I0301 23:04:30.551331 23418 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-0/data/info.pb I0301 23:04:30.552436 23418 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:30.553632 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 23418 I0301 23:04:30.553802 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.22.130:45379 --local_ip_for_outbound_sockets=127.0.22.130 --webserver_port=38259 --webserver_interface=127.0.22.130 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:30.556064 23543 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:30.556087 23543 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.556118 23543 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:30.558992 23541 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:30.559015 23541 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.559047 23541 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:30.570679 23542 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:30.570703 23542 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.570744 23542 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.587954 23551 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.588045 23551 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0301 23:04:30.595558 23320 ts_manager.cc:98] Registered new tserver with Master: 9372ea079b17477c88e757060a70ac25 (127.0.22.129:39109) W0301 23:04:30.600863 23551 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.600898 23551 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.130 I0301 23:04:30.601755 23551 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.130:45379 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.22.130 --webserver_port=38259 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.23551 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.130 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.602599 23551 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:30.602757 23551 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.602846 23551 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.602891 23551 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.612493 23551 fs_manager.cc:399] Time spent opening directory manager: real 0.009s user 0.001s sys 0.000s I0301 23:04:30.612627 23551 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.612690 23551 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.613200 23551 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.613342 23551 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal uuid: "1e01396338ed4503bfc9089554272f8a" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.613373 23551 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.631412 23383 ts_manager.cc:98] Registered new tserver with Master: 9372ea079b17477c88e757060a70ac25 (127.0.22.129:39109) I0301 23:04:30.634032 23551 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.634230 23551 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:30.634292 23551 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:30.637338 23551 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.130:45379 I0301 23:04:30.637408 23551 webserver.cc:175] Starting webserver on 127.0.22.130:38259 I0301 23:04:30.637416 23551 webserver.cc:186] Document root disabled I0301 23:04:30.637532 23551 webserver.cc:313] Webserver started. Bound to: http://127.0.22.130:38259/ I0301 23:04:30.637650 23551 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-1/data/info.pb I0301 23:04:30.637917 23251 ts_manager.cc:98] Registered new tserver with Master: 9372ea079b17477c88e757060a70ac25 (127.0.22.129:39109) I0301 23:04:30.637959 23551 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:30.644066 23673 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:30.644093 23673 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.644134 23673 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:30.644322 23675 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:30.644362 23675 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.644412 23675 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:30.645992 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 23551 I0301 23:04:30.646200 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.22.131:35325 --local_ip_for_outbound_sockets=127.0.22.131 --webserver_port=43655 --webserver_interface=127.0.22.131 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:30.646843 23674 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:30.646870 23674 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.646925 23674 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.677352 23682 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.677536 23682 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:30.678689 23682 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.678730 23682 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.131 I0301 23:04:30.680522 23682 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.131:35325 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.22.131 --webserver_port=43655 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.23682 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.131 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.681732 23682 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:30.681946 23682 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.682040 23682 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.682081 23682 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.683650 23383 ts_manager.cc:98] Registered new tserver with Master: 1e01396338ed4503bfc9089554272f8a (127.0.22.130:45379) I0301 23:04:30.684131 23682 fs_manager.cc:399] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s I0301 23:04:30.684327 23682 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.684445 23682 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.685123 23682 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.685328 23682 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal uuid: "6f458d9b7bc04774935e3e8a7e68343e" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.685417 23682 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.695125 23251 ts_manager.cc:98] Registered new tserver with Master: 1e01396338ed4503bfc9089554272f8a (127.0.22.130:45379) I0301 23:04:30.699651 23320 ts_manager.cc:98] Registered new tserver with Master: 1e01396338ed4503bfc9089554272f8a (127.0.22.130:45379) I0301 23:04:30.721426 23682 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.721611 23682 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:30.721659 23682 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:30.725466 23682 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.131:35325 I0301 23:04:30.725524 23682 webserver.cc:175] Starting webserver on 127.0.22.131:43655 I0301 23:04:30.725546 23682 webserver.cc:186] Document root disabled I0301 23:04:30.725678 23682 webserver.cc:313] Webserver started. Bound to: http://127.0.22.131:43655/ I0301 23:04:30.725800 23682 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-2/data/info.pb I0301 23:04:30.726119 23682 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:30.729658 23804 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:30.729696 23804 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.729712 23802 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:30.729732 23802 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.729768 23802 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:30.729848 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 23682 I0301 23:04:30.730063 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.22.132:35241 --local_ip_for_outbound_sockets=127.0.22.132 --webserver_port=43723 --webserver_interface=127.0.22.132 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:30.730089 23803 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:30.730111 23803 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.730142 23803 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:30.730922 23804 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.765816 23809 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.765913 23809 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:30.766603 23809 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.766634 23809 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.132 I0301 23:04:30.767503 23809 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.132:35241 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.22.132 --webserver_port=43723 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.23809 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.132 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.780350 23809 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:30.780534 23809 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.780616 23809 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.780650 23809 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.781376 23809 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:04:30.781522 23809 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.781585 23809 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.782119 23809 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.782256 23809 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal uuid: "9be02b18019d4208a726de5b4ff80007" format_stamp: "Formatted at 2019-03-01 23:04:26 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.782289 23809 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.808257 23383 ts_manager.cc:98] Registered new tserver with Master: 6f458d9b7bc04774935e3e8a7e68343e (127.0.22.131:35325) I0301 23:04:30.811290 23320 ts_manager.cc:98] Registered new tserver with Master: 6f458d9b7bc04774935e3e8a7e68343e (127.0.22.131:35325) I0301 23:04:30.813699 23809 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.813915 23809 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:30.813985 23809 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:30.814420 23251 ts_manager.cc:98] Registered new tserver with Master: 6f458d9b7bc04774935e3e8a7e68343e (127.0.22.131:35325) I0301 23:04:30.818269 23809 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.132:35241 I0301 23:04:30.818326 23809 webserver.cc:175] Starting webserver on 127.0.22.132:43723 I0301 23:04:30.818349 23809 webserver.cc:186] Document root disabled I0301 23:04:30.818485 23809 webserver.cc:313] Webserver started. Bound to: http://127.0.22.132:43723/ I0301 23:04:30.818608 23809 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-3/data/info.pb I0301 23:04:30.819007 23809 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:30.822165 23931 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:30.822182 23931 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.822219 23931 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:30.822465 23933 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:30.822487 23933 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.822517 23933 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:30.822705 23932 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:30.822729 23932 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.822758 23932 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:30.823935 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 23809 I0301 23:04:30.824088 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.22.133:44473 --local_ip_for_outbound_sockets=127.0.22.133 --webserver_port=40823 --webserver_interface=127.0.22.133 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.865352 23941 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.865451 23941 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:30.866127 23941 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.866154 23941 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.133 I0301 23:04:30.867039 23941 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.133:44473 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.22.133 --webserver_port=40823 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.23941 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.133 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.867828 23941 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:30.867978 23941 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.868043 23941 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.868069 23941 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.880779 23941 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.880908 23941 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.880982 23941 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.881552 23941 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.881693 23941 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal uuid: "5606457608894cb4b4fb65a81f586fa3" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.881727 23941 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.894876 23941 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.895095 23941 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:30.895241 23941 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:30.898502 23941 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.133:44473 I0301 23:04:30.898543 23941 webserver.cc:175] Starting webserver on 127.0.22.133:40823 I0301 23:04:30.898548 23941 webserver.cc:186] Document root disabled I0301 23:04:30.898671 23941 webserver.cc:313] Webserver started. Bound to: http://127.0.22.133:40823/ I0301 23:04:30.898798 23941 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-4/data/info.pb I0301 23:04:30.899263 23941 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:30.900156 23383 ts_manager.cc:98] Registered new tserver with Master: 9be02b18019d4208a726de5b4ff80007 (127.0.22.132:35241) I0301 23:04:30.903348 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 23941 I0301 23:04:30.903538 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data --block_manager=log --rpc_bind_addresses=127.0.22.134:38783 --local_ip_for_outbound_sockets=127.0.22.134 --webserver_port=41657 --webserver_interface=127.0.22.134 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:30.903851 24061 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:30.903864 24061 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.903899 24061 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:30.904032 24060 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:30.904044 24060 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.904072 24060 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:30.905185 24062 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:30.905211 24062 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.905243 24062 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:30.908916 23251 ts_manager.cc:98] Registered new tserver with Master: 9be02b18019d4208a726de5b4ff80007 (127.0.22.132:35241) I0301 23:04:30.909108 23320 ts_manager.cc:98] Registered new tserver with Master: 9be02b18019d4208a726de5b4ff80007 (127.0.22.132:35241) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:30.931510 24067 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:30.931605 24067 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:30.944416 24067 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:30.944449 24067 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.134 I0301 23:04:30.945314 24067 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.134:38783 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/info.pb --webserver_interface=127.0.22.134 --webserver_port=41657 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.24067 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.134 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:30.946097 24067 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:30.946288 24067 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51016us I0301 23:04:30.946424 24067 fs_manager.cc:263] Metadata directory not provided I0301 23:04:30.946454 24067 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:30.947145 24067 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:30.947283 24067 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:30.947356 24067 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:30.948107 24067 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:30.948318 24067 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal uuid: "ac6f7439d58b46d7a566ff1a9b44101a" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:30.948355 24067 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:30.969548 24067 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:30.969746 24067 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:30.969805 24067 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:30.973294 24067 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.134:38783 I0301 23:04:30.973353 24067 webserver.cc:175] Starting webserver on 127.0.22.134:41657 I0301 23:04:30.973376 24067 webserver.cc:186] Document root disabled I0301 23:04:30.973518 24067 webserver.cc:313] Webserver started. Bound to: http://127.0.22.134:41657/ I0301 23:04:30.973659 24067 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-5/data/info.pb I0301 23:04:30.974001 24067 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:30.977612 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 24067 I0301 23:04:30.977773 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data --block_manager=log --rpc_bind_addresses=127.0.22.135:33501 --local_ip_for_outbound_sockets=127.0.22.135 --webserver_port=46057 --webserver_interface=127.0.22.135 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:30.978334 24189 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:30.978408 24189 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.978489 24189 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:30.978440 24191 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:30.978565 24191 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.978627 24191 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:30.979663 24190 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:30.979689 24190 heartbeater.cc:425] Registering TS with master... I0301 23:04:30.979727 24190 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:30.996243 23256 ts_manager.cc:98] Registered new tserver with Master: 5606457608894cb4b4fb65a81f586fa3 (127.0.22.133:44473) I0301 23:04:30.998051 23383 ts_manager.cc:98] Registered new tserver with Master: 5606457608894cb4b4fb65a81f586fa3 (127.0.22.133:44473) I0301 23:04:31.001806 23319 ts_manager.cc:98] Registered new tserver with Master: 5606457608894cb4b4fb65a81f586fa3 (127.0.22.133:44473) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.012001 24196 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.012106 24196 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.017230 24196 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.017272 24196 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.135 I0301 23:04:31.018540 24196 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.135:33501 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/info.pb --webserver_interface=127.0.22.135 --webserver_port=46057 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.24196 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.135 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.019752 24196 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.019948 24196 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.020042 24196 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.020082 24196 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.022408 23251 ts_manager.cc:98] Registered new tserver with Master: ac6f7439d58b46d7a566ff1a9b44101a (127.0.22.134:38783) I0301 23:04:31.025074 24196 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:31.025213 24196 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.025274 24196 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.025771 24196 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.025918 24196 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal uuid: "f9006ac6f5b94d13991a9c3db920c8e0" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.025955 24196 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.036475 23384 ts_manager.cc:98] Registered new tserver with Master: ac6f7439d58b46d7a566ff1a9b44101a (127.0.22.134:38783) I0301 23:04:31.043092 23320 ts_manager.cc:98] Registered new tserver with Master: ac6f7439d58b46d7a566ff1a9b44101a (127.0.22.134:38783) I0301 23:04:31.085707 24196 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.085891 24196 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.085942 24196 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.091702 24196 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.135:33501 I0301 23:04:31.091745 24196 webserver.cc:175] Starting webserver on 127.0.22.135:46057 I0301 23:04:31.091749 24196 webserver.cc:186] Document root disabled I0301 23:04:31.091864 24196 webserver.cc:313] Webserver started. Bound to: http://127.0.22.135:46057/ I0301 23:04:31.091995 24196 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-6/data/info.pb I0301 23:04:31.092371 24196 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.095778 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 24196 I0301 23:04:31.095880 24320 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.095916 24320 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.095948 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data --block_manager=log --rpc_bind_addresses=127.0.22.136:37999 --local_ip_for_outbound_sockets=127.0.22.136 --webserver_port=40931 --webserver_interface=127.0.22.136 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.095957 24320 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.096372 24319 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.096415 24319 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.096467 24319 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.097234 24318 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.097246 24318 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.097277 24318 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.120761 24325 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.120882 24325 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.121923 24325 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.121966 24325 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.136 I0301 23:04:31.123231 24325 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.136:37999 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/info.pb --webserver_interface=127.0.22.136 --webserver_port=40931 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.24325 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.136 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.124887 23251 ts_manager.cc:98] Registered new tserver with Master: f9006ac6f5b94d13991a9c3db920c8e0 (127.0.22.135:33501) I0301 23:04:31.128096 24325 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.130066 24325 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.130169 24325 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.130213 24325 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.131125 24325 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:04:31.131259 24325 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.131331 24325 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.131848 24325 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.131999 24325 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal uuid: "3ccb825be2af42b39758c9b7117513b1" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.132035 24325 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.134264 23320 ts_manager.cc:98] Registered new tserver with Master: f9006ac6f5b94d13991a9c3db920c8e0 (127.0.22.135:33501) I0301 23:04:31.145718 23384 ts_manager.cc:98] Registered new tserver with Master: f9006ac6f5b94d13991a9c3db920c8e0 (127.0.22.135:33501) I0301 23:04:31.153093 24325 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.153302 24325 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.153368 24325 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.157423 24325 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.136:37999 I0301 23:04:31.157477 24325 webserver.cc:175] Starting webserver on 127.0.22.136:40931 I0301 23:04:31.157500 24325 webserver.cc:186] Document root disabled I0301 23:04:31.157626 24325 webserver.cc:313] Webserver started. Bound to: http://127.0.22.136:40931/ I0301 23:04:31.157747 24325 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-7/data/info.pb I0301 23:04:31.158126 24325 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.158159 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 24325 I0301 23:04:31.158342 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data --block_manager=log --rpc_bind_addresses=127.0.22.137:42289 --local_ip_for_outbound_sockets=127.0.22.137 --webserver_port=40891 --webserver_interface=127.0.22.137 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.161887 24449 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.161916 24449 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.161962 24449 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.161998 24447 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.162025 24447 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.162057 24447 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.162668 24448 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.162710 24448 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.162763 24448 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.182242 24454 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.182323 24454 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.183013 24454 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.183041 24454 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.137 I0301 23:04:31.183887 24454 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.137:42289 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/info.pb --webserver_interface=127.0.22.137 --webserver_port=40891 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.24454 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.137 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.196781 24454 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.196965 24454 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.197053 24454 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.197091 24454 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.197772 24454 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.197901 24454 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.197962 24454 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.198503 24454 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.198637 24454 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal uuid: "d82637cdddb54ef38463de251eec3be2" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.198668 24454 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.228996 24454 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.229261 24454 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.229315 24454 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.233646 24454 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.137:42289 I0301 23:04:31.233706 24454 webserver.cc:175] Starting webserver on 127.0.22.137:40891 I0301 23:04:31.233714 24454 webserver.cc:186] Document root disabled I0301 23:04:31.233860 24454 webserver.cc:313] Webserver started. Bound to: http://127.0.22.137:40891/ I0301 23:04:31.234004 24454 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-8/data/info.pb I0301 23:04:31.234817 24454 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.238832 24578 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.238848 24578 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.238884 24578 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.239151 24576 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.239181 24576 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.239217 24576 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.240741 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 24454 I0301 23:04:31.240918 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data --block_manager=log --rpc_bind_addresses=127.0.22.138:45883 --local_ip_for_outbound_sockets=127.0.22.138 --webserver_port=43041 --webserver_interface=127.0.22.138 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.240928 24577 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.240944 24577 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.240983 24577 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.242187 23251 ts_manager.cc:98] Registered new tserver with Master: 3ccb825be2af42b39758c9b7117513b1 (127.0.22.136:37999) I0301 23:04:31.250367 23384 ts_manager.cc:98] Registered new tserver with Master: 3ccb825be2af42b39758c9b7117513b1 (127.0.22.136:37999) I0301 23:04:31.251291 23320 ts_manager.cc:98] Registered new tserver with Master: 3ccb825be2af42b39758c9b7117513b1 (127.0.22.136:37999) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.263367 24583 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.263489 24583 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.268558 24583 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.268604 24583 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.138 I0301 23:04:31.269840 24583 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.138:45883 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/info.pb --webserver_interface=127.0.22.138 --webserver_port=43041 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.24583 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.138 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.271127 24583 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.271395 24583 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.271492 24583 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.271530 24583 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.276432 24583 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.000s sys 0.001s I0301 23:04:31.276592 24583 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.276671 24583 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.277315 24583 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.277498 24583 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal uuid: "8ee77f2f83d545ef96153a77aac9e5a3" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.277539 24583 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.277644 23256 ts_manager.cc:98] Registered new tserver with Master: d82637cdddb54ef38463de251eec3be2 (127.0.22.137:42289) I0301 23:04:31.287269 23383 ts_manager.cc:98] Registered new tserver with Master: d82637cdddb54ef38463de251eec3be2 (127.0.22.137:42289) I0301 23:04:31.292094 23319 ts_manager.cc:98] Registered new tserver with Master: d82637cdddb54ef38463de251eec3be2 (127.0.22.137:42289) I0301 23:04:31.299985 24583 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.300231 24583 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.300292 24583 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.304517 24583 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.138:45883 I0301 23:04:31.304572 24583 webserver.cc:175] Starting webserver on 127.0.22.138:43041 I0301 23:04:31.304589 24583 webserver.cc:186] Document root disabled I0301 23:04:31.304713 24583 webserver.cc:313] Webserver started. Bound to: http://127.0.22.138:43041/ I0301 23:04:31.304831 24583 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-9/data/info.pb I0301 23:04:31.305222 24583 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.305511 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 24583 I0301 23:04:31.305680 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data --block_manager=log --rpc_bind_addresses=127.0.22.139:41897 --local_ip_for_outbound_sockets=127.0.22.139 --webserver_port=45597 --webserver_interface=127.0.22.139 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.309741 24707 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.309759 24707 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.309787 24705 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.309794 24707 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.309820 24705 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.309856 24705 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.311621 24706 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.311648 24706 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.311687 24706 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.316973 24712 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.317059 24712 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.317791 24712 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.317827 24712 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.139 I0301 23:04:31.318720 24712 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.139:41897 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/info.pb --webserver_interface=127.0.22.139 --webserver_port=45597 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.24712 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.139 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.319572 24712 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.319738 24712 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.319821 24712 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.319854 24712 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.321219 24712 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.000s sys 0.000s I0301 23:04:31.321347 24712 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.321434 24712 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.321940 24712 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.322073 24712 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal uuid: "699a11f3afb9486ca3411c4c15d6f42b" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.322106 24712 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.337194 24712 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.337424 24712 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.337486 24712 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.340145 24712 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.139:41897 I0301 23:04:31.340860 24712 webserver.cc:175] Starting webserver on 127.0.22.139:45597 I0301 23:04:31.340880 24712 webserver.cc:186] Document root disabled I0301 23:04:31.341009 24712 webserver.cc:313] Webserver started. Bound to: http://127.0.22.139:45597/ I0301 23:04:31.341164 24712 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-10/data/info.pb I0301 23:04:31.341454 24712 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.345041 24834 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.345057 24834 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.345091 24834 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.345485 24835 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.345501 24835 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.345639 24835 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.347265 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 24712 I0301 23:04:31.347453 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data --block_manager=log --rpc_bind_addresses=127.0.22.140:39563 --local_ip_for_outbound_sockets=127.0.22.140 --webserver_port=37733 --webserver_interface=127.0.22.140 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.348816 24836 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.348913 24836 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.349017 24836 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.355288 23319 ts_manager.cc:98] Registered new tserver with Master: 8ee77f2f83d545ef96153a77aac9e5a3 (127.0.22.138:45883) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.386293 24840 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.386440 24840 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.387466 24840 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.387506 24840 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.140 I0301 23:04:31.391247 23256 ts_manager.cc:98] Registered new tserver with Master: 8ee77f2f83d545ef96153a77aac9e5a3 (127.0.22.138:45883) I0301 23:04:31.391716 24840 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.140:39563 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/info.pb --webserver_interface=127.0.22.140 --webserver_port=37733 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.24840 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.140 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.392813 24840 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.392959 24840 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.393050 24840 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.393088 24840 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.393985 24840 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.394150 24840 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.394220 24840 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.394829 24840 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.394999 24840 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal uuid: "30ffaef5ca2e465aa669c0105befbd8e" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.395033 24840 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.415527 24840 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.415743 24840 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.415805 24840 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.420902 24840 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.140:39563 I0301 23:04:31.420954 24840 webserver.cc:175] Starting webserver on 127.0.22.140:37733 I0301 23:04:31.420961 24840 webserver.cc:186] Document root disabled I0301 23:04:31.421092 24840 webserver.cc:313] Webserver started. Bound to: http://127.0.22.140:37733/ I0301 23:04:31.421221 24840 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-11/data/info.pb I0301 23:04:31.421631 24840 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.423480 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 24840 I0301 23:04:31.423665 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data --block_manager=log --rpc_bind_addresses=127.0.22.141:35933 --local_ip_for_outbound_sockets=127.0.22.141 --webserver_port=46309 --webserver_interface=127.0.22.141 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.425709 24961 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.425735 24961 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.425729 23251 ts_manager.cc:98] Registered new tserver with Master: 699a11f3afb9486ca3411c4c15d6f42b (127.0.22.139:41897) I0301 23:04:31.425774 24961 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.428205 24962 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.428230 24962 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.428263 24962 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.428431 24963 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.428509 24963 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.428587 24963 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.437044 24966 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.437170 24966 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.437870 24966 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.437904 24966 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.141 I0301 23:04:31.438787 24966 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.141:35933 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/info.pb --webserver_interface=127.0.22.141 --webserver_port=46309 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.24966 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.141 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.439600 24966 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.439764 24966 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.439851 24966 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.439884 24966 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.444432 24966 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.000s sys 0.000s I0301 23:04:31.444629 24966 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.444689 24966 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.445320 24966 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.445482 24966 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal uuid: "7612132055d74594899895a5eeb4253f" format_stamp: "Formatted at 2019-03-01 23:04:27 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.445509 24966 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.457646 24966 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.457887 24966 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.457967 24966 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.458731 23251 ts_manager.cc:98] Registered new tserver with Master: 30ffaef5ca2e465aa669c0105befbd8e (127.0.22.140:39563) I0301 23:04:31.463168 24966 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.141:35933 I0301 23:04:31.463248 24966 webserver.cc:175] Starting webserver on 127.0.22.141:46309 I0301 23:04:31.463265 24966 webserver.cc:186] Document root disabled I0301 23:04:31.463419 24966 webserver.cc:313] Webserver started. Bound to: http://127.0.22.141:46309/ I0301 23:04:31.463547 24966 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-12/data/info.pb I0301 23:04:31.464521 24966 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.467509 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 24966 I0301 23:04:31.467674 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data --block_manager=log --rpc_bind_addresses=127.0.22.142:35923 --local_ip_for_outbound_sockets=127.0.22.142 --webserver_port=44225 --webserver_interface=127.0.22.142 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.467862 25090 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.467887 25090 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.467934 25090 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.468519 25089 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.468586 25089 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.468677 25089 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.469144 25088 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.469167 25088 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.469226 25088 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.474689 23383 ts_manager.cc:98] Registered new tserver with Master: 8ee77f2f83d545ef96153a77aac9e5a3 (127.0.22.138:45883) I0301 23:04:31.475527 23320 ts_manager.cc:98] Registered new tserver with Master: 699a11f3afb9486ca3411c4c15d6f42b (127.0.22.139:41897) I0301 23:04:31.501916 23318 ts_manager.cc:98] Registered new tserver with Master: 7612132055d74594899895a5eeb4253f (127.0.22.141:35933) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.504415 25095 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.504511 25095 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.505262 25095 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.505296 25095 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.142 I0301 23:04:31.506193 25095 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.142:35923 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/info.pb --webserver_interface=127.0.22.142 --webserver_port=44225 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.25095 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.142 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.507015 25095 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.507169 25095 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.507258 25095 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.507295 25095 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.512431 25095 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.001s sys 0.000s I0301 23:04:31.512588 25095 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.512667 25095 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.513428 25095 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.513579 25095 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal uuid: "24429722b62a4bfda2c0d772df9fc71a" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.513620 25095 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.536651 23319 ts_manager.cc:98] Registered new tserver with Master: 30ffaef5ca2e465aa669c0105befbd8e (127.0.22.140:39563) I0301 23:04:31.547555 23251 ts_manager.cc:98] Registered new tserver with Master: 7612132055d74594899895a5eeb4253f (127.0.22.141:35933) I0301 23:04:31.547652 23381 ts_manager.cc:98] Registered new tserver with Master: 7612132055d74594899895a5eeb4253f (127.0.22.141:35933) I0301 23:04:31.560458 25111 raft_consensus.cc:472] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0301 23:04:31.560544 25111 raft_consensus.cc:494] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:31.561362 25111 leader_election.cc:292] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 78ca695677d34addb25f9e1b667f9608 (127.0.22.189:40771), 0c06f2d078ab4153a85d26a82e136b78 (127.0.22.188:41299) I0301 23:04:31.565698 23393 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4821875d4f024436a7bad3af9f50cfa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c06f2d078ab4153a85d26a82e136b78" is_pre_election: true I0301 23:04:31.565708 23330 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4821875d4f024436a7bad3af9f50cfa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "78ca695677d34addb25f9e1b667f9608" is_pre_election: true I0301 23:04:31.565739 23393 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4821875d4f024436a7bad3af9f50cfa0 in term 1. I0301 23:04:31.565739 23330 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4821875d4f024436a7bad3af9f50cfa0 in term 1. I0301 23:04:31.565884 23239 leader_election.cc:306] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4821875d4f024436a7bad3af9f50cfa0, 78ca695677d34addb25f9e1b667f9608; no voters: I0301 23:04:31.566009 25111 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Leader pre-election won for term 2 I0301 23:04:31.566030 25111 raft_consensus.cc:472] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0301 23:04:31.566038 25111 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 1 FOLLOWER]: Advancing to term 2 I0301 23:04:31.566964 25111 raft_consensus.cc:494] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:31.567204 23330 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4821875d4f024436a7bad3af9f50cfa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "78ca695677d34addb25f9e1b667f9608" I0301 23:04:31.567222 23330 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 1 FOLLOWER]: Advancing to term 2 I0301 23:04:31.567260 23393 tablet_service.cc:1010] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4821875d4f024436a7bad3af9f50cfa0" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0c06f2d078ab4153a85d26a82e136b78" I0301 23:04:31.567273 23393 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 1 FOLLOWER]: Advancing to term 2 I0301 23:04:31.568037 23393 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4821875d4f024436a7bad3af9f50cfa0 in term 2. I0301 23:04:31.568035 23330 raft_consensus.cc:2346] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4821875d4f024436a7bad3af9f50cfa0 in term 2. I0301 23:04:31.568269 23239 leader_election.cc:306] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c06f2d078ab4153a85d26a82e136b78, 4821875d4f024436a7bad3af9f50cfa0; no voters: I0301 23:04:31.568373 25111 leader_election.cc:292] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [CANDIDATE]: Term 2 election: Requested vote from peers 78ca695677d34addb25f9e1b667f9608 (127.0.22.189:40771), 0c06f2d078ab4153a85d26a82e136b78 (127.0.22.188:41299) I0301 23:04:31.568428 25111 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 2 FOLLOWER]: Leader election won for term 2 I0301 23:04:31.568444 25111 raft_consensus.cc:667] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [term 2 LEADER]: Becoming Leader. State: Replica: 4821875d4f024436a7bad3af9f50cfa0, State: Running, Role: LEADER I0301 23:04:31.568502 25111 consensus_queue.cc:206] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } I0301 23:04:31.568747 25114 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4821875d4f024436a7bad3af9f50cfa0. Latest consensus state: current_term: 2 leader_uuid: "4821875d4f024436a7bad3af9f50cfa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:31.568770 25114 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: LEADER I0301 23:04:31.568938 25095 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.569162 25095 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.569229 25095 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.570118 25116 catalog_manager.cc:1046] Loading table and tablet metadata into memory... I0301 23:04:31.570252 25116 catalog_manager.cc:1057] Initializing Kudu internal certificate authority... I0301 23:04:31.570469 25116 catalog_manager.cc:1066] Loading token signing keys... I0301 23:04:31.570523 25116 catalog_manager.cc:4106] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0: Loaded TSK: 0 I0301 23:04:31.574942 25095 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.142:35923 I0301 23:04:31.574996 25095 webserver.cc:175] Starting webserver on 127.0.22.142:44225 I0301 23:04:31.575007 25095 webserver.cc:186] Document root disabled I0301 23:04:31.575140 25095 webserver.cc:313] Webserver started. Bound to: http://127.0.22.142:44225/ I0301 23:04:31.575266 25095 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-13/data/info.pb I0301 23:04:31.575671 25095 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.579922 25227 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.579979 25227 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.580066 25227 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.581666 25225 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.581671 23382 ts_manager.cc:98] Registered new tserver with Master: 30ffaef5ca2e465aa669c0105befbd8e (127.0.22.140:39563) I0301 23:04:31.581684 25225 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.581887 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 25095 I0301 23:04:31.582039 25226 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.582053 25226 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.582062 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data --block_manager=log --rpc_bind_addresses=127.0.22.143:39163 --local_ip_for_outbound_sockets=127.0.22.143 --webserver_port=46623 --webserver_interface=127.0.22.143 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.582087 25226 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.582229 25225 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.627187 25233 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.627288 25233 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.640347 25233 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.640398 25233 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.143 I0301 23:04:31.641641 25233 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.143:39163 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/info.pb --webserver_interface=127.0.22.143 --webserver_port=46623 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.25233 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.143 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.642832 25233 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.643033 25233 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.643122 25233 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.643159 25233 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.644204 25233 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:31.644346 25233 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.644445 25233 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.645123 25233 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.645287 25233 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal uuid: "a2e75444df734432b1634d0d658460b9" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.645329 25233 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.675031 25233 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.675262 25233 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.675334 25233 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.680658 25233 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.143:39163 I0301 23:04:31.680788 25233 webserver.cc:175] Starting webserver on 127.0.22.143:46623 I0301 23:04:31.680857 25233 webserver.cc:186] Document root disabled I0301 23:04:31.681010 25233 webserver.cc:313] Webserver started. Bound to: http://127.0.22.143:46623/ I0301 23:04:31.681259 25233 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-14/data/info.pb I0301 23:04:31.682246 25233 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.684972 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 25233 I0301 23:04:31.685160 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data --block_manager=log --rpc_bind_addresses=127.0.22.144:36407 --local_ip_for_outbound_sockets=127.0.22.144 --webserver_port=34645 --webserver_interface=127.0.22.144 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.687736 25356 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.687813 25356 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.687979 25356 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.689326 25355 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.689441 25355 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.689550 25355 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.690121 25354 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.690196 25354 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.690289 25354 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.691588 23382 ts_manager.cc:98] Registered new tserver with Master: 24429722b62a4bfda2c0d772df9fc71a (127.0.22.142:35923) I0301 23:04:31.694628 23251 ts_manager.cc:98] Registered new tserver with Master: 24429722b62a4bfda2c0d772df9fc71a (127.0.22.142:35923) I0301 23:04:31.695693 23319 ts_manager.cc:98] Registered new tserver with Master: 24429722b62a4bfda2c0d772df9fc71a (127.0.22.142:35923) I0301 23:04:31.697525 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.142:43851 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.723703 25361 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.723799 25361 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.725816 25361 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.725855 25361 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.144 I0301 23:04:31.739046 25361 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.144:36407 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/info.pb --webserver_interface=127.0.22.144 --webserver_port=34645 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.25361 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.144 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.740289 25361 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.740492 25361 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.740613 25361 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.740651 25361 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.741567 25361 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:31.741739 25361 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.741868 25361 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.742605 25361 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.742777 25361 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal uuid: "5aa30ad144e94b9290474b283d15239b" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.742815 25361 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.775172 25361 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.775434 25361 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.775504 25361 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.780334 25361 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.144:36407 I0301 23:04:31.780402 25361 webserver.cc:175] Starting webserver on 127.0.22.144:34645 I0301 23:04:31.780414 25361 webserver.cc:186] Document root disabled I0301 23:04:31.780544 25361 webserver.cc:313] Webserver started. Bound to: http://127.0.22.144:34645/ I0301 23:04:31.780683 25361 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-15/data/info.pb I0301 23:04:31.781234 25361 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.786061 25485 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.786087 25485 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.786120 25484 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.786144 25484 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.786221 25484 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.786128 25485 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.787650 25483 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.787711 25483 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.787792 25483 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.789240 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 25361 I0301 23:04:31.789489 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data --block_manager=log --rpc_bind_addresses=127.0.22.145:35473 --local_ip_for_outbound_sockets=127.0.22.145 --webserver_port=40751 --webserver_interface=127.0.22.145 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.791255 23255 ts_manager.cc:98] Registered new tserver with Master: a2e75444df734432b1634d0d658460b9 (127.0.22.143:39163) I0301 23:04:31.794100 23255 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.143:58293 I0301 23:04:31.796314 23380 ts_manager.cc:98] Registered new tserver with Master: a2e75444df734432b1634d0d658460b9 (127.0.22.143:39163) I0301 23:04:31.796321 23320 ts_manager.cc:98] Registered new tserver with Master: a2e75444df734432b1634d0d658460b9 (127.0.22.143:39163) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.819022 25490 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.819108 25490 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.820150 25490 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.828342 25490 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.145 I0301 23:04:31.829399 25490 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.145:35473 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/info.pb --webserver_interface=127.0.22.145 --webserver_port=40751 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.25490 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.145 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.830332 25490 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.830487 25490 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.830549 25490 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.830585 25490 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.831248 25490 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:31.831403 25490 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.831468 25490 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.831845 23383 ts_manager.cc:98] Registered new tserver with Master: 5aa30ad144e94b9290474b283d15239b (127.0.22.144:36407) I0301 23:04:31.832144 25490 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.832342 25490 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal uuid: "0365389cd1e7443fa3125e104740a028" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.832396 25490 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.844488 25490 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.844694 25490 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.844758 25490 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.861951 25490 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.145:35473 I0301 23:04:31.862175 25490 webserver.cc:175] Starting webserver on 127.0.22.145:40751 I0301 23:04:31.862287 25490 webserver.cc:186] Document root disabled I0301 23:04:31.862874 25490 webserver.cc:313] Webserver started. Bound to: http://127.0.22.145:40751/ I0301 23:04:31.863579 25490 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-16/data/info.pb I0301 23:04:31.865458 25490 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.866156 23251 ts_manager.cc:98] Registered new tserver with Master: 5aa30ad144e94b9290474b283d15239b (127.0.22.144:36407) I0301 23:04:31.866972 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.144:55669 I0301 23:04:31.867012 23256 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.129:38283 I0301 23:04:31.867028 23255 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.131:49421 I0301 23:04:31.868757 23254 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.130:57957 I0301 23:04:31.870069 23317 ts_manager.cc:98] Registered new tserver with Master: 5aa30ad144e94b9290474b283d15239b (127.0.22.144:36407) I0301 23:04:31.872738 25613 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.872756 25613 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.872794 25613 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.873247 25616 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.873266 25616 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.873286 25614 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.873311 25614 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.873337 25616 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.873349 25614 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:31.873623 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 25490 I0301 23:04:31.873785 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data --block_manager=log --rpc_bind_addresses=127.0.22.146:33687 --local_ip_for_outbound_sockets=127.0.22.146 --webserver_port=37205 --webserver_interface=127.0.22.146 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.878449 23384 ts_manager.cc:98] Registered new tserver with Master: 699a11f3afb9486ca3411c4c15d6f42b (127.0.22.139:41897) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.887334 25620 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.887449 25620 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.888497 25620 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.888538 25620 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.146 I0301 23:04:31.889765 25620 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.146:33687 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/info.pb --webserver_interface=127.0.22.146 --webserver_port=37205 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.25620 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.146 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.890946 25620 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.891125 25620 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.891221 25620 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.891258 25620 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.892395 25620 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.001s sys 0.001s I0301 23:04:31.892542 25620 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.892612 25620 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.893283 25620 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.893435 25620 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal uuid: "8dae08811aa64ff8890b2f4b2be6ccf4" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.893472 25620 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:31.919049 25620 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:31.919273 25620 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:31.919340 25620 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:31.924656 25620 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.146:33687 I0301 23:04:31.924713 25620 webserver.cc:175] Starting webserver on 127.0.22.146:37205 I0301 23:04:31.924759 25620 webserver.cc:186] Document root disabled I0301 23:04:31.924927 25620 webserver.cc:313] Webserver started. Bound to: http://127.0.22.146:37205/ I0301 23:04:31.925053 25620 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-17/data/info.pb I0301 23:04:31.925364 25620 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:31.926196 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 25620 I0301 23:04:31.926369 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data --block_manager=log --rpc_bind_addresses=127.0.22.147:41519 --local_ip_for_outbound_sockets=127.0.22.147 --webserver_port=38071 --webserver_interface=127.0.22.147 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:31.929582 25742 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:31.929600 25742 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.929637 25742 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:31.929702 25744 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:31.929749 25744 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.929816 25744 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:31.946805 25743 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:31.946832 25743 heartbeater.cc:425] Registering TS with master... I0301 23:04:31.946874 25743 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:31.974555 25749 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:31.974651 25749 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:31.975623 25749 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:31.975658 25749 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.147 I0301 23:04:31.985551 23319 ts_manager.cc:98] Registered new tserver with Master: 0365389cd1e7443fa3125e104740a028 (127.0.22.145:35473) I0301 23:04:31.986140 25749 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.147:41519 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/info.pb --webserver_interface=127.0.22.147 --webserver_port=38071 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.25749 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.147 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:31.987246 25749 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:31.987434 25749 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 51516us I0301 23:04:31.987524 25749 fs_manager.cc:263] Metadata directory not provided I0301 23:04:31.987560 25749 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:31.991106 23254 ts_manager.cc:98] Registered new tserver with Master: 0365389cd1e7443fa3125e104740a028 (127.0.22.145:35473) I0301 23:04:31.991171 23381 ts_manager.cc:98] Registered new tserver with Master: 0365389cd1e7443fa3125e104740a028 (127.0.22.145:35473) I0301 23:04:31.991652 25749 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.001s sys 0.000s I0301 23:04:31.991782 25749 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:31.991838 25749 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:31.991919 23254 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.145:34429 I0301 23:04:31.991951 23255 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.132:37341 I0301 23:04:31.992516 25749 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:31.992651 25749 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal uuid: "cbd7bbaf5b4f4009824f0d72a28c7a0b" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:31.992688 25749 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.045951 25749 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.046209 25749 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.046278 25749 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.054780 25749 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.147:41519 I0301 23:04:32.054863 25749 webserver.cc:175] Starting webserver on 127.0.22.147:38071 I0301 23:04:32.054909 25749 webserver.cc:186] Document root disabled I0301 23:04:32.055109 25749 webserver.cc:313] Webserver started. Bound to: http://127.0.22.147:38071/ I0301 23:04:32.055254 25749 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-18/data/info.pb I0301 23:04:32.055591 25749 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.060132 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 25749 I0301 23:04:32.060354 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data --block_manager=log --rpc_bind_addresses=127.0.22.148:35887 --local_ip_for_outbound_sockets=127.0.22.148 --webserver_port=33125 --webserver_interface=127.0.22.148 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:32.062269 25872 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.062289 25872 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.062374 25872 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.063866 25873 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.063949 25873 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.064038 25873 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.064304 25871 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.064369 25871 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.064479 25871 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.097108 23320 ts_manager.cc:98] Registered new tserver with Master: 8dae08811aa64ff8890b2f4b2be6ccf4 (127.0.22.146:33687) I0301 23:04:32.097862 23393 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [term 2 FOLLOWER]: Refusing update from remote peer 4821875d4f024436a7bad3af9f50cfa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch) I0301 23:04:32.098230 25879 consensus_queue.cc:984] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s I0301 23:04:32.099064 25881 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4821875d4f024436a7bad3af9f50cfa0. Latest consensus state: current_term: 2 leader_uuid: "4821875d4f024436a7bad3af9f50cfa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:32.099213 25881 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:32.100414 23330 raft_consensus.cc:1181] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [term 2 FOLLOWER]: Refusing update from remote peer 4821875d4f024436a7bad3af9f50cfa0: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch) I0301 23:04:32.100867 25879 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "4821875d4f024436a7bad3af9f50cfa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:32.100944 25879 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: LEADER I0301 23:04:32.100976 25880 consensus_queue.cc:984] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s I0301 23:04:32.101243 25881 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "4821875d4f024436a7bad3af9f50cfa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:32.101588 25881 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0c06f2d078ab4153a85d26a82e136b78 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:32.102694 25893 sys_catalog.cc:337] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "4821875d4f024436a7bad3af9f50cfa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:32.102735 25890 sys_catalog.cc:337] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4821875d4f024436a7bad3af9f50cfa0. Latest consensus state: current_term: 2 leader_uuid: "4821875d4f024436a7bad3af9f50cfa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:32.102753 25893 sys_catalog.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:32.102751 25890 sys_catalog.cc:340] T 00000000000000000000000000000000 P 78ca695677d34addb25f9e1b667f9608 [sys.catalog]: This master's current role is: FOLLOWER I0301 23:04:32.105664 23380 ts_manager.cc:98] Registered new tserver with Master: 8dae08811aa64ff8890b2f4b2be6ccf4 (127.0.22.146:33687) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.107100 25878 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.107190 25878 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0301 23:04:32.108304 23256 ts_manager.cc:98] Registered new tserver with Master: 8dae08811aa64ff8890b2f4b2be6ccf4 (127.0.22.146:33687) I0301 23:04:32.109100 23256 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.146:51159 I0301 23:04:32.109112 23255 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.133:34895 I0301 23:04:32.111835 23254 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.134:57003 W0301 23:04:32.116219 25878 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.116261 25878 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.148 I0301 23:04:32.117583 25878 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.148:35887 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/info.pb --webserver_interface=127.0.22.148 --webserver_port=33125 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.25878 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.148 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.118813 25878 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.119015 25878 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.119115 25878 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.119158 25878 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.120306 25878 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:32.120625 25878 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.120745 25878 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.121491 25878 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.122047 25878 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal uuid: "b8d38d23869b4ab6b8c58ddc0231fc8f" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.122125 25878 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.134413 25878 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.134627 25878 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.134675 25878 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.138856 25878 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.148:35887 I0301 23:04:32.138900 25878 webserver.cc:175] Starting webserver on 127.0.22.148:33125 I0301 23:04:32.138922 25878 webserver.cc:186] Document root disabled I0301 23:04:32.139044 25878 webserver.cc:313] Webserver started. Bound to: http://127.0.22.148:33125/ I0301 23:04:32.139164 25878 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-19/data/info.pb I0301 23:04:32.139833 25878 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.144440 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 25878 I0301 23:04:32.144629 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data --block_manager=log --rpc_bind_addresses=127.0.22.149:38703 --local_ip_for_outbound_sockets=127.0.22.149 --webserver_port=40617 --webserver_interface=127.0.22.149 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:32.150532 26015 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.150651 26015 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.151027 26014 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.151051 26014 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.151131 26014 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.151140 26015 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.153318 26016 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.153336 26016 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.153471 26016 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.162447 23251 ts_manager.cc:98] Registered new tserver with Master: cbd7bbaf5b4f4009824f0d72a28c7a0b (127.0.22.147:41519) I0301 23:04:32.164772 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.147:57819 WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.172720 26021 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.172818 26021 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.173842 26021 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.173885 26021 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.149 I0301 23:04:32.175129 26021 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.149:38703 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/info.pb --webserver_interface=127.0.22.149 --webserver_port=40617 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.26021 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.149 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.175132 23316 ts_manager.cc:98] Registered new tserver with Master: cbd7bbaf5b4f4009824f0d72a28c7a0b (127.0.22.147:41519) I0301 23:04:32.176542 23382 ts_manager.cc:98] Registered new tserver with Master: cbd7bbaf5b4f4009824f0d72a28c7a0b (127.0.22.147:41519) I0301 23:04:32.188431 26021 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.188601 26021 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.188691 26021 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.188726 26021 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.189754 26021 fs_manager.cc:399] Time spent opening directory manager: real 0.001s user 0.001s sys 0.000s I0301 23:04:32.190052 26021 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.190142 26021 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.190927 26021 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.191241 26021 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal uuid: "1809bbd3e6ee4892b4f88f8c4dfc7631" format_stamp: "Formatted at 2019-03-01 23:04:28 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.191313 26021 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.220116 26021 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.220404 26021 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.220484 26021 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.226028 26021 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.149:38703 I0301 23:04:32.226083 26021 webserver.cc:175] Starting webserver on 127.0.22.149:40617 I0301 23:04:32.226104 26021 webserver.cc:186] Document root disabled I0301 23:04:32.226236 26021 webserver.cc:313] Webserver started. Bound to: http://127.0.22.149:40617/ I0301 23:04:32.226397 26021 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-20/data/info.pb I0301 23:04:32.226711 26021 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.231765 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 26021 I0301 23:04:32.231943 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data --block_manager=log --rpc_bind_addresses=127.0.22.150:33415 --local_ip_for_outbound_sockets=127.0.22.150 --webserver_port=39433 --webserver_interface=127.0.22.150 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:32.234076 26144 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.234107 26144 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.234148 26144 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.234192 26143 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.234206 26143 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.234230 26143 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.235612 26145 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.235697 26145 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.235797 26145 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.246254 26150 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.246348 26150 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.247319 26150 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.247356 26150 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.150 I0301 23:04:32.248661 26150 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.150:33415 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/info.pb --webserver_interface=127.0.22.150 --webserver_port=39433 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.26150 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.150 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.250365 26150 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.250581 26150 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.250672 26150 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.250746 26150 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.251711 26150 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:32.251866 26150 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.251945 26150 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.252691 26150 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.252882 26150 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal uuid: "ed2cf46582b1444e9f38162d39866c52" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.252936 26150 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.260493 23256 ts_manager.cc:98] Registered new tserver with Master: b8d38d23869b4ab6b8c58ddc0231fc8f (127.0.22.148:35887) I0301 23:04:32.261281 23256 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.148:41551 I0301 23:04:32.262377 23254 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.135:35459 I0301 23:04:32.262815 23255 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.136:57565 I0301 23:04:32.269207 23314 ts_manager.cc:98] Registered new tserver with Master: b8d38d23869b4ab6b8c58ddc0231fc8f (127.0.22.148:35887) I0301 23:04:32.270197 26150 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.270226 23379 ts_manager.cc:98] Registered new tserver with Master: b8d38d23869b4ab6b8c58ddc0231fc8f (127.0.22.148:35887) I0301 23:04:32.270550 26150 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.270614 26150 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.272990 26150 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.150:33415 I0301 23:04:32.273058 26150 webserver.cc:175] Starting webserver on 127.0.22.150:39433 I0301 23:04:32.273104 26150 webserver.cc:186] Document root disabled I0301 23:04:32.273226 26150 webserver.cc:313] Webserver started. Bound to: http://127.0.22.150:39433/ I0301 23:04:32.273347 26150 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-21/data/info.pb I0301 23:04:32.273769 26150 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.274426 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 26150 I0301 23:04:32.274593 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data --block_manager=log --rpc_bind_addresses=127.0.22.151:40697 --local_ip_for_outbound_sockets=127.0.22.151 --webserver_port=44909 --webserver_interface=127.0.22.151 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:32.290040 26273 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.290146 26273 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.290415 26273 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.291638 26272 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.291728 26272 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.291822 26272 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.292708 26274 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.292850 26274 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.293007 26274 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.307518 23384 ts_manager.cc:98] Registered new tserver with Master: 1809bbd3e6ee4892b4f88f8c4dfc7631 (127.0.22.149:38703) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.311497 26276 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.311636 26276 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.324730 26276 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.324792 26276 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.151 I0301 23:04:32.326119 26276 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.151:40697 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/info.pb --webserver_interface=127.0.22.151 --webserver_port=44909 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.26276 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.151 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.327284 26276 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.327473 26276 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.336316 26276 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.336360 26276 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.340469 26276 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.000s sys 0.001s I0301 23:04:32.340644 26276 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.340718 26276 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.341497 26276 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.341692 26276 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal uuid: "e245ac87358647788ec155fcd199ec11" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.341732 26276 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.356287 23251 ts_manager.cc:98] Registered new tserver with Master: 1809bbd3e6ee4892b4f88f8c4dfc7631 (127.0.22.149:38703) I0301 23:04:32.358798 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.149:36461 I0301 23:04:32.370632 23317 ts_manager.cc:98] Registered new tserver with Master: 1809bbd3e6ee4892b4f88f8c4dfc7631 (127.0.22.149:38703) I0301 23:04:32.380805 23379 ts_manager.cc:98] Registered new tserver with Master: ed2cf46582b1444e9f38162d39866c52 (127.0.22.150:33415) I0301 23:04:32.396292 26276 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.396559 26276 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.396651 26276 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.402138 26276 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.151:40697 I0301 23:04:32.402220 26276 webserver.cc:175] Starting webserver on 127.0.22.151:44909 I0301 23:04:32.402238 26276 webserver.cc:186] Document root disabled I0301 23:04:32.402403 26276 webserver.cc:313] Webserver started. Bound to: http://127.0.22.151:44909/ I0301 23:04:32.402534 26276 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-22/data/info.pb I0301 23:04:32.402874 26276 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.407409 26402 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.407456 26402 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.407552 26402 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.408358 26403 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.408432 26403 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.408555 26403 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.409181 26401 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.409204 26401 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.409235 26401 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.412302 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 26276 I0301 23:04:32.412510 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data --block_manager=log --rpc_bind_addresses=127.0.22.152:35037 --local_ip_for_outbound_sockets=127.0.22.152 --webserver_port=45421 --webserver_interface=127.0.22.152 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:32.418310 23255 ts_manager.cc:98] Registered new tserver with Master: ed2cf46582b1444e9f38162d39866c52 (127.0.22.150:33415) I0301 23:04:32.420716 23255 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.150:32847 I0301 23:04:32.430092 23318 ts_manager.cc:98] Registered new tserver with Master: ed2cf46582b1444e9f38162d39866c52 (127.0.22.150:33415) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.451840 26409 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.451999 26409 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.453127 26409 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.453171 26409 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.152 I0301 23:04:32.454506 26409 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.152:35037 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/info.pb --webserver_interface=127.0.22.152 --webserver_port=45421 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.26409 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.152 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.455701 26409 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.455912 26409 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.456008 26409 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.456049 26409 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.468443 26409 fs_manager.cc:399] Time spent opening directory manager: real 0.002s user 0.001s sys 0.000s I0301 23:04:32.468596 26409 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.468672 26409 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.469339 26409 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.469517 26409 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal uuid: "8173db00a9ce41c0bdf618f89872624e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.469554 26409 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.480698 23319 ts_manager.cc:98] Registered new tserver with Master: e245ac87358647788ec155fcd199ec11 (127.0.22.151:40697) I0301 23:04:32.494266 23383 ts_manager.cc:98] Registered new tserver with Master: e245ac87358647788ec155fcd199ec11 (127.0.22.151:40697) I0301 23:04:32.500515 23256 ts_manager.cc:98] Registered new tserver with Master: e245ac87358647788ec155fcd199ec11 (127.0.22.151:40697) I0301 23:04:32.501397 23256 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.151:39761 I0301 23:04:32.501425 23254 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.137:49415 I0301 23:04:32.501957 23255 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.139:50049 I0301 23:04:32.502212 23253 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.140:36003 I0301 23:04:32.503026 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.138:58991 I0301 23:04:32.515571 25885 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "4821875d4f024436a7bad3af9f50cfa0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4821875d4f024436a7bad3af9f50cfa0" member_type: VOTER last_known_addr { host: "127.0.22.190" port: 40937 } } peers { permanent_uuid: "78ca695677d34addb25f9e1b667f9608" member_type: VOTER last_known_addr { host: "127.0.22.189" port: 40771 } } peers { permanent_uuid: "0c06f2d078ab4153a85d26a82e136b78" member_type: VOTER last_known_addr { host: "127.0.22.188" port: 41299 } } } I0301 23:04:32.515591 25885 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4821875d4f024436a7bad3af9f50cfa0 [sys.catalog]: This master's current role is: LEADER I0301 23:04:32.527710 26409 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.527966 26409 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.528033 26409 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.532829 26409 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.152:35037 I0301 23:04:32.532886 26409 webserver.cc:175] Starting webserver on 127.0.22.152:45421 I0301 23:04:32.532917 26409 webserver.cc:186] Document root disabled I0301 23:04:32.533044 26409 webserver.cc:313] Webserver started. Bound to: http://127.0.22.152:45421/ I0301 23:04:32.533165 26409 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-23/data/info.pb I0301 23:04:32.533546 26409 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.537068 26531 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.537125 26531 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.537222 26531 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.537235 26532 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.537264 26532 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.537349 26532 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.537083 26530 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.537472 26530 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.537518 26530 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.539178 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 26409 I0301 23:04:32.539361 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data --block_manager=log --rpc_bind_addresses=127.0.22.153:43729 --local_ip_for_outbound_sockets=127.0.22.153 --webserver_port=35609 --webserver_interface=127.0.22.153 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:32.575171 23318 ts_manager.cc:98] Registered new tserver with Master: 8173db00a9ce41c0bdf618f89872624e (127.0.22.152:35037) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.578827 26540 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.578922 26540 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.579635 26540 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.579671 26540 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.153 I0301 23:04:32.588593 26540 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.153:43729 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/info.pb --webserver_interface=127.0.22.153 --webserver_port=35609 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.26540 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.153 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.593420 26540 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.593587 26540 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.593677 26540 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.593736 26540 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.594647 26540 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:32.594789 26540 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.594885 26540 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.595517 26540 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.595666 26540 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal uuid: "e243ad45f06746eea00d461b3e91fa20" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.595702 26540 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.614833 23255 ts_manager.cc:98] Registered new tserver with Master: 8173db00a9ce41c0bdf618f89872624e (127.0.22.152:35037) I0301 23:04:32.615703 23255 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.152:52485 I0301 23:04:32.616142 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.141:37631 I0301 23:04:32.617370 23379 ts_manager.cc:98] Registered new tserver with Master: 8173db00a9ce41c0bdf618f89872624e (127.0.22.152:35037) I0301 23:04:32.631605 26540 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.631801 26540 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.631860 26540 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.636366 26540 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.153:43729 I0301 23:04:32.636423 26540 webserver.cc:175] Starting webserver on 127.0.22.153:35609 I0301 23:04:32.636441 26540 webserver.cc:186] Document root disabled I0301 23:04:32.636571 26540 webserver.cc:313] Webserver started. Bound to: http://127.0.22.153:35609/ I0301 23:04:32.636695 26540 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-24/data/info.pb I0301 23:04:32.637069 26540 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.640120 26659 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.640210 26659 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.640285 26659 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.640375 26661 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.640413 26661 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.640446 26661 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.640501 26660 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.640527 26660 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.640556 26660 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.642520 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 26540 I0301 23:04:32.642709 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data --block_manager=log --rpc_bind_addresses=127.0.22.154:35051 --local_ip_for_outbound_sockets=127.0.22.154 --webserver_port=43973 --webserver_interface=127.0.22.154 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.681643 26669 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.681725 26669 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.682469 26669 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.682498 26669 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.154 I0301 23:04:32.683629 26669 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.154:35051 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/info.pb --webserver_interface=127.0.22.154 --webserver_port=43973 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.26669 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.154 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.696720 26669 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.696916 26669 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.697008 26669 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.697044 26669 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.697988 26669 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:32.698138 26669 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.698211 26669 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.698374 25227 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:32.698925 26669 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.699071 26669 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal uuid: "a84448f5e0c54e8b8f0a8a38e09fcb8e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.699108 26669 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.725569 23383 ts_manager.cc:98] Registered new tserver with Master: e243ad45f06746eea00d461b3e91fa20 (127.0.22.153:43729) I0301 23:04:32.726763 23318 ts_manager.cc:98] Registered new tserver with Master: e243ad45f06746eea00d461b3e91fa20 (127.0.22.153:43729) I0301 23:04:32.726845 23251 ts_manager.cc:98] Registered new tserver with Master: e243ad45f06746eea00d461b3e91fa20 (127.0.22.153:43729) I0301 23:04:32.727833 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.153:58411 I0301 23:04:32.740977 26669 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.741171 26669 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.741230 26669 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.745482 26669 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.154:35051 I0301 23:04:32.745541 26669 webserver.cc:175] Starting webserver on 127.0.22.154:43973 I0301 23:04:32.745558 26669 webserver.cc:186] Document root disabled I0301 23:04:32.745679 26669 webserver.cc:313] Webserver started. Bound to: http://127.0.22.154:43973/ I0301 23:04:32.745807 26669 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-25/data/info.pb I0301 23:04:32.746170 26669 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.749706 26788 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.749759 26788 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.749856 26788 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.750160 26789 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.750185 26789 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.750185 26790 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.750198 26790 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.750217 26789 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.750279 26790 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.753554 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 26669 I0301 23:04:32.753743 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data --block_manager=log --rpc_bind_addresses=127.0.22.155:45897 --local_ip_for_outbound_sockets=127.0.22.155 --webserver_port=46187 --webserver_interface=127.0.22.155 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:32.776654 23319 ts_manager.cc:98] Registered new tserver with Master: a84448f5e0c54e8b8f0a8a38e09fcb8e (127.0.22.154:35051) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.781769 26798 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.781849 26798 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.782559 26798 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.782588 26798 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.155 I0301 23:04:32.783471 26798 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.155:45897 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/info.pb --webserver_interface=127.0.22.155 --webserver_port=46187 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.26798 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.155 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.795059 25356 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:32.796352 26798 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.796530 26798 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.796655 26798 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.796696 26798 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.797571 26798 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:04:32.797768 26798 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.797839 26798 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.798519 26798 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.798681 26798 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal uuid: "6f3042abec074254a3c34d297e3098c9" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.798719 26798 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.813261 23379 ts_manager.cc:98] Registered new tserver with Master: a84448f5e0c54e8b8f0a8a38e09fcb8e (127.0.22.154:35051) I0301 23:04:32.814096 23251 ts_manager.cc:98] Registered new tserver with Master: a84448f5e0c54e8b8f0a8a38e09fcb8e (127.0.22.154:35051) I0301 23:04:32.814766 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.154:41465 I0301 23:04:32.829576 26798 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.829795 26798 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.829859 26798 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.833587 26798 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.155:45897 I0301 23:04:32.833647 26798 webserver.cc:175] Starting webserver on 127.0.22.155:46187 I0301 23:04:32.833669 26798 webserver.cc:186] Document root disabled I0301 23:04:32.833786 26798 webserver.cc:313] Webserver started. Bound to: http://127.0.22.155:46187/ I0301 23:04:32.833907 26798 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-26/data/info.pb I0301 23:04:32.834234 26798 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.838083 26917 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.838109 26917 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.838147 26917 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.838261 26919 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.838287 26919 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.838320 26919 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.838567 26918 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.838613 26918 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.838650 26918 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.841734 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 26798 I0301 23:04:32.841892 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data --block_manager=log --rpc_bind_addresses=127.0.22.156:44865 --local_ip_for_outbound_sockets=127.0.22.156 --webserver_port=37777 --webserver_interface=127.0.22.156 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:32.867698 23804 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:32.867863 23543 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:32.868203 25485 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:32.869437 23675 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.878290 26927 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.878403 26927 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.879423 26927 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.882015 26927 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.156 I0301 23:04:32.883309 26927 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.156:44865 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/info.pb --webserver_interface=127.0.22.156 --webserver_port=37777 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.26927 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.156 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.888567 26927 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.888767 26927 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.888860 26927 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.888912 26927 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.889822 26927 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.889993 26927 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.890065 26927 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.891582 26927 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.891969 26927 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal uuid: "9e2aef0791a6458ca6c8cc08cd7b0cde" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.892051 26927 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.907018 23251 ts_manager.cc:98] Registered new tserver with Master: 6f3042abec074254a3c34d297e3098c9 (127.0.22.155:45897) I0301 23:04:32.907820 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.155:51225 I0301 23:04:32.919606 23380 ts_manager.cc:98] Registered new tserver with Master: 6f3042abec074254a3c34d297e3098c9 (127.0.22.155:45897) I0301 23:04:32.920224 23319 ts_manager.cc:98] Registered new tserver with Master: 6f3042abec074254a3c34d297e3098c9 (127.0.22.155:45897) I0301 23:04:32.927675 26927 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.927886 26927 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.927960 26927 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.932227 26927 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.156:44865 I0301 23:04:32.932288 26927 webserver.cc:175] Starting webserver on 127.0.22.156:37777 I0301 23:04:32.932305 26927 webserver.cc:186] Document root disabled I0301 23:04:32.932462 26927 webserver.cc:313] Webserver started. Bound to: http://127.0.22.156:37777/ I0301 23:04:32.932579 26927 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-27/data/info.pb I0301 23:04:32.932961 26927 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.936357 27046 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:32.936393 27046 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.936432 27046 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:32.936641 27047 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:32.936664 27048 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:32.936730 27047 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.936754 27048 heartbeater.cc:425] Registering TS with master... I0301 23:04:32.936786 27047 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:32.936789 27048 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:32.939723 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 26927 I0301 23:04:32.939874 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data --block_manager=log --rpc_bind_addresses=127.0.22.157:39971 --local_ip_for_outbound_sockets=127.0.22.157 --webserver_port=42421 --webserver_interface=127.0.22.157 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:32.965777 27056 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:32.965867 27056 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:32.966568 27056 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:32.966599 27056 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.157 I0301 23:04:32.967461 27056 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.157:39971 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/info.pb --webserver_interface=127.0.22.157 --webserver_port=42421 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.27056 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.157 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:32.972313 27056 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:32.972503 27056 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52016us I0301 23:04:32.972579 27056 fs_manager.cc:263] Metadata directory not provided I0301 23:04:32.972617 27056 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:32.976425 27056 fs_manager.cc:399] Time spent opening directory manager: real 0.003s user 0.000s sys 0.001s I0301 23:04:32.976572 27056 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:32.976650 27056 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:32.977376 27056 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:32.977586 27056 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal uuid: "dfef967142f842f6af542671120a564e" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:32.977632 27056 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:32.981377 23251 ts_manager.cc:98] Registered new tserver with Master: 9e2aef0791a6458ca6c8cc08cd7b0cde (127.0.22.156:44865) I0301 23:04:32.982300 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.156:40367 I0301 23:04:32.987736 23316 ts_manager.cc:98] Registered new tserver with Master: 9e2aef0791a6458ca6c8cc08cd7b0cde (127.0.22.156:44865) I0301 23:04:32.990999 23380 ts_manager.cc:98] Registered new tserver with Master: 9e2aef0791a6458ca6c8cc08cd7b0cde (127.0.22.156:44865) I0301 23:04:32.992419 27056 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:32.992622 27056 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:32.992667 23933 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:32.992693 27056 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:32.995702 25616 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:32.996709 27056 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.157:39971 I0301 23:04:32.996789 27056 webserver.cc:175] Starting webserver on 127.0.22.157:42421 I0301 23:04:32.996809 27056 webserver.cc:186] Document root disabled I0301 23:04:32.996970 27056 webserver.cc:313] Webserver started. Bound to: http://127.0.22.157:42421/ I0301 23:04:32.997931 27056 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-28/data/info.pb I0301 23:04:32.998271 27056 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:32.999161 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 27056 I0301 23:04:32.999330 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data --block_manager=log --rpc_bind_addresses=127.0.22.158:46635 --local_ip_for_outbound_sockets=127.0.22.158 --webserver_port=45633 --webserver_interface=127.0.22.158 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:33.001721 27177 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:33.001776 27177 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.001883 27177 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:33.002054 27176 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:33.002104 27176 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.002176 27176 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:33.003643 27175 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:33.003695 27175 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.003757 27175 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:33.031008 27182 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:33.031086 27182 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:33.031888 27182 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:33.031929 27182 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.158 I0301 23:04:33.044926 27182 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.158:46635 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/info.pb --webserver_interface=127.0.22.158 --webserver_port=45633 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.27182 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.158 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:33.045809 27182 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:33.045984 27182 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52516us I0301 23:04:33.046053 27182 fs_manager.cc:263] Metadata directory not provided I0301 23:04:33.046085 27182 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:33.046780 27182 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:33.046953 27182 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:33.047027 27182 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:33.047610 27182 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:33.047768 27182 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal uuid: "68cd2b3e78884927ad0c60e4274be725" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:33.047808 27182 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:33.077133 23320 ts_manager.cc:98] Registered new tserver with Master: dfef967142f842f6af542671120a564e (127.0.22.157:39971) I0301 23:04:33.083981 23380 ts_manager.cc:98] Registered new tserver with Master: dfef967142f842f6af542671120a564e (127.0.22.157:39971) I0301 23:04:33.086303 23251 ts_manager.cc:98] Registered new tserver with Master: dfef967142f842f6af542671120a564e (127.0.22.157:39971) I0301 23:04:33.086891 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.157:57779 I0301 23:04:33.089732 27182 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:33.089956 27182 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:33.090010 27182 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:33.094378 27182 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.158:46635 I0301 23:04:33.094437 27182 webserver.cc:175] Starting webserver on 127.0.22.158:45633 I0301 23:04:33.094442 27182 webserver.cc:186] Document root disabled I0301 23:04:33.094565 27182 webserver.cc:313] Webserver started. Bound to: http://127.0.22.158:45633/ I0301 23:04:33.094681 27182 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-29/data/info.pb I0301 23:04:33.094979 27182 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:33.098515 27304 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:33.098543 27304 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.098587 27304 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:33.098726 27306 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:33.098752 27306 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.098785 27306 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:33.099252 27305 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:33.099268 27305 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.099298 27305 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:33.102128 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 27182 I0301 23:04:33.102305 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data --block_manager=log --rpc_bind_addresses=127.0.22.159:42115 --local_ip_for_outbound_sockets=127.0.22.159 --webserver_port=41675 --webserver_interface=127.0.22.159 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:33.109880 24062 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:33.111583 25744 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:33.112679 24191 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:33.152249 27314 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:33.152361 27314 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:33.153414 27314 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:33.153448 27314 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.159 I0301 23:04:33.154711 27314 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.159:42115 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/info.pb --webserver_interface=127.0.22.159 --webserver_port=41675 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.27314 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.159 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:33.165668 25873 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:33.172472 27314 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:33.172677 27314 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52516us I0301 23:04:33.172775 27314 fs_manager.cc:263] Metadata directory not provided I0301 23:04:33.172814 27314 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:33.173802 27314 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.000s sys 0.001s I0301 23:04:33.173985 27314 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:33.174060 27314 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:33.174718 27314 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:33.174891 27314 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal uuid: "93811e8b1a554358b588f3a88472e55b" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:33.174930 27314 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:33.205032 27314 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:33.205284 27314 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:33.205345 27314 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:33.210752 23251 ts_manager.cc:98] Registered new tserver with Master: 68cd2b3e78884927ad0c60e4274be725 (127.0.22.158:46635) I0301 23:04:33.211364 27314 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.159:42115 I0301 23:04:33.211433 27314 webserver.cc:175] Starting webserver on 127.0.22.159:41675 I0301 23:04:33.211441 27314 webserver.cc:186] Document root disabled I0301 23:04:33.211558 23251 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.158:53979 I0301 23:04:33.211578 27314 webserver.cc:313] Webserver started. Bound to: http://127.0.22.159:41675/ I0301 23:04:33.211609 23320 ts_manager.cc:98] Registered new tserver with Master: 68cd2b3e78884927ad0c60e4274be725 (127.0.22.158:46635) I0301 23:04:33.211709 27314 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-30/data/info.pb I0301 23:04:33.212465 27314 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:33.213224 23380 ts_manager.cc:98] Registered new tserver with Master: 68cd2b3e78884927ad0c60e4274be725 (127.0.22.158:46635) I0301 23:04:33.217566 27435 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:33.217592 27435 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.217633 27435 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:33.217766 27433 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:33.217787 27433 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.217818 27433 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:33.218009 27434 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:33.218029 27434 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.218058 27434 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:33.219673 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 27314 I0301 23:04:33.219833 90 external_mini_cluster.cc:933] Running /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data --block_manager=log --rpc_bind_addresses=127.0.22.160:46103 --local_ip_for_outbound_sockets=127.0.22.160 --webserver_port=35159 --webserver_interface=127.0.22.160 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/logs --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0301 23:04:33.245038 23379 ts_manager.cc:98] Registered new tserver with Master: 93811e8b1a554358b588f3a88472e55b (127.0.22.159:42115) WARNING: Logging before InitGoogleLogging() is written to STDERR W0301 23:04:33.245133 27442 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0301 23:04:33.245263 27442 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0301 23:04:33.246330 27442 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0301 23:04:33.246371 27442 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.22.160 I0301 23:04:33.252804 27442 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data --fs_wal_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.22.160:46103 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/info.pb --webserver_interface=127.0.22.160 --webserver_port=35159 --tserver_master_addrs=127.0.22.190:40937,127.0.22.189:40771,127.0.22.188:41299 --never_fsync=true --heap_profile_path=/tmp/kudu-tserver.27442 --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.22.160 --log_dir=/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.9.0 revision deb0f04b010c5399771879829285c284b8f20008 build type RELEASE built by hao.hao at 01 Mar 2019 13:57:59 PST on ve0518.halxg.cloudera.com I0301 23:04:33.254081 27442 tablet_server_main.cc:85] Initializing tablet server... I0301 23:04:33.254274 27442 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 52516us I0301 23:04:33.254371 27442 fs_manager.cc:263] Metadata directory not provided I0301 23:04:33.254429 27442 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0301 23:04:33.255311 27442 fs_manager.cc:399] Time spent opening directory manager: real 0.000s user 0.001s sys 0.000s I0301 23:04:33.255466 27442 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0301 23:04:33.255538 27442 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0301 23:04:33.256022 27442 fs_manager.cc:419] Time spent opening block manager: real 0.000s user 0.000s sys 0.000s I0301 23:04:33.256290 27442 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data,/tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal uuid: "edf8f151a97949ab9d67d3381c58f99b" format_stamp: "Formatted at 2019-03-01 23:04:29 on dist-test-slave-dist-test-slave-04f2" I0301 23:04:33.256328 27442 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal metadata directory: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/wal 1 data directories: /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0301 23:04:33.262037 26016 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:33.263180 24320 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:33.263491 24449 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:33.270129 23318 ts_manager.cc:98] Registered new tserver with Master: 93811e8b1a554358b588f3a88472e55b (127.0.22.159:42115) I0301 23:04:33.270970 23253 ts_manager.cc:98] Registered new tserver with Master: 93811e8b1a554358b588f3a88472e55b (127.0.22.159:42115) I0301 23:04:33.271754 23253 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.159:43787 I0301 23:04:33.281129 27442 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0301 23:04:33.281332 27442 ts_tablet_manager.cc:356] Loaded tablet metadata (0 live tablets) I0301 23:04:33.281407 27442 tablet_server_main.cc:90] Starting tablet server... I0301 23:04:33.285553 27442 rpc_server.cc:205] RPC server started. Bound to: 127.0.22.160:46103 I0301 23:04:33.285593 27442 webserver.cc:175] Starting webserver on 127.0.22.160:35159 I0301 23:04:33.285598 27442 webserver.cc:186] Document root disabled I0301 23:04:33.285755 27442 webserver.cc:313] Webserver started. Bound to: http://127.0.22.160:35159/ I0301 23:04:33.285877 27442 server_base.cc:607] Dumped server information to /tmp/dist-test-task3pD_4V/test-tmp/location_assignment-itest.0.TsLocationAssignmentITest.Basic_7.1551481418399944-90/minicluster-data/ts-31/data/info.pb I0301 23:04:33.286247 27442 tablet_server_main.cc:93] Tablet server successfully started. I0301 23:04:33.289484 27562 heartbeater.cc:345] Connected to a master server at 127.0.22.188:41299 I0301 23:04:33.289539 27562 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.289594 27563 heartbeater.cc:345] Connected to a master server at 127.0.22.189:40771 I0301 23:04:33.289610 27562 heartbeater.cc:474] Master 127.0.22.188:41299 requested a full tablet report, sending... I0301 23:04:33.289640 27563 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.289674 27563 heartbeater.cc:474] Master 127.0.22.189:40771 requested a full tablet report, sending... I0301 23:04:33.289873 27564 heartbeater.cc:345] Connected to a master server at 127.0.22.190:40937 I0301 23:04:33.289897 27564 heartbeater.cc:425] Registering TS with master... I0301 23:04:33.289927 27564 heartbeater.cc:474] Master 127.0.22.190:40937 requested a full tablet report, sending... I0301 23:04:33.295403 90 external_mini_cluster.cc:995] Started /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver as pid 27442 I0301 23:04:33.354753 23253 ts_manager.cc:98] Registered new tserver with Master: edf8f151a97949ab9d67d3381c58f99b (127.0.22.160:46103) I0301 23:04:33.355626 23253 master_service.cc:263] Signed X509 certificate for tserver {username='slave'} at 127.0.22.160:56609 I0301 23:04:33.361006 26145 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... I0301 23:04:33.389335 23316 ts_manager.cc:98] Registered new tserver with Master: edf8f151a97949ab9d67d3381c58f99b (127.0.22.160:46103) I0301 23:04:33.390018 23379 ts_manager.cc:98] Registered new tserver with Master: edf8f151a97949ab9d67d3381c58f99b (127.0.22.160:46103) I0301 23:04:33.396579 90 external_mini_cluster.cc:623] 32 TS(s) registered with all masters I0301 23:04:33.397485 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 23418 W0301 23:04:33.400418 23304 connection.cc:647] server connection from 127.0.22.129:41643 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:41643): Connection reset by peer (error 104) W0301 23:04:33.400437 23237 connection.cc:647] server connection from 127.0.22.129:38283 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:38283): Connection reset by peer (error 104) W0301 23:04:33.400467 23366 connection.cc:647] server connection from 127.0.22.129:48965 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.129:48965): Connection reset by peer (error 104) I0301 23:04:33.400522 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 23551 W0301 23:04:33.403069 23302 connection.cc:647] server connection from 127.0.22.130:60537 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:60537): Connection reset by peer (error 104) W0301 23:04:33.403074 23367 connection.cc:647] server connection from 127.0.22.130:58341 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:58341): Connection reset by peer (error 104) W0301 23:04:33.403111 23239 connection.cc:647] server connection from 127.0.22.130:57957 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.130:57957): Connection reset by peer (error 104) I0301 23:04:33.403211 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 23682 W0301 23:04:33.405496 23238 connection.cc:647] server connection from 127.0.22.131:49421 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:49421): Connection reset by peer (error 104) W0301 23:04:33.405499 23301 connection.cc:647] server connection from 127.0.22.131:48811 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:48811): Connection reset by peer (error 104) I0301 23:04:33.405562 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 23809 W0301 23:04:33.405490 23366 connection.cc:647] server connection from 127.0.22.131:52071 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.131:52071): Connection reset by peer (error 104) W0301 23:04:33.408048 23302 connection.cc:647] server connection from 127.0.22.132:50869 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:50869): Connection reset by peer (error 104) W0301 23:04:33.408061 23239 connection.cc:647] server connection from 127.0.22.132:37341 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:37341): Connection reset by peer (error 104) W0301 23:04:33.408087 23365 connection.cc:647] server connection from 127.0.22.132:55649 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.132:55649): Connection reset by peer (error 104) I0301 23:04:33.408150 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 23941 W0301 23:04:33.410645 23367 connection.cc:647] server connection from 127.0.22.133:60363 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:60363): Connection reset by peer (error 104) W0301 23:04:33.410661 23238 connection.cc:647] server connection from 127.0.22.133:34895 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:34895): Connection reset by peer (error 104) W0301 23:04:33.410681 23304 connection.cc:647] server connection from 127.0.22.133:33175 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.133:33175): Connection reset by peer (error 104) I0301 23:04:33.410759 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 24067 W0301 23:04:33.413226 23301 connection.cc:647] server connection from 127.0.22.134:34779 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:34779): Connection reset by peer (error 104) W0301 23:04:33.413254 23239 connection.cc:647] server connection from 127.0.22.134:57003 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:57003): Connection reset by peer (error 104) W0301 23:04:33.413278 23368 connection.cc:647] server connection from 127.0.22.134:57423 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.134:57423): Connection reset by peer (error 104) I0301 23:04:33.413329 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 24196 W0301 23:04:33.416081 23301 connection.cc:647] server connection from 127.0.22.135:49405 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:49405): Connection reset by peer (error 104) W0301 23:04:33.416110 23239 connection.cc:647] server connection from 127.0.22.135:35459 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:35459): Connection reset by peer (error 104) W0301 23:04:33.416123 23368 connection.cc:647] server connection from 127.0.22.135:51447 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.135:51447): Connection reset by peer (error 104) I0301 23:04:33.416209 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 24325 W0301 23:04:33.418634 23240 connection.cc:647] server connection from 127.0.22.136:57565 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:57565): Connection reset by peer (error 104) W0301 23:04:33.418638 23303 connection.cc:647] server connection from 127.0.22.136:42305 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:42305): Connection reset by peer (error 104) W0301 23:04:33.418643 23366 connection.cc:647] server connection from 127.0.22.136:59875 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.136:59875): Connection reset by peer (error 104) I0301 23:04:33.418709 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 24454 W0301 23:04:33.421172 23304 connection.cc:647] server connection from 127.0.22.137:36245 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:36245): Connection reset by peer (error 104) W0301 23:04:33.421218 23368 connection.cc:647] server connection from 127.0.22.137:60765 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:60765): Connection reset by peer (error 104) W0301 23:04:33.421218 23240 connection.cc:647] server connection from 127.0.22.137:49415 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.137:49415): Connection reset by peer (error 104) I0301 23:04:33.421274 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 24583 I0301 23:04:33.422039 26274 heartbeater.cc:466] Master 127.0.22.190:40937 was elected leader, sending a full tablet report... W0301 23:04:33.423552 23304 connection.cc:647] server connection from 127.0.22.138:43271 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:43271): Connection reset by peer (error 104) W0301 23:04:33.423579 23238 connection.cc:647] server connection from 127.0.22.138:58991 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:58991): Connection reset by peer (error 104) W0301 23:04:33.423596 23366 connection.cc:647] server connection from 127.0.22.138:42291 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.138:42291): Connection reset by peer (error 104) I0301 23:04:33.423650 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 24712 W0301 23:04:33.425979 23240 connection.cc:647] server connection from 127.0.22.139:50049 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:50049): Connection reset by peer (error 104) W0301 23:04:33.426003 23304 connection.cc:647] server connection from 127.0.22.139:55633 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:55633): Connection reset by peer (error 104) W0301 23:04:33.426020 23367 connection.cc:647] server connection from 127.0.22.139:58307 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.139:58307): Connection reset by peer (error 104) I0301 23:04:33.426084 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 24840 W0301 23:04:33.428401 23238 connection.cc:647] server connection from 127.0.22.140:36003 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:36003): Connection reset by peer (error 104) W0301 23:04:33.428442 23365 connection.cc:647] server connection from 127.0.22.140:46135 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:46135): Connection reset by peer (error 104) I0301 23:04:33.428506 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 24966 W0301 23:04:33.429648 23304 connection.cc:647] server connection from 127.0.22.140:33639 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.140:33639): Connection reset by peer (error 104) W0301 23:04:33.430868 23301 connection.cc:647] server connection from 127.0.22.141:51695 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:51695): Connection reset by peer (error 104) W0301 23:04:33.430888 23367 connection.cc:647] server connection from 127.0.22.141:41231 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:41231): Connection reset by peer (error 104) I0301 23:04:33.430966 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 25095 W0301 23:04:33.430990 23240 connection.cc:647] server connection from 127.0.22.141:37631 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.141:37631): Connection reset by peer (error 104) W0301 23:04:33.433473 23239 connection.cc:647] server connection from 127.0.22.142:43851 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:43851): Connection reset by peer (error 104) W0301 23:04:33.433495 23301 connection.cc:647] server connection from 127.0.22.142:33649 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:33649): Connection reset by peer (error 104) W0301 23:04:33.433518 23365 connection.cc:647] server connection from 127.0.22.142:42335 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.142:42335): Connection reset by peer (error 104) I0301 23:04:33.433578 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 25233 W0301 23:04:33.435710 23239 connection.cc:647] server connection from 127.0.22.143:58293 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:58293): Connection reset by peer (error 104) W0301 23:04:33.435740 23368 connection.cc:647] server connection from 127.0.22.143:43557 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:43557): Connection reset by peer (error 104) W0301 23:04:33.435740 23303 connection.cc:647] server connection from 127.0.22.143:55799 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.143:55799): Connection reset by peer (error 104) I0301 23:04:33.435789 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 25361 W0301 23:04:33.439075 23237 connection.cc:647] server connection from 127.0.22.144:55669 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:55669): Connection reset by peer (error 104) W0301 23:04:33.439100 23304 connection.cc:647] server connection from 127.0.22.144:53995 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:53995): Connection reset by peer (error 104) W0301 23:04:33.439119 23367 connection.cc:647] server connection from 127.0.22.144:54079 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.144:54079): Connection reset by peer (error 104) I0301 23:04:33.439172 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 25490 W0301 23:04:33.441573 23239 connection.cc:647] server connection from 127.0.22.145:34429 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.145:34429): Connection reset by peer (error 104) W0301 23:04:33.441597 23304 connection.cc:647] server connection from 127.0.22.145:47581 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.145:47581): Connection reset by peer (error 104) W0301 23:04:33.441608 23366 connection.cc:647] server connection from 127.0.22.145:59321 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.145:59321): Connection reset by peer (error 104) I0301 23:04:33.441668 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 25620 W0301 23:04:33.443891 23304 connection.cc:647] server connection from 127.0.22.146:46009 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.146:46009): Connection reset by peer (error 104) W0301 23:04:33.443943 23367 connection.cc:647] server connection from 127.0.22.146:55939 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.146:55939): Connection reset by peer (error 104) W0301 23:04:33.443943 23238 connection.cc:647] server connection from 127.0.22.146:51159 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.146:51159): Connection reset by peer (error 104) I0301 23:04:33.444003 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 25749 W0301 23:04:33.446243 23240 connection.cc:647] server connection from 127.0.22.147:57819 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.147:57819): Connection reset by peer (error 104) W0301 23:04:33.446247 23365 connection.cc:647] server connection from 127.0.22.147:51705 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.147:51705): Connection reset by peer (error 104) W0301 23:04:33.446264 23304 connection.cc:647] server connection from 127.0.22.147:35279 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.147:35279): Connection reset by peer (error 104) I0301 23:04:33.446316 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 25878 W0301 23:04:33.449318 23304 connection.cc:647] server connection from 127.0.22.148:51275 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.148:51275): Connection reset by peer (error 104) W0301 23:04:33.449337 23238 connection.cc:647] server connection from 127.0.22.148:41551 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.148:41551): Connection reset by peer (error 104) W0301 23:04:33.449352 23368 connection.cc:647] server connection from 127.0.22.148:44453 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.148:44453): Connection reset by peer (error 104) I0301 23:04:33.449427 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 26021 W0301 23:04:33.451994 23302 connection.cc:647] server connection from 127.0.22.149:45911 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.149:45911): Connection reset by peer (error 104) W0301 23:04:33.452018 23237 connection.cc:647] server connection from 127.0.22.149:36461 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.149:36461): Connection reset by peer (error 104) W0301 23:04:33.452036 23368 connection.cc:647] server connection from 127.0.22.149:59547 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.149:59547): Connection reset by peer (error 104) I0301 23:04:33.452087 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 26150 W0301 23:04:33.454895 23303 connection.cc:647] server connection from 127.0.22.150:34809 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.150:34809): Connection reset by peer (error 104) W0301 23:04:33.454947 23365 connection.cc:647] server connection from 127.0.22.150:50383 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.150:50383): Connection reset by peer (error 104) W0301 23:04:33.454947 23239 connection.cc:647] server connection from 127.0.22.150:32847 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.150:32847): Connection reset by peer (error 104) I0301 23:04:33.454998 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 26276 W0301 23:04:33.457203 23240 connection.cc:647] server connection from 127.0.22.151:39761 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.151:39761): Connection reset by peer (error 104) W0301 23:04:33.457223 23302 connection.cc:647] server connection from 127.0.22.151:49269 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.151:49269): Connection reset by peer (error 104) W0301 23:04:33.457248 23366 connection.cc:647] server connection from 127.0.22.151:42927 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.151:42927): Connection reset by peer (error 104) I0301 23:04:33.457343 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 26409 W0301 23:04:33.459830 23303 connection.cc:647] server connection from 127.0.22.152:40793 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.152:40793): Connection reset by peer (error 104) W0301 23:04:33.459856 23239 connection.cc:647] server connection from 127.0.22.152:52485 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.152:52485): Connection reset by peer (error 104) W0301 23:04:33.459867 23366 connection.cc:647] server connection from 127.0.22.152:53313 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.152:53313): Connection reset by peer (error 104) I0301 23:04:33.459945 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 26540 W0301 23:04:33.462838 23301 connection.cc:647] server connection from 127.0.22.153:35857 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.153:35857): Connection reset by peer (error 104) W0301 23:04:33.462862 23240 connection.cc:647] server connection from 127.0.22.153:58411 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.153:58411): Connection reset by peer (error 104) W0301 23:04:33.462874 23365 connection.cc:647] server connection from 127.0.22.153:38761 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.153:38761): Connection reset by peer (error 104) I0301 23:04:33.462950 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 26669 W0301 23:04:33.465363 23240 connection.cc:647] server connection from 127.0.22.154:41465 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.154:41465): Connection reset by peer (error 104) W0301 23:04:33.465364 23367 connection.cc:647] server connection from 127.0.22.154:40001 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.154:40001): Connection reset by peer (error 104) W0301 23:04:33.465464 23304 connection.cc:647] server connection from 127.0.22.154:38871 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.154:38871): Connection reset by peer (error 104) I0301 23:04:33.465509 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 26798 W0301 23:04:33.467662 23301 connection.cc:647] server connection from 127.0.22.155:54701 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.155:54701): Connection reset by peer (error 104) W0301 23:04:33.467680 23240 connection.cc:647] server connection from 127.0.22.155:51225 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.155:51225): Connection reset by peer (error 104) W0301 23:04:33.467700 23367 connection.cc:647] server connection from 127.0.22.155:38555 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.155:38555): Connection reset by peer (error 104) I0301 23:04:33.467799 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 26927 W0301 23:04:33.470088 23303 connection.cc:647] server connection from 127.0.22.156:37827 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.156:37827): Connection reset by peer (error 104) W0301 23:04:33.470111 23239 connection.cc:647] server connection from 127.0.22.156:40367 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.156:40367): Connection reset by peer (error 104) W0301 23:04:33.470127 23367 connection.cc:647] server connection from 127.0.22.156:53297 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.156:53297): Connection reset by peer (error 104) I0301 23:04:33.470183 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 27056 W0301 23:04:33.473299 23303 connection.cc:647] server connection from 127.0.22.157:52003 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.157:52003): Connection reset by peer (error 104) W0301 23:04:33.473320 23240 connection.cc:647] server connection from 127.0.22.157:57779 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.157:57779): Connection reset by peer (error 104) W0301 23:04:33.473340 23367 connection.cc:647] server connection from 127.0.22.157:59709 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.157:59709): Connection reset by peer (error 104) I0301 23:04:33.473449 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 27182 W0301 23:04:33.475608 23304 connection.cc:647] server connection from 127.0.22.158:53287 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.158:53287): Connection reset by peer (error 104) W0301 23:04:33.475632 23239 connection.cc:647] server connection from 127.0.22.158:53979 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.158:53979): Connection reset by peer (error 104) W0301 23:04:33.475648 23366 connection.cc:647] server connection from 127.0.22.158:34827 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.158:34827): Connection reset by peer (error 104) I0301 23:04:33.475764 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 27314 W0301 23:04:33.478018 23302 connection.cc:647] server connection from 127.0.22.159:48375 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.159:48375): Connection reset by peer (error 104) W0301 23:04:33.478021 23240 connection.cc:647] server connection from 127.0.22.159:43787 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.159:43787): Connection reset by peer (error 104) W0301 23:04:33.478032 23365 connection.cc:647] server connection from 127.0.22.159:53949 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.159:53949): Connection reset by peer (error 104) I0301 23:04:33.478087 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-tserver with pid 27442 W0301 23:04:33.480432 23237 connection.cc:647] server connection from 127.0.22.160:56609 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.160:56609): Connection reset by peer (error 104) W0301 23:04:33.480672 23302 connection.cc:647] server connection from 127.0.22.160:48183 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.160:48183): Connection reset by peer (error 104) W0301 23:04:33.480844 23366 connection.cc:647] server connection from 127.0.22.160:43353 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.160:43353): Connection reset by peer (error 104) I0301 23:04:33.480919 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 23230 W0301 23:04:33.483783 18889 connection.cc:647] client connection to 127.0.22.190:40937 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.190:40937): Connection reset by peer (error 104) W0301 23:04:33.483786 23367 connection.cc:647] server connection from 127.0.0.1:52554 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:52554): Connection reset by peer (error 104) W0301 23:04:33.483811 23303 connection.cc:647] server connection from 127.0.0.1:36972 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36972): Connection reset by peer (error 104) I0301 23:04:33.484004 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 23291 W0301 23:04:33.486402 18889 connection.cc:647] client connection to 127.0.22.189:40771 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.189:40771): Connection reset by peer (error 104) I0301 23:04:33.486515 90 external_mini_cluster.cc:1131] Killing /tmp/dist-test-task3pD_4V/build/release/bin/kudu-master with pid 23355 W0301 23:04:33.488956 18889 connection.cc:647] client connection to 127.0.22.188:41299 recv error: Network error: failed to read from TLS socket (remote: 127.0.22.188:41299): Connection reset by peer (error 104) [ OK ] TsLocationAssignmentITest.Basic/7 (6992 ms) [----------] 8 tests from TsLocationAssignmentITest (54074 ms total) [----------] Global test environment tear-down [==========] 9 tests from 2 test cases ran. (55097 ms total) [ PASSED ] 8 tests. [ FAILED ] 1 test, listed below: [ FAILED ] TsLocationAssignmentITest.Basic/3, where GetParam() = (1, 32) 1 FAILED TEST