Note: This is test shard 1 of 4. [==========] Running 18 tests from 5 test cases. [----------] Global test environment set-up. [----------] 13 tests from ToolTest [ RUN ] ToolTest.TestHelpXML [ OK ] ToolTest.TestHelpXML (1910 ms) [ RUN ] ToolTest.TestActionMissingRequiredArg [ OK ] ToolTest.TestActionMissingRequiredArg (3583 ms) [ RUN ] ToolTest.TestFsFormatWithUuid WARNING: Logging before InitGoogleLogging() is written to STDERR I0405 05:40:19.226826 236 fs_manager.cc:263] Metadata directory not provided I0405 05:40:19.227164 236 fs_manager.cc:266] Using existing metadata directory in first data directory I0405 05:40:19.234728 236 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s I0405 05:40:19.235517 236 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:19.236100 236 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:19.244426 236 fs_report.cc:352] FS layout report -------------------- wal directory: metadata directory: 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestFsFormatWithUuid.1554442812470121-236/test/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:19.244819 236 fs_manager.cc:419] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s I0405 05:40:19.244964 236 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestFsFormatWithUuid.1554442812470121-236/test uuid: "abfd983e4f1646658693313c4404ae54" format_stamp: "Formatted at 2019-04-05 05:40:18 on dist-test-slave-dist-test-slave-bl6s" [ OK ] ToolTest.TestFsFormatWithUuid (1251 ms) [ RUN ] ToolTest.TestFsDumpBlock I0405 05:40:19.258563 236 fs_manager.cc:263] Metadata directory not provided I0405 05:40:19.258702 236 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:19.260082 236 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpBlock.1554442812470121-236/test/instance: uuid: "33038a8d4cae450e92666125967e1f53" format_stamp: "Formatted at 2019-04-05 05:40:19 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:19.268527 236 fs_manager.cc:503] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s I0405 05:40:19.269743 236 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:19.276610 236 fs_report.cc:352] FS layout report -------------------- wal directory: metadata directory: 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpBlock.1554442812470121-236/test/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:19.276932 236 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:40:19.277058 236 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpBlock.1554442812470121-236/test uuid: "33038a8d4cae450e92666125967e1f53" format_stamp: "Formatted at 2019-04-05 05:40:19 on dist-test-slave-dist-test-slave-bl6s" [ OK ] ToolTest.TestFsDumpBlock (1252 ms) [ RUN ] ToolTest.TestFsDumpTree I0405 05:40:20.511384 236 fs_manager.cc:263] Metadata directory not provided I0405 05:40:20.511559 236 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:20.512495 236 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpTree.1554442812470121-236/test/instance: uuid: "8c4c527a93904ed38ae8b65aed7ab395" format_stamp: "Formatted at 2019-04-05 05:40:20 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:20.523231 236 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.004s sys 0.008s I0405 05:40:20.524533 236 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:20.531013 236 fs_report.cc:352] FS layout report -------------------- wal directory: metadata directory: 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpTree.1554442812470121-236/test/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:20.531330 236 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.001s I0405 05:40:20.531458 236 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpTree.1554442812470121-236/test uuid: "8c4c527a93904ed38ae8b65aed7ab395" format_stamp: "Formatted at 2019-04-05 05:40:20 on dist-test-slave-dist-test-slave-bl6s" [ OK ] ToolTest.TestFsDumpTree (1249 ms) [ RUN ] ToolTest.TestLoadgenAutoFlushBackgroundRandom I0405 05:40:21.783730 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:40085 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:21.933557 292 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:21.934087 292 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:21.945636 292 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:40:21.945847 292 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:21.945955 292 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:40:21.946081 292 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:40:21.964622 292 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:40085 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:21.980906 292 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 24516us I0405 05:40:21.982086 292 fs_manager.cc:263] Metadata directory not provided I0405 05:40:21.982235 292 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:21.982528 292 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:21.982645 292 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:21.986121 292 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "56f1d07e0d794fce8ee40898db54ee01" format_stamp: "Formatted at 2019-04-05 05:40:21 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:21.986958 292 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "56f1d07e0d794fce8ee40898db54ee01" format_stamp: "Formatted at 2019-04-05 05:40:21 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:21.998611 292 fs_manager.cc:503] Time spent creating directory manager: real 0.011s user 0.010s sys 0.001s I0405 05:40:22.000078 292 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:22.000818 292 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:22.009166 292 fs_manager.cc:419] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s I0405 05:40:22.009325 292 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/wal uuid: "56f1d07e0d794fce8ee40898db54ee01" format_stamp: "Formatted at 2019-04-05 05:40:21 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:22.009586 292 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:22.499882 292 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:22.577617 292 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:40085 I0405 05:40:22.581562 292 webserver.cc:308] Webserver started at http://127.0.59.62:32995/ using document root and password file I0405 05:40:22.582613 292 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:40:22.586211 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 292 I0405 05:40:22.587945 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.59.1:0 --local_ip_for_outbound_sockets=127.0.59.1 --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:40:22.588125 354 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:22.613704 354 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01: Bootstrap starting. I0405 05:40:22.618152 354 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01: No blocks or log segments found. Creating new log. I0405 05:40:22.619833 354 log.cc:525] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01: Log is configured to *not* fsync() on all Append() calls I0405 05:40:22.623719 354 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01: No bootstrap required, opened a new log I0405 05:40:22.649489 354 raft_consensus.cc:340] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56f1d07e0d794fce8ee40898db54ee01" member_type: VOTER } I0405 05:40:22.650043 354 raft_consensus.cc:366] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:22.650283 354 raft_consensus.cc:705] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 56f1d07e0d794fce8ee40898db54ee01, State: Initialized, Role: FOLLOWER I0405 05:40:22.650986 354 consensus_queue.cc:229] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56f1d07e0d794fce8ee40898db54ee01" member_type: VOTER } I0405 05:40:22.651504 354 raft_consensus.cc:380] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:22.651803 354 raft_consensus.cc:472] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:22.652102 354 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:22.657421 354 raft_consensus.cc:494] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56f1d07e0d794fce8ee40898db54ee01" member_type: VOTER } I0405 05:40:22.658154 354 leader_election.cc:310] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 56f1d07e0d794fce8ee40898db54ee01; no voters: I0405 05:40:22.661303 357 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:22.663368 354 leader_election.cc:296] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:22.765110 357 raft_consensus.cc:667] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [term 1 LEADER]: Becoming Leader. State: Replica: 56f1d07e0d794fce8ee40898db54ee01, State: Running, Role: LEADER I0405 05:40:22.766654 357 consensus_queue.cc:206] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56f1d07e0d794fce8ee40898db54ee01" member_type: VOTER } I0405 05:40:22.774902 354 sys_catalog.cc:337] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "56f1d07e0d794fce8ee40898db54ee01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56f1d07e0d794fce8ee40898db54ee01" member_type: VOTER } } I0405 05:40:22.775465 354 sys_catalog.cc:340] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [sys.catalog]: This master's current role is: LEADER I0405 05:40:22.776175 358 sys_catalog.cc:337] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 56f1d07e0d794fce8ee40898db54ee01. Latest consensus state: current_term: 1 leader_uuid: "56f1d07e0d794fce8ee40898db54ee01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56f1d07e0d794fce8ee40898db54ee01" member_type: VOTER } } I0405 05:40:22.776506 359 sys_catalog.cc:337] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "56f1d07e0d794fce8ee40898db54ee01" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "56f1d07e0d794fce8ee40898db54ee01" member_type: VOTER } } I0405 05:40:22.777122 358 sys_catalog.cc:340] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [sys.catalog]: This master's current role is: LEADER I0405 05:40:22.780246 359 sys_catalog.cc:340] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [sys.catalog]: This master's current role is: LEADER I0405 05:40:22.785497 354 sys_catalog.cc:424] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01 [sys.catalog]: configured and running, proceeding with master startup. I0405 05:40:22.786490 361 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:40:22.797448 361 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:22.813273 355 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:22.813913 355 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0405 05:40:22.829838 361 catalog_manager.cc:950] Generated new certificate authority record I0405 05:40:22.831416 361 catalog_manager.cc:1075] Loading token signing keys... W0405 05:40:22.833871 355 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:22.834455 355 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.1 I0405 05:40:22.841174 361 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 56f1d07e0d794fce8ee40898db54ee01: Generated new TSK 0 I0405 05:40:22.863054 355 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:22.892916 355 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 25016us I0405 05:40:22.893661 355 fs_manager.cc:263] Metadata directory not provided I0405 05:40:22.893874 355 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:22.894263 355 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:22.894438 355 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:22.899672 355 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "a37356ee097342538b072da484f76bd3" format_stamp: "Formatted at 2019-04-05 05:40:22 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:22.900768 355 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "a37356ee097342538b072da484f76bd3" format_stamp: "Formatted at 2019-04-05 05:40:22 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:22.931699 355 fs_manager.cc:503] Time spent creating directory manager: real 0.030s user 0.016s sys 0.016s I0405 05:40:22.933696 355 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:22.934528 355 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:22.945322 355 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s I0405 05:40:22.945529 355 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/wal uuid: "a37356ee097342538b072da484f76bd3" format_stamp: "Formatted at 2019-04-05 05:40:22 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:22.945917 355 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:23.574993 355 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:23.579782 355 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:23.579973 355 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:24.002446 355 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:35007 I0405 05:40:24.006474 355 webserver.cc:308] Webserver started at http://127.0.59.1:41869/ using document root and password file I0405 05:40:24.007553 355 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:40:24.012046 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 355 I0405 05:40:24.013166 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.59.2:0 --local_ip_for_outbound_sockets=127.0.59.2 --webserver_interface=127.0.59.2 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:40:24.059325 486 heartbeater.cc:345] Connected to a master server at 127.0.59.62:40085 I0405 05:40:24.059710 486 heartbeater.cc:426] Registering TS with master... I0405 05:40:24.060389 486 heartbeater.cc:475] Master 127.0.59.62:40085 requested a full tablet report, sending... I0405 05:40:24.063406 321 ts_manager.cc:159] Registered new tserver with Master: a37356ee097342538b072da484f76bd3 (127.0.59.1:35007) I0405 05:40:24.066171 321 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.1:49621 WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:24.163342 487 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:24.163786 487 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:24.173306 487 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:24.173697 487 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.2 I0405 05:40:24.190116 487 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.2:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.59.2 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.2 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:24.207811 487 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26016us I0405 05:40:24.208302 487 fs_manager.cc:263] Metadata directory not provided I0405 05:40:24.208428 487 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:24.208698 487 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:24.208806 487 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:24.211738 487 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/data/instance: uuid: "ec3926d7aa194fb5b34179301fb67a4d" format_stamp: "Formatted at 2019-04-05 05:40:24 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:24.212471 487 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/wal/instance: uuid: "ec3926d7aa194fb5b34179301fb67a4d" format_stamp: "Formatted at 2019-04-05 05:40:24 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:24.224453 487 fs_manager.cc:503] Time spent creating directory manager: real 0.012s user 0.010s sys 0.003s I0405 05:40:24.225714 487 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:24.226240 487 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:24.233345 487 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:40:24.233462 487 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/wal uuid: "ec3926d7aa194fb5b34179301fb67a4d" format_stamp: "Formatted at 2019-04-05 05:40:24 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:24.233705 487 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:40:24.778599 487 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.512s user 0.110s sys 0.400s W0405 05:40:24.778791 487 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.512s user 0.110s sys 0.400s I0405 05:40:24.798926 487 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:24.803565 487 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:24.803748 487 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:24.974793 487 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.2:42257 I0405 05:40:24.977730 487 webserver.cc:308] Webserver started at http://127.0.59.2:39759/ using document root and password file I0405 05:40:24.978588 487 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-1/data/info.pb I0405 05:40:24.982817 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 487 I0405 05:40:24.984026 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.59.3:0 --local_ip_for_outbound_sockets=127.0.59.3 --webserver_interface=127.0.59.3 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:40:25.003684 611 heartbeater.cc:345] Connected to a master server at 127.0.59.62:40085 I0405 05:40:25.003968 611 heartbeater.cc:426] Registering TS with master... I0405 05:40:25.004456 611 heartbeater.cc:475] Master 127.0.59.62:40085 requested a full tablet report, sending... I0405 05:40:25.005901 321 ts_manager.cc:159] Registered new tserver with Master: ec3926d7aa194fb5b34179301fb67a4d (127.0.59.2:42257) I0405 05:40:25.007570 321 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.2:43827 I0405 05:40:25.069453 486 heartbeater.cc:467] Master 127.0.59.62:40085 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:25.123458 615 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:25.123912 615 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:25.133602 615 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:25.134006 615 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.3 I0405 05:40:25.150863 615 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.3:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.59.3 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.3 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:25.168735 615 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 26516us I0405 05:40:25.169227 615 fs_manager.cc:263] Metadata directory not provided I0405 05:40:25.169350 615 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:25.169646 615 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:25.169844 615 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:25.172736 615 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/data/instance: uuid: "67fe2e497c1243dabeb7ef850bf4969d" format_stamp: "Formatted at 2019-04-05 05:40:25 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:25.173478 615 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/wal/instance: uuid: "67fe2e497c1243dabeb7ef850bf4969d" format_stamp: "Formatted at 2019-04-05 05:40:25 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:25.184212 615 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.006s sys 0.002s I0405 05:40:25.185492 615 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:25.186040 615 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:25.193197 615 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:40:25.193321 615 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/wal uuid: "67fe2e497c1243dabeb7ef850bf4969d" format_stamp: "Formatted at 2019-04-05 05:40:25 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:25.193567 615 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:40:25.744724 615 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.527s user 0.095s sys 0.431s W0405 05:40:25.744910 615 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.528s user 0.095s sys 0.431s I0405 05:40:25.770324 615 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:25.775357 615 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:25.775538 615 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:25.938477 615 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.3:41327 I0405 05:40:25.941397 615 webserver.cc:308] Webserver started at http://127.0.59.3:46563/ using document root and password file I0405 05:40:25.942200 615 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-2/data/info.pb I0405 05:40:25.948537 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 615 I0405 05:40:25.949674 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.0.59.4:0 --local_ip_for_outbound_sockets=127.0.59.4 --webserver_interface=127.0.59.4 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:40:25.977704 736 heartbeater.cc:345] Connected to a master server at 127.0.59.62:40085 I0405 05:40:25.978019 736 heartbeater.cc:426] Registering TS with master... I0405 05:40:25.978561 736 heartbeater.cc:475] Master 127.0.59.62:40085 requested a full tablet report, sending... I0405 05:40:25.980099 321 ts_manager.cc:159] Registered new tserver with Master: 67fe2e497c1243dabeb7ef850bf4969d (127.0.59.3:41327) I0405 05:40:25.982132 321 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.3:54427 I0405 05:40:26.010017 611 heartbeater.cc:467] Master 127.0.59.62:40085 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:26.095688 740 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:26.096114 740 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:26.105607 740 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:26.106034 740 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.4 I0405 05:40:26.122117 740 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.4:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/data/info.pb --webserver_interface=127.0.59.4 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.4 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:26.139611 740 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27016us I0405 05:40:26.140134 740 fs_manager.cc:263] Metadata directory not provided I0405 05:40:26.140270 740 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:26.140564 740 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:26.140691 740 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:26.143673 740 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/data/instance: uuid: "f581ad77010e48c08b65021ea7fc4569" format_stamp: "Formatted at 2019-04-05 05:40:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:26.144446 740 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/wal/instance: uuid: "f581ad77010e48c08b65021ea7fc4569" format_stamp: "Formatted at 2019-04-05 05:40:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:26.155628 740 fs_manager.cc:503] Time spent creating directory manager: real 0.011s user 0.010s sys 0.003s I0405 05:40:26.156852 740 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:26.157382 740 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:26.164741 740 fs_manager.cc:419] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s I0405 05:40:26.164880 740 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/wal uuid: "f581ad77010e48c08b65021ea7fc4569" format_stamp: "Formatted at 2019-04-05 05:40:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:26.165110 740 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:26.686246 740 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:26.689561 740 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:26.692296 740 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:26.862552 740 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.4:43425 I0405 05:40:26.864959 740 webserver.cc:308] Webserver started at http://127.0.59.4:46217/ using document root and password file I0405 05:40:26.865761 740 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-3/data/info.pb I0405 05:40:26.875203 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 740 I0405 05:40:26.876447 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.0.59.5:0 --local_ip_for_outbound_sockets=127.0.59.5 --webserver_interface=127.0.59.5 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:40:26.905381 861 heartbeater.cc:345] Connected to a master server at 127.0.59.62:40085 I0405 05:40:26.906220 861 heartbeater.cc:426] Registering TS with master... I0405 05:40:26.906939 861 heartbeater.cc:475] Master 127.0.59.62:40085 requested a full tablet report, sending... I0405 05:40:26.908604 321 ts_manager.cc:159] Registered new tserver with Master: f581ad77010e48c08b65021ea7fc4569 (127.0.59.4:43425) I0405 05:40:26.909714 321 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.4:59799 I0405 05:40:26.984694 736 heartbeater.cc:467] Master 127.0.59.62:40085 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:27.026181 865 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:27.026577 865 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:27.036123 865 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:27.036487 865 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.5 I0405 05:40:27.052664 865 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.5:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/data/info.pb --webserver_interface=127.0.59.5 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40085 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.5 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:27.070087 865 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 27516us I0405 05:40:27.070631 865 fs_manager.cc:263] Metadata directory not provided I0405 05:40:27.070749 865 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:27.071000 865 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:27.071105 865 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:27.074153 865 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/data/instance: uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" format_stamp: "Formatted at 2019-04-05 05:40:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:27.074853 865 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/wal/instance: uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" format_stamp: "Formatted at 2019-04-05 05:40:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:27.086207 865 fs_manager.cc:503] Time spent creating directory manager: real 0.011s user 0.010s sys 0.001s I0405 05:40:27.087417 865 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:27.087922 865 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:27.094393 865 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:40:27.094511 865 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/wal uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" format_stamp: "Formatted at 2019-04-05 05:40:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:27.094736 865 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:27.622738 865 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:27.626700 865 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:27.626896 865 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:27.792121 865 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.5:34661 I0405 05:40:27.794351 865 webserver.cc:308] Webserver started at http://127.0.59.5:45547/ using document root and password file I0405 05:40:27.795145 865 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236/minicluster-data/ts-4/data/info.pb I0405 05:40:27.803208 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 865 I0405 05:40:27.835022 986 heartbeater.cc:345] Connected to a master server at 127.0.59.62:40085 I0405 05:40:27.835402 986 heartbeater.cc:426] Registering TS with master... I0405 05:40:27.836189 986 heartbeater.cc:475] Master 127.0.59.62:40085 requested a full tablet report, sending... I0405 05:40:27.837949 321 ts_manager.cc:159] Registered new tserver with Master: facb8ca437fe4f77a2ee4af6ea171a7e (127.0.59.5:34661) I0405 05:40:27.840205 321 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.5:58363 I0405 05:40:27.840862 236 external_mini_cluster.cc:623] 5 TS(s) registered with all masters I0405 05:40:27.877418 321 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49996: name: "bench_auto_flush_background_random" schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 9 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 2 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } columns { name: "unixtime_micros_val" type: UNIXTIME_MICROS is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 5 split_rows_range_bounds { } partition_schema { hash_bucket_schemas { columns { name: "key" } num_buckets: 2 seed: 0 } } W0405 05:40:27.889879 321 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table bench_auto_flush_background_random in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers. I0405 05:40:27.912142 861 heartbeater.cc:467] Master 127.0.59.62:40085 was elected leader, sending a full tablet report... I0405 05:40:27.951704 923 tablet_service.cc:1006] Processing CreateTablet for tablet 0b0defba64c2467f94d78a20c7f4c2a0 (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0405 05:40:27.952807 923 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0b0defba64c2467f94d78a20c7f4c2a0. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:27.956768 798 tablet_service.cc:1006] Processing CreateTablet for tablet 0b0defba64c2467f94d78a20c7f4c2a0 (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0405 05:40:27.958268 798 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0b0defba64c2467f94d78a20c7f4c2a0. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:27.964781 422 tablet_service.cc:1006] Processing CreateTablet for tablet 767393d48e1a4b9dbb1c77d84243de2f (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0405 05:40:27.974061 422 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 767393d48e1a4b9dbb1c77d84243de2f. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:27.985296 673 tablet_service.cc:1006] Processing CreateTablet for tablet 0b0defba64c2467f94d78a20c7f4c2a0 (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0405 05:40:27.996059 673 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0b0defba64c2467f94d78a20c7f4c2a0. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:28.000720 547 tablet_service.cc:1006] Processing CreateTablet for tablet 767393d48e1a4b9dbb1c77d84243de2f (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0405 05:40:28.007761 547 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 767393d48e1a4b9dbb1c77d84243de2f. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:27.951736 922 tablet_service.cc:1006] Processing CreateTablet for tablet 767393d48e1a4b9dbb1c77d84243de2f (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0405 05:40:28.012188 922 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 767393d48e1a4b9dbb1c77d84243de2f. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:28.024726 1011 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e: Bootstrap starting. I0405 05:40:28.040987 1011 tablet_bootstrap.cc:590] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e: No blocks or log segments found. Creating new log. I0405 05:40:28.045003 1011 log.cc:525] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e: Log is configured to *not* fsync() on all Append() calls I0405 05:40:27.967519 423 tablet_service.cc:1006] Processing CreateTablet for tablet 0b0defba64c2467f94d78a20c7f4c2a0 (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0405 05:40:28.057250 423 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0b0defba64c2467f94d78a20c7f4c2a0. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:28.071741 1013 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3: Bootstrap starting. I0405 05:40:28.083689 1013 tablet_bootstrap.cc:590] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3: No blocks or log segments found. Creating new log. I0405 05:40:28.085490 1013 log.cc:525] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3: Log is configured to *not* fsync() on all Append() calls I0405 05:40:28.088634 1011 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e: No bootstrap required, opened a new log I0405 05:40:28.089109 1011 ts_tablet_manager.cc:1053] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e: Time spent bootstrapping tablet: real 0.065s user 0.000s sys 0.019s I0405 05:40:27.959647 797 tablet_service.cc:1006] Processing CreateTablet for tablet 767393d48e1a4b9dbb1c77d84243de2f (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0405 05:40:28.123471 797 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 767393d48e1a4b9dbb1c77d84243de2f. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:28.125309 1013 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3: No bootstrap required, opened a new log I0405 05:40:28.002149 548 tablet_service.cc:1006] Processing CreateTablet for tablet 0b0defba64c2467f94d78a20c7f4c2a0 (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0405 05:40:28.128188 548 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0b0defba64c2467f94d78a20c7f4c2a0. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:28.130236 1013 ts_tablet_manager.cc:1053] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3: Time spent bootstrapping tablet: real 0.059s user 0.005s sys 0.011s I0405 05:40:28.134608 1012 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569: Bootstrap starting. I0405 05:40:28.141945 1016 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d: Bootstrap starting. I0405 05:40:27.987540 672 tablet_service.cc:1006] Processing CreateTablet for tablet 767393d48e1a4b9dbb1c77d84243de2f (table=bench_auto_flush_background_random [id=11c4ba8e5d5f4674a5a339e9026d7a39]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0405 05:40:28.148891 672 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 767393d48e1a4b9dbb1c77d84243de2f. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:28.150035 1016 tablet_bootstrap.cc:590] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d: No blocks or log segments found. Creating new log. I0405 05:40:28.152848 1016 log.cc:525] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d: Log is configured to *not* fsync() on all Append() calls I0405 05:40:28.159512 1017 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d: Bootstrap starting. I0405 05:40:28.160084 1013 raft_consensus.cc:340] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.161087 1013 raft_consensus.cc:366] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.161322 1013 raft_consensus.cc:705] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a37356ee097342538b072da484f76bd3, State: Initialized, Role: FOLLOWER I0405 05:40:28.161917 1016 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d: No bootstrap required, opened a new log I0405 05:40:28.162302 1016 ts_tablet_manager.cc:1053] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d: Time spent bootstrapping tablet: real 0.023s user 0.005s sys 0.012s I0405 05:40:28.161947 1013 consensus_queue.cc:229] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.166246 1013 ts_tablet_manager.cc:1081] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3: Time spent starting tablet: real 0.036s user 0.025s sys 0.004s I0405 05:40:28.167027 1013 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3: Bootstrap starting. I0405 05:40:28.170275 1012 tablet_bootstrap.cc:590] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569: No blocks or log segments found. Creating new log. I0405 05:40:28.170992 1013 tablet_bootstrap.cc:590] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3: No blocks or log segments found. Creating new log. I0405 05:40:28.178601 1013 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3: No bootstrap required, opened a new log I0405 05:40:28.178942 1013 ts_tablet_manager.cc:1053] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s I0405 05:40:28.180414 1013 raft_consensus.cc:340] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.182025 1013 raft_consensus.cc:366] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.182214 1013 raft_consensus.cc:705] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a37356ee097342538b072da484f76bd3, State: Initialized, Role: FOLLOWER I0405 05:40:28.183059 1012 log.cc:525] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569: Log is configured to *not* fsync() on all Append() calls I0405 05:40:28.182607 1016 raft_consensus.cc:340] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.182744 1013 consensus_queue.cc:229] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.183359 1016 raft_consensus.cc:366] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.183533 1016 raft_consensus.cc:705] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec3926d7aa194fb5b34179301fb67a4d, State: Initialized, Role: FOLLOWER I0405 05:40:28.184310 1013 ts_tablet_manager.cc:1081] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3: Time spent starting tablet: real 0.005s user 0.003s sys 0.003s I0405 05:40:28.184839 1017 tablet_bootstrap.cc:590] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d: No blocks or log segments found. Creating new log. I0405 05:40:28.184293 1016 consensus_queue.cc:229] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.187090 1017 log.cc:525] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d: Log is configured to *not* fsync() on all Append() calls I0405 05:40:28.189880 1016 ts_tablet_manager.cc:1081] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d: Time spent starting tablet: real 0.027s user 0.027s sys 0.001s I0405 05:40:28.190466 1016 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d: Bootstrap starting. I0405 05:40:28.192998 1016 tablet_bootstrap.cc:590] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d: No blocks or log segments found. Creating new log. I0405 05:40:28.195713 1011 raft_consensus.cc:340] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.196449 1011 raft_consensus.cc:366] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.196626 1011 raft_consensus.cc:705] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: facb8ca437fe4f77a2ee4af6ea171a7e, State: Initialized, Role: FOLLOWER I0405 05:40:28.197299 1017 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d: No bootstrap required, opened a new log I0405 05:40:28.197723 1017 ts_tablet_manager.cc:1053] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.000s I0405 05:40:28.198173 1011 consensus_queue.cc:229] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.199429 1016 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d: No bootstrap required, opened a new log I0405 05:40:28.199811 1016 ts_tablet_manager.cc:1053] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d: Time spent bootstrapping tablet: real 0.009s user 0.006s sys 0.003s I0405 05:40:28.202018 1016 raft_consensus.cc:340] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.202796 1016 raft_consensus.cc:366] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.202826 1012 tablet_bootstrap.cc:439] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569: No bootstrap required, opened a new log I0405 05:40:28.203017 1016 raft_consensus.cc:705] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec3926d7aa194fb5b34179301fb67a4d, State: Initialized, Role: FOLLOWER I0405 05:40:28.203234 1012 ts_tablet_manager.cc:1053] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569: Time spent bootstrapping tablet: real 0.069s user 0.010s sys 0.003s I0405 05:40:28.203521 1016 consensus_queue.cc:229] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.206751 1016 ts_tablet_manager.cc:1081] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d: Time spent starting tablet: real 0.007s user 0.004s sys 0.001s I0405 05:40:28.212317 986 heartbeater.cc:467] Master 127.0.59.62:40085 was elected leader, sending a full tablet report... I0405 05:40:28.214387 1011 ts_tablet_manager.cc:1081] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e: Time spent starting tablet: real 0.125s user 0.025s sys 0.006s I0405 05:40:28.214870 1011 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e: Bootstrap starting. I0405 05:40:28.218529 1011 tablet_bootstrap.cc:590] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e: No blocks or log segments found. Creating new log. I0405 05:40:28.223659 1017 raft_consensus.cc:340] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.224392 1017 raft_consensus.cc:366] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.224571 1017 raft_consensus.cc:705] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67fe2e497c1243dabeb7ef850bf4969d, State: Initialized, Role: FOLLOWER I0405 05:40:28.225080 1017 consensus_queue.cc:229] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.227658 1011 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e: No bootstrap required, opened a new log I0405 05:40:28.228049 1011 ts_tablet_manager.cc:1053] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.002s I0405 05:40:28.228842 1017 ts_tablet_manager.cc:1081] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d: Time spent starting tablet: real 0.031s user 0.017s sys 0.005s I0405 05:40:28.229410 1017 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d: Bootstrap starting. I0405 05:40:28.229421 1012 raft_consensus.cc:340] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.229493 1011 raft_consensus.cc:340] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.231400 1012 raft_consensus.cc:366] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.231516 1011 raft_consensus.cc:366] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.231660 1012 raft_consensus.cc:705] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f581ad77010e48c08b65021ea7fc4569, State: Initialized, Role: FOLLOWER I0405 05:40:28.231725 1011 raft_consensus.cc:705] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: facb8ca437fe4f77a2ee4af6ea171a7e, State: Initialized, Role: FOLLOWER I0405 05:40:28.232311 1011 consensus_queue.cc:229] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.233044 1017 tablet_bootstrap.cc:590] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d: No blocks or log segments found. Creating new log. I0405 05:40:28.232425 1012 consensus_queue.cc:229] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } W0405 05:40:28.233512 612 tablet.cc:1786] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:40:28.236534 1011 ts_tablet_manager.cc:1081] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e: Time spent starting tablet: real 0.008s user 0.001s sys 0.004s I0405 05:40:28.238909 1012 ts_tablet_manager.cc:1081] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569: Time spent starting tablet: real 0.035s user 0.014s sys 0.012s I0405 05:40:28.239545 1012 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569: Bootstrap starting. I0405 05:40:28.241657 1017 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d: No bootstrap required, opened a new log I0405 05:40:28.242055 1017 ts_tablet_manager.cc:1053] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.000s I0405 05:40:28.243023 1012 tablet_bootstrap.cc:590] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569: No blocks or log segments found. Creating new log. I0405 05:40:28.243391 1017 raft_consensus.cc:340] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.243906 1017 raft_consensus.cc:366] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.244169 1017 raft_consensus.cc:705] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67fe2e497c1243dabeb7ef850bf4969d, State: Initialized, Role: FOLLOWER I0405 05:40:28.244835 1017 consensus_queue.cc:229] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.246270 1017 ts_tablet_manager.cc:1081] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s I0405 05:40:28.249393 1012 tablet_bootstrap.cc:439] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569: No bootstrap required, opened a new log I0405 05:40:28.249658 1012 ts_tablet_manager.cc:1053] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.008s I0405 05:40:28.250746 1012 raft_consensus.cc:340] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.251260 1012 raft_consensus.cc:366] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:28.251444 1012 raft_consensus.cc:705] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f581ad77010e48c08b65021ea7fc4569, State: Initialized, Role: FOLLOWER I0405 05:40:28.251788 1012 consensus_queue.cc:229] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.252748 1012 ts_tablet_manager.cc:1081] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s W0405 05:40:28.283710 488 tablet.cc:1786] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3: Can't schedule compaction. Clean time has not been advanced past its initial value. W0405 05:40:28.300693 987 tablet.cc:1786] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e: Can't schedule compaction. Clean time has not been advanced past its initial value. W0405 05:40:28.370393 862 tablet.cc:1786] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:40:28.432296 1028 raft_consensus.cc:472] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0405 05:40:28.432698 1028 raft_consensus.cc:494] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.434711 1028 leader_election.cc:296] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ec3926d7aa194fb5b34179301fb67a4d (127.0.59.2:42257), a37356ee097342538b072da484f76bd3 (127.0.59.1:35007), 67fe2e497c1243dabeb7ef850bf4969d (127.0.59.3:41327), facb8ca437fe4f77a2ee4af6ea171a7e (127.0.59.5:34661) I0405 05:40:28.454250 568 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767393d48e1a4b9dbb1c77d84243de2f" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3926d7aa194fb5b34179301fb67a4d" is_pre_election: true I0405 05:40:28.454905 568 raft_consensus.cc:2346] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 0. I0405 05:40:28.455386 943 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767393d48e1a4b9dbb1c77d84243de2f" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" is_pre_election: true I0405 05:40:28.455739 443 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767393d48e1a4b9dbb1c77d84243de2f" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a37356ee097342538b072da484f76bd3" is_pre_election: true I0405 05:40:28.456015 943 raft_consensus.cc:2346] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 0. I0405 05:40:28.456180 693 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767393d48e1a4b9dbb1c77d84243de2f" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67fe2e497c1243dabeb7ef850bf4969d" is_pre_election: true I0405 05:40:28.456384 443 raft_consensus.cc:2346] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 0. I0405 05:40:28.456758 693 raft_consensus.cc:2346] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 0. I0405 05:40:28.457149 748 leader_election.cc:310] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: ec3926d7aa194fb5b34179301fb67a4d, f581ad77010e48c08b65021ea7fc4569, facb8ca437fe4f77a2ee4af6ea171a7e; no voters: I0405 05:40:28.457837 1028 raft_consensus.cc:2640] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0405 05:40:28.458050 1028 raft_consensus.cc:472] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0405 05:40:28.458204 1028 raft_consensus.cc:2886] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Advancing to term 1 W0405 05:40:28.460079 737 tablet.cc:1786] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:40:28.461402 1028 raft_consensus.cc:494] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.462924 1028 leader_election.cc:296] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [CANDIDATE]: Term 1 election: Requested vote from peers ec3926d7aa194fb5b34179301fb67a4d (127.0.59.2:42257), a37356ee097342538b072da484f76bd3 (127.0.59.1:35007), 67fe2e497c1243dabeb7ef850bf4969d (127.0.59.3:41327), facb8ca437fe4f77a2ee4af6ea171a7e (127.0.59.5:34661) I0405 05:40:28.463341 568 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767393d48e1a4b9dbb1c77d84243de2f" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3926d7aa194fb5b34179301fb67a4d" I0405 05:40:28.463434 693 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767393d48e1a4b9dbb1c77d84243de2f" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67fe2e497c1243dabeb7ef850bf4969d" I0405 05:40:28.463670 568 raft_consensus.cc:2886] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.463780 693 raft_consensus.cc:2886] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.466022 443 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767393d48e1a4b9dbb1c77d84243de2f" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a37356ee097342538b072da484f76bd3" I0405 05:40:28.466375 443 raft_consensus.cc:2886] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.468159 693 raft_consensus.cc:2346] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 1. I0405 05:40:28.470592 943 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "767393d48e1a4b9dbb1c77d84243de2f" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" I0405 05:40:28.471060 943 raft_consensus.cc:2886] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.471626 568 raft_consensus.cc:2346] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 1. I0405 05:40:28.472424 750 leader_election.cc:310] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 67fe2e497c1243dabeb7ef850bf4969d, ec3926d7aa194fb5b34179301fb67a4d, f581ad77010e48c08b65021ea7fc4569; no voters: I0405 05:40:28.472965 1028 raft_consensus.cc:2640] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:28.475035 443 raft_consensus.cc:2346] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 1. I0405 05:40:28.475394 1028 raft_consensus.cc:667] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [term 1 LEADER]: Becoming Leader. State: Replica: f581ad77010e48c08b65021ea7fc4569, State: Running, Role: LEADER I0405 05:40:28.476171 1028 consensus_queue.cc:206] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } I0405 05:40:28.476701 943 raft_consensus.cc:2346] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 1. I0405 05:40:28.483003 319 catalog_manager.cc:3977] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 reported cstate change: term changed from 0 to 1, leader changed from to f581ad77010e48c08b65021ea7fc4569 (127.0.59.4). New cstate: current_term: 1 leader_uuid: "f581ad77010e48c08b65021ea7fc4569" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } health_report { overall_health: UNKNOWN } } } I0405 05:40:28.506057 1025 raft_consensus.cc:472] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0405 05:40:28.506412 1025 raft_consensus.cc:494] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.509392 1025 leader_election.cc:296] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67fe2e497c1243dabeb7ef850bf4969d (127.0.59.3:41327), f581ad77010e48c08b65021ea7fc4569 (127.0.59.4:43425), a37356ee097342538b072da484f76bd3 (127.0.59.1:35007), ec3926d7aa194fb5b34179301fb67a4d (127.0.59.2:42257) I0405 05:40:28.517176 1019 raft_consensus.cc:472] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0405 05:40:28.517581 1019 raft_consensus.cc:494] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.541920 1019 leader_election.cc:296] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67fe2e497c1243dabeb7ef850bf4969d (127.0.59.3:41327), f581ad77010e48c08b65021ea7fc4569 (127.0.59.4:43425), facb8ca437fe4f77a2ee4af6ea171a7e (127.0.59.5:34661), ec3926d7aa194fb5b34179301fb67a4d (127.0.59.2:42257) I0405 05:40:28.546975 568 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3926d7aa194fb5b34179301fb67a4d" is_pre_election: true I0405 05:40:28.547451 568 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate facb8ca437fe4f77a2ee4af6ea171a7e in term 0. I0405 05:40:28.549094 693 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67fe2e497c1243dabeb7ef850bf4969d" is_pre_election: true I0405 05:40:28.549634 693 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate facb8ca437fe4f77a2ee4af6ea171a7e in term 0. I0405 05:40:28.551060 877 leader_election.cc:310] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 67fe2e497c1243dabeb7ef850bf4969d, ec3926d7aa194fb5b34179301fb67a4d, facb8ca437fe4f77a2ee4af6ea171a7e; no voters: I0405 05:40:28.552331 1025 raft_consensus.cc:2640] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Leader pre-election won for term 1 I0405 05:40:28.552191 443 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a37356ee097342538b072da484f76bd3" is_pre_election: true I0405 05:40:28.552578 1025 raft_consensus.cc:472] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0405 05:40:28.552780 1025 raft_consensus.cc:2886] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.552726 443 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate facb8ca437fe4f77a2ee4af6ea171a7e in term 0. I0405 05:40:28.554919 1028 raft_consensus.cc:472] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0405 05:40:28.555368 1028 raft_consensus.cc:494] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.558642 443 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a37356ee097342538b072da484f76bd3" is_pre_election: true I0405 05:40:28.558815 693 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67fe2e497c1243dabeb7ef850bf4969d" is_pre_election: true I0405 05:40:28.559149 443 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 0. I0405 05:40:28.559319 693 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 0. I0405 05:40:28.560247 752 leader_election.cc:310] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 67fe2e497c1243dabeb7ef850bf4969d, a37356ee097342538b072da484f76bd3, f581ad77010e48c08b65021ea7fc4569; no voters: I0405 05:40:28.560487 1025 raft_consensus.cc:494] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.561056 1035 raft_consensus.cc:2640] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0405 05:40:28.561094 568 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3926d7aa194fb5b34179301fb67a4d" is_pre_election: true I0405 05:40:28.561287 1035 raft_consensus.cc:472] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0405 05:40:28.561493 1035 raft_consensus.cc:2886] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.561583 568 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 0. I0405 05:40:28.562523 1028 leader_election.cc:296] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 67fe2e497c1243dabeb7ef850bf4969d (127.0.59.3:41327), facb8ca437fe4f77a2ee4af6ea171a7e (127.0.59.5:34661), a37356ee097342538b072da484f76bd3 (127.0.59.1:35007), ec3926d7aa194fb5b34179301fb67a4d (127.0.59.2:42257) I0405 05:40:28.563398 443 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a37356ee097342538b072da484f76bd3" I0405 05:40:28.563725 443 raft_consensus.cc:2886] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.565505 1025 leader_election.cc:296] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [CANDIDATE]: Term 1 election: Requested vote from peers 67fe2e497c1243dabeb7ef850bf4969d (127.0.59.3:41327), f581ad77010e48c08b65021ea7fc4569 (127.0.59.4:43425), a37356ee097342538b072da484f76bd3 (127.0.59.1:35007), ec3926d7aa194fb5b34179301fb67a4d (127.0.59.2:42257) I0405 05:40:28.566314 568 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3926d7aa194fb5b34179301fb67a4d" I0405 05:40:28.566766 568 raft_consensus.cc:2886] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.567144 1035 raft_consensus.cc:494] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.567781 943 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" is_pre_election: true I0405 05:40:28.568408 943 raft_consensus.cc:2276] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f581ad77010e48c08b65021ea7fc4569 in current term 1: Already voted for candidate facb8ca437fe4f77a2ee4af6ea171a7e in this term. I0405 05:40:28.569614 693 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67fe2e497c1243dabeb7ef850bf4969d" I0405 05:40:28.569736 692 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67fe2e497c1243dabeb7ef850bf4969d" I0405 05:40:28.570091 693 raft_consensus.cc:2886] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:28.573472 1035 leader_election.cc:296] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [CANDIDATE]: Term 1 election: Requested vote from peers 67fe2e497c1243dabeb7ef850bf4969d (127.0.59.3:41327), facb8ca437fe4f77a2ee4af6ea171a7e (127.0.59.5:34661), a37356ee097342538b072da484f76bd3 (127.0.59.1:35007), ec3926d7aa194fb5b34179301fb67a4d (127.0.59.2:42257) I0405 05:40:28.573722 567 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3926d7aa194fb5b34179301fb67a4d" I0405 05:40:28.574069 442 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a37356ee097342538b072da484f76bd3" I0405 05:40:28.574285 568 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate facb8ca437fe4f77a2ee4af6ea171a7e in term 1. I0405 05:40:28.575260 693 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f581ad77010e48c08b65021ea7fc4569 in term 1. I0405 05:40:28.576864 692 raft_consensus.cc:2321] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate facb8ca437fe4f77a2ee4af6ea171a7e for term 1 because replica is already servicing an update from a current leader or another vote. I0405 05:40:28.576908 567 raft_consensus.cc:2321] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f581ad77010e48c08b65021ea7fc4569 for term 1 because replica is already servicing an update from a current leader or another vote. I0405 05:40:28.577699 818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f581ad77010e48c08b65021ea7fc4569" is_pre_election: true I0405 05:40:28.578608 818 raft_consensus.cc:2276] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate facb8ca437fe4f77a2ee4af6ea171a7e in current term 1: Already voted for candidate f581ad77010e48c08b65021ea7fc4569 in this term. I0405 05:40:28.578665 943 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "f581ad77010e48c08b65021ea7fc4569" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" I0405 05:40:28.578056 817 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f581ad77010e48c08b65021ea7fc4569" I0405 05:40:28.579217 943 raft_consensus.cc:2276] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f581ad77010e48c08b65021ea7fc4569 in current term 1: Already voted for candidate facb8ca437fe4f77a2ee4af6ea171a7e in this term. I0405 05:40:28.579480 817 raft_consensus.cc:2276] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate facb8ca437fe4f77a2ee4af6ea171a7e in current term 1: Already voted for candidate f581ad77010e48c08b65021ea7fc4569 in this term. I0405 05:40:28.580514 443 raft_consensus.cc:2346] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate facb8ca437fe4f77a2ee4af6ea171a7e in term 1. I0405 05:40:28.582062 442 raft_consensus.cc:2321] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f581ad77010e48c08b65021ea7fc4569 for term 1 because replica is already servicing an update from a current leader or another vote. I0405 05:40:28.587270 692 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "a37356ee097342538b072da484f76bd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67fe2e497c1243dabeb7ef850bf4969d" is_pre_election: true I0405 05:40:28.587368 873 leader_election.cc:310] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 5 responses out of 5 voters: 3 yes votes; 2 no votes. yes voters: a37356ee097342538b072da484f76bd3, ec3926d7aa194fb5b34179301fb67a4d, facb8ca437fe4f77a2ee4af6ea171a7e; no voters: 67fe2e497c1243dabeb7ef850bf4969d, f581ad77010e48c08b65021ea7fc4569 I0405 05:40:28.587527 748 leader_election.cc:310] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 67fe2e497c1243dabeb7ef850bf4969d, f581ad77010e48c08b65021ea7fc4569; no voters: a37356ee097342538b072da484f76bd3, ec3926d7aa194fb5b34179301fb67a4d, facb8ca437fe4f77a2ee4af6ea171a7e I0405 05:40:28.587806 692 raft_consensus.cc:2276] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a37356ee097342538b072da484f76bd3 in current term 1: Already voted for candidate f581ad77010e48c08b65021ea7fc4569 in this term. I0405 05:40:28.588150 1035 raft_consensus.cc:2588] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority I0405 05:40:28.588620 1025 raft_consensus.cc:2640] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:28.591099 1025 raft_consensus.cc:667] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 1 LEADER]: Becoming Leader. State: Replica: facb8ca437fe4f77a2ee4af6ea171a7e, State: Running, Role: LEADER I0405 05:40:28.591733 1025 consensus_queue.cc:206] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } } I0405 05:40:28.595872 943 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "a37356ee097342538b072da484f76bd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" is_pre_election: true I0405 05:40:28.596560 568 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "a37356ee097342538b072da484f76bd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ec3926d7aa194fb5b34179301fb67a4d" is_pre_election: true I0405 05:40:28.598136 568 raft_consensus.cc:2276] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a37356ee097342538b072da484f76bd3 in current term 1: Already voted for candidate facb8ca437fe4f77a2ee4af6ea171a7e in this term. I0405 05:40:28.599697 943 raft_consensus.cc:2307] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate a37356ee097342538b072da484f76bd3 for term 1 because replica is either leader or believes a valid leader to be alive. I0405 05:40:28.601897 373 leader_election.cc:310] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 5 voters: 1 yes votes; 3 no votes. yes voters: a37356ee097342538b072da484f76bd3; no voters: 67fe2e497c1243dabeb7ef850bf4969d, ec3926d7aa194fb5b34179301fb67a4d, facb8ca437fe4f77a2ee4af6ea171a7e I0405 05:40:28.602742 1019 raft_consensus.cc:2588] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0405 05:40:28.603283 319 catalog_manager.cc:3977] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e reported cstate change: term changed from 0 to 1, leader changed from to facb8ca437fe4f77a2ee4af6ea171a7e (127.0.59.5). New cstate: current_term: 1 leader_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 } health_report { overall_health: UNKNOWN } } } I0405 05:40:28.605497 817 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0b0defba64c2467f94d78a20c7f4c2a0" candidate_uuid: "a37356ee097342538b072da484f76bd3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f581ad77010e48c08b65021ea7fc4569" is_pre_election: true I0405 05:40:28.606034 817 raft_consensus.cc:2276] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a37356ee097342538b072da484f76bd3 in current term 1: Already voted for candidate f581ad77010e48c08b65021ea7fc4569 in this term. I0405 05:40:28.857252 943 raft_consensus.cc:1181] T 767393d48e1a4b9dbb1c77d84243de2f P facb8ca437fe4f77a2ee4af6ea171a7e [term 1 FOLLOWER]: Refusing update from remote peer f581ad77010e48c08b65021ea7fc4569: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0405 05:40:28.858392 1035 consensus_queue.cc:984] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "facb8ca437fe4f77a2ee4af6ea171a7e" member_type: VOTER last_known_addr { host: "127.0.59.5" port: 34661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0405 05:40:28.987979 692 raft_consensus.cc:1181] T 0b0defba64c2467f94d78a20c7f4c2a0 P 67fe2e497c1243dabeb7ef850bf4969d [term 1 FOLLOWER]: Refusing update from remote peer facb8ca437fe4f77a2ee4af6ea171a7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0405 05:40:28.989089 1025 consensus_queue.cc:984] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0405 05:40:29.024916 568 raft_consensus.cc:1181] T 767393d48e1a4b9dbb1c77d84243de2f P ec3926d7aa194fb5b34179301fb67a4d [term 1 FOLLOWER]: Refusing update from remote peer f581ad77010e48c08b65021ea7fc4569: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0405 05:40:29.026021 1035 consensus_queue.cc:984] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0405 05:40:29.044709 692 raft_consensus.cc:1181] T 767393d48e1a4b9dbb1c77d84243de2f P 67fe2e497c1243dabeb7ef850bf4969d [term 1 FOLLOWER]: Refusing update from remote peer f581ad77010e48c08b65021ea7fc4569: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0405 05:40:29.046062 1062 consensus_queue.cc:984] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "67fe2e497c1243dabeb7ef850bf4969d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 41327 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0405 05:40:29.049911 443 raft_consensus.cc:1181] T 767393d48e1a4b9dbb1c77d84243de2f P a37356ee097342538b072da484f76bd3 [term 1 FOLLOWER]: Refusing update from remote peer f581ad77010e48c08b65021ea7fc4569: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0405 05:40:29.051426 1035 consensus_queue.cc:984] T 767393d48e1a4b9dbb1c77d84243de2f P f581ad77010e48c08b65021ea7fc4569 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0405 05:40:29.097944 568 raft_consensus.cc:1181] T 0b0defba64c2467f94d78a20c7f4c2a0 P ec3926d7aa194fb5b34179301fb67a4d [term 1 FOLLOWER]: Refusing update from remote peer facb8ca437fe4f77a2ee4af6ea171a7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0405 05:40:29.098855 1025 consensus_queue.cc:984] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ec3926d7aa194fb5b34179301fb67a4d" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 42257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0405 05:40:29.114614 443 raft_consensus.cc:1181] T 0b0defba64c2467f94d78a20c7f4c2a0 P a37356ee097342538b072da484f76bd3 [term 1 FOLLOWER]: Refusing update from remote peer facb8ca437fe4f77a2ee4af6ea171a7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0405 05:40:29.132345 1072 consensus_queue.cc:984] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a37356ee097342538b072da484f76bd3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s I0405 05:40:29.136957 817 raft_consensus.cc:1181] T 0b0defba64c2467f94d78a20c7f4c2a0 P f581ad77010e48c08b65021ea7fc4569 [term 1 FOLLOWER]: Refusing update from remote peer facb8ca437fe4f77a2ee4af6ea171a7e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0405 05:40:29.139869 1025 consensus_queue.cc:984] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f581ad77010e48c08b65021ea7fc4569" member_type: VOTER last_known_addr { host: "127.0.59.4" port: 43425 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s W0405 05:40:29.341495 1076 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:29.949453 1076 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.549s user 0.002s sys 0.000s W0405 05:40:29.949669 1076 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.549s user 0.002s sys 0.000s Using table 'bench_auto_flush_background_random' Generator report time total : 130.906 ms time per row: 8.1816 ms Scanner report expected rows: 16 actual rows : 16 ================== WARNING: ThreadSanitizer: destroy of a locked mutex (pid=1076) #0 pthread_rwlock_destroy /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1313 (kudu+0x4b4474) #1 glog_internal_namespace_::Mutex::~Mutex() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:249:30 (libglog.so.0+0x16488) #2 cxa_at_exit_wrapper(void*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:386 (kudu+0x484803) and: #0 operator delete(void*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_new_delete.cc:119 (kudu+0x523cf1) #1 google::protobuf::FieldDescriptorProto::~FieldDescriptorProto() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/descriptor.pb.cc:4916:47 (libprotobuf.so.14+0x19c3b1) #2 google::protobuf::internal::GenericTypeHandler::Delete(google::protobuf::FieldDescriptorProto*, google::protobuf::Arena*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/repeated_field.h:615:7 (libprotobuf.so.14+0x1973b1) #3 void google::protobuf::internal::RepeatedPtrFieldBase::Destroy::TypeHandler>() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/repeated_field.h:1429 (libprotobuf.so.14+0x1973b1) #4 google::protobuf::RepeatedPtrField::~RepeatedPtrField() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/repeated_field.h:1892 (libprotobuf.so.14+0x1973b1) #5 google::protobuf::DescriptorProto::~DescriptorProto() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/descriptor.pb.cc:3528 (libprotobuf.so.14+0x1973b1) #6 google::protobuf::DescriptorProto::~DescriptorProto() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/descriptor.pb.cc:3525:37 (libprotobuf.so.14+0x197519) #7 google::protobuf::internal::GenericTypeHandler::Delete(google::protobuf::DescriptorProto*, google::protobuf::Arena*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/repeated_field.h:615:7 (libprotobuf.so.14+0x18e8c1) #8 void google::protobuf::internal::RepeatedPtrFieldBase::Destroy::TypeHandler>() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/repeated_field.h:1429 (libprotobuf.so.14+0x18e8c1) #9 google::protobuf::RepeatedPtrField::~RepeatedPtrField() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/repeated_field.h:1892 (libprotobuf.so.14+0x18e8c1) #10 google::protobuf::FileDescriptorProto::~FileDescriptorProto() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/descriptor.pb.cc:1426 (libprotobuf.so.14+0x18e8c1) #11 google::protobuf::EncodedDescriptorDatabase::Add(void const*, int) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/descriptor_database.cc:322:1 (libprotobuf.so.14+0x182dcd) #12 google::protobuf::DescriptorPool::InternalAddGeneratedFile(void const*, int) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/descriptor.cc:1315:3 (libprotobuf.so.14+0x13b705) #13 google::protobuf::protobuf_google_2fprotobuf_2ftype_2eproto::(anonymous namespace)::AddDescriptorsImpl() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/type.pb.cc:240:3 (libprotobuf.so.14+0x237c10) #14 google::protobuf::internal::FunctionClosure0::Run() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/stubs/callback.h:129:5 (libprotobuf.so.14+0xd330b) #15 google::protobuf::GoogleOnceInitImpl(long*, google::protobuf::Closure*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/stubs/once.cc:83:14 (libprotobuf.so.14+0xd5d6a) #16 google::protobuf::GoogleOnceInit(long*, void (*)()) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/stubs/once.h:128:5 (libprotobuf.so.14+0x237b66) #17 google::protobuf::protobuf_google_2fprotobuf_2ftype_2eproto::AddDescriptors() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/type.pb.cc:251 (libprotobuf.so.14+0x237b66) #18 google::protobuf::protobuf_google_2fprotobuf_2fapi_2eproto::(anonymous namespace)::AddDescriptorsImpl() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/api.pb.cc:179:3 (libprotobuf.so.14+0x12ca1d) #19 google::protobuf::internal::FunctionClosure0::Run() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/stubs/callback.h:129:5 (libprotobuf.so.14+0xd330b) #20 google::protobuf::GoogleOnceInitImpl(long*, google::protobuf::Closure*) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/stubs/once.cc:83:14 (libprotobuf.so.14+0xd5d6a) #21 google::protobuf::GoogleOnceInit(long*, void (*)()) /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/stubs/once.h:128:5 (libprotobuf.so.14+0xcf0a6) #22 google::protobuf::protobuf_google_2fprotobuf_2fapi_2eproto::AddDescriptors() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/api.pb.cc:185 (libprotobuf.so.14+0xcf0a6) #23 google::protobuf::protobuf_google_2fprotobuf_2fapi_2eproto::StaticDescriptorInitializer::StaticDescriptorInitializer() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/api.pb.cc:190 (libprotobuf.so.14+0xcf0a6) #24 __cxx_global_var_init /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/api.pb.cc:192 (libprotobuf.so.14+0xcf0a6) #25 _GLOBAL__sub_I_api.pb.cc /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/protobuf-3.4.1/src/google/protobuf/api.pb.cc (libprotobuf.so.14+0xcf0a6) #26 call_init /build/eglibc-SvCtMH/eglibc-2.19/elf/dl-init.c:78 (ld-linux-x86-64.so.2+0x102d9) Location is global 'google::vmodule_lock' of size 64 at 0x7efc2674e878 (libglog.so.0+0x00000023c878) Mutex M132 (0x7efc2674e878) created at: #0 pthread_rwlock_init /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-6.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors.cc:1304 (kudu+0x4b46e4) #1 glog_internal_namespace_::Mutex::Mutex() /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:247:19 (libglog.so.0+0xcca6) #2 __cxx_global_var_init.15 /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/vlog_is_on.cc:120 (libglog.so.0+0xcca6) #3 _GLOBAL__sub_I_vlog_is_on.cc /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/vlog_is_on.cc (libglog.so.0+0xcca6) #4 call_init /build/eglibc-SvCtMH/eglibc-2.19/elf/dl-init.c:78 (ld-linux-x86-64.so.2+0x102d9) SUMMARY: ThreadSanitizer: destroy of a locked mutex /data/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/glog-0.3.5/src/base/mutex.h:249:30 in glog_internal_namespace_::Mutex::~Mutex() ================== ThreadSanitizer: reported 1 warnings /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tools/kudu-tool-test.cc:1996: Failure Failed Bad status: Runtime error: /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu: process exited with non-zero status 66 /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tools/kudu-tool-test.cc:2033: Failure Expected: RunLoadgen(5, { "--buffer_flush_watermark_pct=0.125", "--buffer_size_bytes=65536", "--buffers_num=8", "--num_rows_per_thread=16", "--num_threads=1", "--run_scan", "--string_len=8", "--use_random", }, "bench_auto_flush_background_random") doesn't generate new fatal failures in the current thread. Actual: it does. I0405 05:40:31.297757 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 355 I0405 05:40:31.327579 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 487 I0405 05:40:31.351951 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 615 W0405 05:40:31.355260 873 consensus_peers.cc:457] T 0b0defba64c2467f94d78a20c7f4c2a0 P facb8ca437fe4f77a2ee4af6ea171a7e -> Peer a37356ee097342538b072da484f76bd3 (127.0.59.1:35007): Couldn't send request to peer a37356ee097342538b072da484f76bd3. Status: Network error: Client connection negotiation failed: client connection to 127.0.59.1:35007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0405 05:40:31.377568 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 740 I0405 05:40:31.396442 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 865 I0405 05:40:31.414378 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 292 I0405 05:40:31.443878 236 test_util.cc:135] ----------------------------------------------- I0405 05:40:31.444095 236 test_util.cc:136] Had fatal failures, leaving test files at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554442812470121-236 [ FAILED ] ToolTest.TestLoadgenAutoFlushBackgroundRandom (9692 ms) [ RUN ] ToolTest.TestLoadgenHmsEnabled 2019-04-05 05:40:32: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/derby.log log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvH0aH1/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvH0aH1/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Starting hive metastore on port 0 2750 T1 odu.Log4JLogger.info Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2762 T1 odu.Log4JLogger.info Property datanucleus.cache.level2 unknown - will be ignored I0405 05:40:42.936645 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:44821 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:43.084158 1249 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:43.084620 1249 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:43.096453 1249 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:40:43.096609 1249 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:43.096745 1249 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:40:43.096890 1249 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:40:43.113535 1249 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:44821 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:43.128026 1249 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 35516us I0405 05:40:43.128984 1249 fs_manager.cc:263] Metadata directory not provided I0405 05:40:43.129142 1249 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:43.129393 1249 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:43.129487 1249 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:43.132587 1249 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "602375174f824d7ebda42dc5b5d0a3a2" format_stamp: "Formatted at 2019-04-05 05:40:43 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:43.133363 1249 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "602375174f824d7ebda42dc5b5d0a3a2" format_stamp: "Formatted at 2019-04-05 05:40:43 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:43.143560 1249 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.007s sys 0.005s I0405 05:40:43.144842 1249 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:43.145385 1249 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:43.151991 1249 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:40:43.152117 1249 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/wal uuid: "602375174f824d7ebda42dc5b5d0a3a2" format_stamp: "Formatted at 2019-04-05 05:40:43 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:43.152369 1249 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:43.660636 1249 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:43.728165 1249 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:44821 I0405 05:40:43.731158 1249 webserver.cc:308] Webserver started at http://127.0.59.62:34913/ using document root and password file I0405 05:40:43.732229 1249 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:40:43.735469 1310 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:43.737320 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 1249 I0405 05:40:43.738746 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.59.1:0 --local_ip_for_outbound_sockets=127.0.59.1 --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:44821 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:40:43.761572 1310 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Bootstrap starting. I0405 05:40:43.768630 1310 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: No blocks or log segments found. Creating new log. I0405 05:40:43.774056 1310 log.cc:525] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Log is configured to *not* fsync() on all Append() calls I0405 05:40:43.783609 1310 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: No bootstrap required, opened a new log I0405 05:40:43.804903 1310 raft_consensus.cc:340] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602375174f824d7ebda42dc5b5d0a3a2" member_type: VOTER } I0405 05:40:43.805420 1310 raft_consensus.cc:366] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:43.805618 1310 raft_consensus.cc:705] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 602375174f824d7ebda42dc5b5d0a3a2, State: Initialized, Role: FOLLOWER I0405 05:40:43.806313 1310 consensus_queue.cc:229] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602375174f824d7ebda42dc5b5d0a3a2" member_type: VOTER } I0405 05:40:43.806829 1310 raft_consensus.cc:380] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:43.807063 1310 raft_consensus.cc:472] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:43.807358 1310 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:43.811862 1310 raft_consensus.cc:494] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602375174f824d7ebda42dc5b5d0a3a2" member_type: VOTER } I0405 05:40:43.812515 1310 leader_election.cc:310] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 602375174f824d7ebda42dc5b5d0a3a2; no voters: I0405 05:40:43.818361 1310 leader_election.cc:296] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:43.818668 1313 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:43.898234 1313 raft_consensus.cc:667] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [term 1 LEADER]: Becoming Leader. State: Replica: 602375174f824d7ebda42dc5b5d0a3a2, State: Running, Role: LEADER I0405 05:40:43.898738 1313 consensus_queue.cc:206] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602375174f824d7ebda42dc5b5d0a3a2" member_type: VOTER } I0405 05:40:43.903378 1310 sys_catalog.cc:337] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "602375174f824d7ebda42dc5b5d0a3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602375174f824d7ebda42dc5b5d0a3a2" member_type: VOTER } } I0405 05:40:43.903566 1315 sys_catalog.cc:337] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 602375174f824d7ebda42dc5b5d0a3a2. Latest consensus state: current_term: 1 leader_uuid: "602375174f824d7ebda42dc5b5d0a3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602375174f824d7ebda42dc5b5d0a3a2" member_type: VOTER } } I0405 05:40:43.904028 1310 sys_catalog.cc:340] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [sys.catalog]: This master's current role is: LEADER I0405 05:40:43.903506 1314 sys_catalog.cc:337] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "602375174f824d7ebda42dc5b5d0a3a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "602375174f824d7ebda42dc5b5d0a3a2" member_type: VOTER } } I0405 05:40:43.904662 1314 sys_catalog.cc:340] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [sys.catalog]: This master's current role is: LEADER I0405 05:40:43.905150 1315 sys_catalog.cc:340] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [sys.catalog]: This master's current role is: LEADER I0405 05:40:43.908710 1310 sys_catalog.cc:424] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2 [sys.catalog]: configured and running, proceeding with master startup. I0405 05:40:43.910681 1317 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:40:43.916352 1317 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:43.929036 1311 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:43.929612 1311 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:43.945498 1311 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:43.946360 1311 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.1 I0405 05:40:43.948876 1317 catalog_manager.cc:950] Generated new certificate authority record I0405 05:40:43.950368 1317 catalog_manager.cc:1075] Loading token signing keys... I0405 05:40:43.970263 1311 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:44821 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:43.970937 1317 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Generated new TSK 0 I0405 05:40:43.996673 1311 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 35516us I0405 05:40:43.997385 1311 fs_manager.cc:263] Metadata directory not provided I0405 05:40:43.997565 1311 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:43.997975 1311 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:43.998145 1311 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:44.002669 1311 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "3e8fb9a698764665b4082521a37740b3" format_stamp: "Formatted at 2019-04-05 05:40:43 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:44.003687 1311 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "3e8fb9a698764665b4082521a37740b3" format_stamp: "Formatted at 2019-04-05 05:40:43 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:44.018978 1311 fs_manager.cc:503] Time spent creating directory manager: real 0.015s user 0.014s sys 0.002s I0405 05:40:44.020812 1311 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:44.021528 1311 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:44.032590 1311 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:40:44.032793 1311 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal uuid: "3e8fb9a698764665b4082521a37740b3" format_stamp: "Formatted at 2019-04-05 05:40:43 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:44.033102 1311 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:40:44.626612 1311 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.561s user 0.128s sys 0.432s W0405 05:40:44.626861 1311 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.562s user 0.128s sys 0.432s I0405 05:40:44.680444 1311 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:44.687427 1311 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:44.687737 1311 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:44.874976 1311 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:34407 I0405 05:40:44.877312 1311 webserver.cc:308] Webserver started at http://127.0.59.1:41095/ using document root and password file I0405 05:40:44.878242 1311 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:40:44.880916 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 1311 I0405 05:40:44.911295 1442 heartbeater.cc:345] Connected to a master server at 127.0.59.62:44821 I0405 05:40:44.911617 1442 heartbeater.cc:426] Registering TS with master... I0405 05:40:44.912137 1442 heartbeater.cc:475] Master 127.0.59.62:44821 requested a full tablet report, sending... I0405 05:40:44.913993 1277 ts_manager.cc:159] Registered new tserver with Master: 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) I0405 05:40:44.916090 1277 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.1:53959 I0405 05:40:44.917093 236 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0405 05:40:45.648924 1277 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47498: name: "default.loadgen_auto_a3236e41762041af82782d61e2842a2f" schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { hash_bucket_schemas { columns { name: "key" } num_buckets: 8 seed: 0 } } I0405 05:40:45.719905 1377 tablet_service.cc:1006] Processing CreateTablet for tablet 34c9b96f562f44aa81208b52e2b2babd (table=default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED I0405 05:40:45.721470 1377 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 34c9b96f562f44aa81208b52e2b2babd. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:45.720122 1373 tablet_service.cc:1006] Processing CreateTablet for tablet dc5edbb341cc46538c98cbc2b2034487 (table=default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED I0405 05:40:45.749089 1373 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet dc5edbb341cc46538c98cbc2b2034487. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:45.720561 1375 tablet_service.cc:1006] Processing CreateTablet for tablet b89228c0b8b64f8aa59460436a040572 (table=default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED I0405 05:40:45.750476 1375 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b89228c0b8b64f8aa59460436a040572. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:45.720574 1374 tablet_service.cc:1006] Processing CreateTablet for tablet 51136496936e44e8ab763870c232d487 (table=default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED I0405 05:40:45.754186 1374 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 51136496936e44e8ab763870c232d487. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:45.720584 1378 tablet_service.cc:1006] Processing CreateTablet for tablet 237cfe4bde594dc5b5d4f7642260a6e1 (table=default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0405 05:40:45.758705 1378 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 237cfe4bde594dc5b5d4f7642260a6e1. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:45.722007 1379 tablet_service.cc:1006] Processing CreateTablet for tablet 4738983f4c574127b1fdde41bc9c0591 (table=default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0405 05:40:45.832140 1379 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4738983f4c574127b1fdde41bc9c0591. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:45.722237 1372 tablet_service.cc:1006] Processing CreateTablet for tablet 1d17dd16c7c44c8690168e2f5b4216ad (table=default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED I0405 05:40:45.834097 1372 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1d17dd16c7c44c8690168e2f5b4216ad. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:45.721959 1376 tablet_service.cc:1006] Processing CreateTablet for tablet 1db483145cd145efa5e8c206f6643f1a (table=default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED I0405 05:40:45.837280 1376 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1db483145cd145efa5e8c206f6643f1a. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:45.843925 1467 tablet_bootstrap.cc:439] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: Bootstrap starting. I0405 05:40:45.847878 1467 tablet_bootstrap.cc:590] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: No blocks or log segments found. Creating new log. I0405 05:40:45.849225 1467 log.cc:525] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: Log is configured to *not* fsync() on all Append() calls I0405 05:40:45.851683 1467 tablet_bootstrap.cc:439] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: No bootstrap required, opened a new log I0405 05:40:45.852003 1467 ts_tablet_manager.cc:1053] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s I0405 05:40:45.863870 1467 raft_consensus.cc:340] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.864367 1467 raft_consensus.cc:366] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:45.864528 1467 raft_consensus.cc:705] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Initialized, Role: FOLLOWER I0405 05:40:45.864984 1467 consensus_queue.cc:229] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.865372 1467 raft_consensus.cc:380] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:45.865545 1467 raft_consensus.cc:472] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:45.865751 1467 raft_consensus.cc:2886] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:45.868748 1467 raft_consensus.cc:494] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.869217 1467 leader_election.cc:310] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8fb9a698764665b4082521a37740b3; no voters: I0405 05:40:45.870918 1467 leader_election.cc:296] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:45.871249 1469 raft_consensus.cc:2640] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:45.873450 1442 heartbeater.cc:467] Master 127.0.59.62:44821 was elected leader, sending a full tablet report... I0405 05:40:45.873437 1469 raft_consensus.cc:667] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Running, Role: LEADER I0405 05:40:45.873963 1467 ts_tablet_manager.cc:1081] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: Time spent starting tablet: real 0.022s user 0.017s sys 0.005s I0405 05:40:45.874020 1469 consensus_queue.cc:206] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.874485 1467 tablet_bootstrap.cc:439] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: Bootstrap starting. I0405 05:40:45.877378 1467 tablet_bootstrap.cc:590] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: No blocks or log segments found. Creating new log. I0405 05:40:45.882052 1467 tablet_bootstrap.cc:439] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: No bootstrap required, opened a new log I0405 05:40:45.881873 1277 catalog_manager.cc:3977] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 reported cstate change: term changed from 0 to 1, leader changed from to 3e8fb9a698764665b4082521a37740b3 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "3e8fb9a698764665b4082521a37740b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } health_report { overall_health: HEALTHY } } } I0405 05:40:45.882308 1467 ts_tablet_manager.cc:1053] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s I0405 05:40:45.883464 1467 raft_consensus.cc:340] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.883874 1467 raft_consensus.cc:366] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:45.884058 1467 raft_consensus.cc:705] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Initialized, Role: FOLLOWER I0405 05:40:45.884575 1467 consensus_queue.cc:229] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.885015 1467 raft_consensus.cc:380] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:45.885160 1467 raft_consensus.cc:472] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:45.885330 1467 raft_consensus.cc:2886] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:45.889108 1467 raft_consensus.cc:494] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.889560 1467 leader_election.cc:310] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8fb9a698764665b4082521a37740b3; no voters: I0405 05:40:45.890075 1467 leader_election.cc:296] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:45.890184 1469 raft_consensus.cc:2640] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:45.890514 1469 raft_consensus.cc:667] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Running, Role: LEADER I0405 05:40:45.890890 1469 consensus_queue.cc:206] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.891058 1467 ts_tablet_manager.cc:1081] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s I0405 05:40:45.891665 1467 tablet_bootstrap.cc:439] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: Bootstrap starting. W0405 05:40:45.894488 1447 tablet.cc:1786] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:40:45.895037 1467 tablet_bootstrap.cc:590] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: No blocks or log segments found. Creating new log. I0405 05:40:45.895036 1276 catalog_manager.cc:3977] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 reported cstate change: term changed from 0 to 1, leader changed from to 3e8fb9a698764665b4082521a37740b3 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "3e8fb9a698764665b4082521a37740b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } health_report { overall_health: HEALTHY } } } I0405 05:40:45.898685 1467 tablet_bootstrap.cc:439] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: No bootstrap required, opened a new log I0405 05:40:45.898993 1467 ts_tablet_manager.cc:1053] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s I0405 05:40:45.900290 1467 raft_consensus.cc:340] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.900588 1467 raft_consensus.cc:366] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:45.900740 1467 raft_consensus.cc:705] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Initialized, Role: FOLLOWER I0405 05:40:45.901059 1467 consensus_queue.cc:229] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.901387 1467 raft_consensus.cc:380] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:45.901525 1467 raft_consensus.cc:472] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:45.901693 1467 raft_consensus.cc:2886] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:45.904486 1467 raft_consensus.cc:494] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.904857 1467 leader_election.cc:310] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8fb9a698764665b4082521a37740b3; no voters: I0405 05:40:45.905201 1467 leader_election.cc:296] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:45.905305 1469 raft_consensus.cc:2640] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:45.905623 1469 raft_consensus.cc:667] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Running, Role: LEADER I0405 05:40:45.906103 1467 ts_tablet_manager.cc:1081] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s I0405 05:40:45.905979 1469 consensus_queue.cc:206] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.906484 1467 tablet_bootstrap.cc:439] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: Bootstrap starting. I0405 05:40:45.908713 1467 tablet_bootstrap.cc:590] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: No blocks or log segments found. Creating new log. I0405 05:40:45.912403 1276 catalog_manager.cc:3977] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 reported cstate change: term changed from 0 to 1, leader changed from to 3e8fb9a698764665b4082521a37740b3 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "3e8fb9a698764665b4082521a37740b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } health_report { overall_health: HEALTHY } } } I0405 05:40:45.913027 1467 tablet_bootstrap.cc:439] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: No bootstrap required, opened a new log I0405 05:40:45.913309 1467 ts_tablet_manager.cc:1053] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s I0405 05:40:45.914355 1467 raft_consensus.cc:340] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.914667 1467 raft_consensus.cc:366] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:45.914868 1467 raft_consensus.cc:705] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Initialized, Role: FOLLOWER I0405 05:40:45.915274 1467 consensus_queue.cc:229] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.915725 1467 raft_consensus.cc:380] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:45.915868 1467 raft_consensus.cc:472] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:45.916045 1467 raft_consensus.cc:2886] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:45.919268 1467 raft_consensus.cc:494] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.919693 1467 leader_election.cc:310] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8fb9a698764665b4082521a37740b3; no voters: I0405 05:40:45.920078 1467 leader_election.cc:296] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:45.920164 1469 raft_consensus.cc:2640] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:45.920578 1469 raft_consensus.cc:667] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Running, Role: LEADER I0405 05:40:45.920876 1467 ts_tablet_manager.cc:1081] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s I0405 05:40:45.920925 1469 consensus_queue.cc:206] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.921286 1467 tablet_bootstrap.cc:439] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: Bootstrap starting. I0405 05:40:45.924023 1467 tablet_bootstrap.cc:590] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: No blocks or log segments found. Creating new log. I0405 05:40:45.924657 1276 catalog_manager.cc:3977] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 reported cstate change: term changed from 0 to 1, leader changed from to 3e8fb9a698764665b4082521a37740b3 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "3e8fb9a698764665b4082521a37740b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } health_report { overall_health: HEALTHY } } } I0405 05:40:45.927888 1467 tablet_bootstrap.cc:439] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: No bootstrap required, opened a new log I0405 05:40:45.928222 1467 ts_tablet_manager.cc:1053] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s I0405 05:40:45.929651 1467 raft_consensus.cc:340] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.930033 1467 raft_consensus.cc:366] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:45.930331 1467 raft_consensus.cc:705] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Initialized, Role: FOLLOWER I0405 05:40:45.930701 1467 consensus_queue.cc:229] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.931092 1467 raft_consensus.cc:380] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:45.931232 1467 raft_consensus.cc:472] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:45.931396 1467 raft_consensus.cc:2886] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:45.934589 1467 raft_consensus.cc:494] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.934974 1467 leader_election.cc:310] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8fb9a698764665b4082521a37740b3; no voters: I0405 05:40:45.935331 1467 leader_election.cc:296] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:45.935447 1469 raft_consensus.cc:2640] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:45.935786 1469 raft_consensus.cc:667] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Running, Role: LEADER I0405 05:40:45.936262 1467 ts_tablet_manager.cc:1081] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: Time spent starting tablet: real 0.008s user 0.009s sys 0.000s I0405 05:40:45.936137 1469 consensus_queue.cc:206] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.936666 1467 tablet_bootstrap.cc:439] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: Bootstrap starting. I0405 05:40:45.940026 1467 tablet_bootstrap.cc:590] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: No blocks or log segments found. Creating new log. I0405 05:40:45.940191 1276 catalog_manager.cc:3977] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 reported cstate change: term changed from 0 to 1, leader changed from to 3e8fb9a698764665b4082521a37740b3 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "3e8fb9a698764665b4082521a37740b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } health_report { overall_health: HEALTHY } } } I0405 05:40:45.944236 1467 tablet_bootstrap.cc:439] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: No bootstrap required, opened a new log I0405 05:40:45.944586 1467 ts_tablet_manager.cc:1053] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s I0405 05:40:45.945928 1467 raft_consensus.cc:340] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.946293 1467 raft_consensus.cc:366] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:45.946458 1467 raft_consensus.cc:705] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Initialized, Role: FOLLOWER I0405 05:40:45.946913 1467 consensus_queue.cc:229] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.947301 1467 raft_consensus.cc:380] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:45.947438 1467 raft_consensus.cc:472] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:45.947604 1467 raft_consensus.cc:2886] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:45.950824 1467 raft_consensus.cc:494] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.951299 1467 leader_election.cc:310] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8fb9a698764665b4082521a37740b3; no voters: I0405 05:40:45.951671 1467 leader_election.cc:296] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:45.951782 1469 raft_consensus.cc:2640] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:45.952098 1469 raft_consensus.cc:667] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Running, Role: LEADER I0405 05:40:45.952476 1467 ts_tablet_manager.cc:1081] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s I0405 05:40:45.952446 1469 consensus_queue.cc:206] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.952884 1467 tablet_bootstrap.cc:439] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: Bootstrap starting. I0405 05:40:45.955624 1467 tablet_bootstrap.cc:590] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: No blocks or log segments found. Creating new log. I0405 05:40:45.956831 1276 catalog_manager.cc:3977] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 reported cstate change: term changed from 0 to 1, leader changed from to 3e8fb9a698764665b4082521a37740b3 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "3e8fb9a698764665b4082521a37740b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } health_report { overall_health: HEALTHY } } } I0405 05:40:45.959683 1467 tablet_bootstrap.cc:439] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: No bootstrap required, opened a new log I0405 05:40:45.959928 1467 ts_tablet_manager.cc:1053] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s I0405 05:40:45.961283 1467 raft_consensus.cc:340] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.961699 1467 raft_consensus.cc:366] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:45.961910 1467 raft_consensus.cc:705] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Initialized, Role: FOLLOWER I0405 05:40:45.962416 1467 consensus_queue.cc:229] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.962906 1467 raft_consensus.cc:380] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:45.963095 1467 raft_consensus.cc:472] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:45.963310 1467 raft_consensus.cc:2886] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:45.966648 1467 raft_consensus.cc:494] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.966997 1467 leader_election.cc:310] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8fb9a698764665b4082521a37740b3; no voters: I0405 05:40:45.967334 1467 leader_election.cc:296] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:45.967435 1469 raft_consensus.cc:2640] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:45.967731 1469 raft_consensus.cc:667] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Running, Role: LEADER I0405 05:40:45.968050 1469 consensus_queue.cc:206] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.968463 1467 ts_tablet_manager.cc:1081] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s I0405 05:40:45.968860 1467 tablet_bootstrap.cc:439] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: Bootstrap starting. I0405 05:40:45.971894 1467 tablet_bootstrap.cc:590] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: No blocks or log segments found. Creating new log. I0405 05:40:45.971526 1276 catalog_manager.cc:3977] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 reported cstate change: term changed from 0 to 1, leader changed from to 3e8fb9a698764665b4082521a37740b3 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "3e8fb9a698764665b4082521a37740b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } health_report { overall_health: HEALTHY } } } I0405 05:40:45.976980 1467 tablet_bootstrap.cc:439] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: No bootstrap required, opened a new log I0405 05:40:45.977221 1467 ts_tablet_manager.cc:1053] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.004s I0405 05:40:45.978248 1467 raft_consensus.cc:340] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.978543 1467 raft_consensus.cc:366] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:45.978668 1467 raft_consensus.cc:705] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Initialized, Role: FOLLOWER I0405 05:40:45.978946 1467 consensus_queue.cc:229] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.979264 1467 raft_consensus.cc:380] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:45.979393 1467 raft_consensus.cc:472] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:45.979539 1467 raft_consensus.cc:2886] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:45.982378 1467 raft_consensus.cc:494] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.982739 1467 leader_election.cc:310] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e8fb9a698764665b4082521a37740b3; no voters: I0405 05:40:45.983062 1467 leader_election.cc:296] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:45.983166 1469 raft_consensus.cc:2640] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:45.983475 1469 raft_consensus.cc:667] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Becoming Leader. State: Replica: 3e8fb9a698764665b4082521a37740b3, State: Running, Role: LEADER I0405 05:40:45.983983 1467 ts_tablet_manager.cc:1081] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s I0405 05:40:45.983798 1469 consensus_queue.cc:206] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } } I0405 05:40:45.990028 1276 catalog_manager.cc:3977] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 reported cstate change: term changed from 0 to 1, leader changed from to 3e8fb9a698764665b4082521a37740b3 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "3e8fb9a698764665b4082521a37740b3" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e8fb9a698764665b4082521a37740b3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34407 } health_report { overall_health: HEALTHY } } } I0405 05:40:46.411993 1276 catalog_manager.cc:1890] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47498: table { table_name: "default.loadgen_auto_a3236e41762041af82782d61e2842a2f" } modify_external_catalogs: true I0405 05:40:46.420368 1276 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Sending DeleteTablet for 1 replicas of tablet 4738983f4c574127b1fdde41bc9c0591 I0405 05:40:46.420688 1276 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 4738983f4c574127b1fdde41bc9c0591 on 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) (Table deleted at 2019-04-05 05:40:46 UTC) I0405 05:40:46.421025 1276 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Sending DeleteTablet for 1 replicas of tablet 237cfe4bde594dc5b5d4f7642260a6e1 I0405 05:40:46.421224 1276 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 237cfe4bde594dc5b5d4f7642260a6e1 on 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) (Table deleted at 2019-04-05 05:40:46 UTC) I0405 05:40:46.421530 1276 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Sending DeleteTablet for 1 replicas of tablet 34c9b96f562f44aa81208b52e2b2babd I0405 05:40:46.421797 1276 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 34c9b96f562f44aa81208b52e2b2babd on 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) (Table deleted at 2019-04-05 05:40:46 UTC) I0405 05:40:46.421938 1376 tablet_service.cc:1047] Processing DeleteTablet for tablet 4738983f4c574127b1fdde41bc9c0591 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:40:46 UTC) from {username='slave'} at 127.0.0.1:39190 I0405 05:40:46.422137 1276 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Sending DeleteTablet for 1 replicas of tablet 1db483145cd145efa5e8c206f6643f1a I0405 05:40:46.422130 1372 tablet_service.cc:1047] Processing DeleteTablet for tablet 237cfe4bde594dc5b5d4f7642260a6e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:40:46 UTC) from {username='slave'} at 127.0.0.1:39190 I0405 05:40:46.422384 1276 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 1db483145cd145efa5e8c206f6643f1a on 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) (Table deleted at 2019-04-05 05:40:46 UTC) I0405 05:40:46.422848 1372 tablet_service.cc:1047] Processing DeleteTablet for tablet 34c9b96f562f44aa81208b52e2b2babd with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:40:46 UTC) from {username='slave'} at 127.0.0.1:39190 I0405 05:40:46.423013 1276 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Sending DeleteTablet for 1 replicas of tablet b89228c0b8b64f8aa59460436a040572 I0405 05:40:46.423254 1276 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet b89228c0b8b64f8aa59460436a040572 on 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) (Table deleted at 2019-04-05 05:40:46 UTC) I0405 05:40:46.423300 1379 tablet_service.cc:1047] Processing DeleteTablet for tablet 1db483145cd145efa5e8c206f6643f1a with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:40:46 UTC) from {username='slave'} at 127.0.0.1:39190 I0405 05:40:46.423498 1276 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Sending DeleteTablet for 1 replicas of tablet 51136496936e44e8ab763870c232d487 I0405 05:40:46.423758 1276 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 51136496936e44e8ab763870c232d487 on 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) (Table deleted at 2019-04-05 05:40:46 UTC) I0405 05:40:46.424046 1276 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Sending DeleteTablet for 1 replicas of tablet dc5edbb341cc46538c98cbc2b2034487 I0405 05:40:46.424077 1379 tablet_service.cc:1047] Processing DeleteTablet for tablet b89228c0b8b64f8aa59460436a040572 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:40:46 UTC) from {username='slave'} at 127.0.0.1:39190 I0405 05:40:46.424299 1276 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet dc5edbb341cc46538c98cbc2b2034487 on 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) (Table deleted at 2019-04-05 05:40:46 UTC) I0405 05:40:46.424769 1379 tablet_service.cc:1047] Processing DeleteTablet for tablet 51136496936e44e8ab763870c232d487 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:40:46 UTC) from {username='slave'} at 127.0.0.1:39190 I0405 05:40:46.425220 1379 tablet_service.cc:1047] Processing DeleteTablet for tablet dc5edbb341cc46538c98cbc2b2034487 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:40:46 UTC) from {username='slave'} at 127.0.0.1:39190 I0405 05:40:46.425882 1276 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 602375174f824d7ebda42dc5b5d0a3a2: Sending DeleteTablet for 1 replicas of tablet 1d17dd16c7c44c8690168e2f5b4216ad I0405 05:40:46.426089 1276 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 1d17dd16c7c44c8690168e2f5b4216ad on 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407) (Table deleted at 2019-04-05 05:40:46 UTC) I0405 05:40:46.425695 1503 tablet_replica.cc:264] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: stopping tablet replica I0405 05:40:46.426889 1379 tablet_service.cc:1047] Processing DeleteTablet for tablet 1d17dd16c7c44c8690168e2f5b4216ad with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:40:46 UTC) from {username='slave'} at 127.0.0.1:39190 I0405 05:40:46.426911 1503 raft_consensus.cc:2143] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Raft consensus shutting down. I0405 05:40:46.427335 1503 raft_consensus.cc:2170] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:40:46.430742 1503 ts_tablet_manager.cc:1377] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: Deleting tablet data with delete state TABLET_DATA_DELETED I0405 05:40:46.437870 1503 ts_tablet_manager.cc:1390] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0405 05:40:46.438066 1503 log.cc:990] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/wals/4738983f4c574127b1fdde41bc9c0591 I0405 05:40:46.438611 1503 ts_tablet_manager.cc:1411] T 4738983f4c574127b1fdde41bc9c0591 P 3e8fb9a698764665b4082521a37740b3: Deleting consensus metadata I0405 05:40:46.440325 1503 tablet_replica.cc:264] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: stopping tablet replica I0405 05:40:46.440526 1259 catalog_manager.cc:3357] TS 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407): tablet 4738983f4c574127b1fdde41bc9c0591 (table default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]) successfully deleted I0405 05:40:46.440740 1503 raft_consensus.cc:2143] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Raft consensus shutting down. I0405 05:40:46.441012 1503 raft_consensus.cc:2170] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:40:46.443186 1503 ts_tablet_manager.cc:1377] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: Deleting tablet data with delete state TABLET_DATA_DELETED I0405 05:40:46.448973 1503 ts_tablet_manager.cc:1390] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0405 05:40:46.449131 1503 log.cc:990] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/wals/237cfe4bde594dc5b5d4f7642260a6e1 I0405 05:40:46.449544 1503 ts_tablet_manager.cc:1411] T 237cfe4bde594dc5b5d4f7642260a6e1 P 3e8fb9a698764665b4082521a37740b3: Deleting consensus metadata I0405 05:40:46.450899 1503 tablet_replica.cc:264] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: stopping tablet replica I0405 05:40:46.451149 1259 catalog_manager.cc:3357] TS 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407): tablet 237cfe4bde594dc5b5d4f7642260a6e1 (table default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]) successfully deleted I0405 05:40:46.451308 1503 raft_consensus.cc:2143] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Raft consensus shutting down. I0405 05:40:46.451607 1503 raft_consensus.cc:2170] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:40:46.453613 1503 ts_tablet_manager.cc:1377] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: Deleting tablet data with delete state TABLET_DATA_DELETED I0405 05:40:46.459420 1503 ts_tablet_manager.cc:1390] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0405 05:40:46.459664 1503 log.cc:990] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/wals/34c9b96f562f44aa81208b52e2b2babd I0405 05:40:46.460098 1503 ts_tablet_manager.cc:1411] T 34c9b96f562f44aa81208b52e2b2babd P 3e8fb9a698764665b4082521a37740b3: Deleting consensus metadata I0405 05:40:46.461494 1503 tablet_replica.cc:264] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: stopping tablet replica I0405 05:40:46.461732 1259 catalog_manager.cc:3357] TS 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407): tablet 34c9b96f562f44aa81208b52e2b2babd (table default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]) successfully deleted I0405 05:40:46.461906 1503 raft_consensus.cc:2143] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Raft consensus shutting down. I0405 05:40:46.462177 1503 raft_consensus.cc:2170] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:40:46.464609 1503 ts_tablet_manager.cc:1377] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: Deleting tablet data with delete state TABLET_DATA_DELETED I0405 05:40:46.470434 1503 ts_tablet_manager.cc:1390] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0405 05:40:46.470607 1503 log.cc:990] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/wals/1db483145cd145efa5e8c206f6643f1a I0405 05:40:46.471014 1503 ts_tablet_manager.cc:1411] T 1db483145cd145efa5e8c206f6643f1a P 3e8fb9a698764665b4082521a37740b3: Deleting consensus metadata I0405 05:40:46.472340 1503 tablet_replica.cc:264] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: stopping tablet replica I0405 05:40:46.472610 1259 catalog_manager.cc:3357] TS 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407): tablet 1db483145cd145efa5e8c206f6643f1a (table default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]) successfully deleted I0405 05:40:46.472733 1503 raft_consensus.cc:2143] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Raft consensus shutting down. I0405 05:40:46.472990 1503 raft_consensus.cc:2170] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:40:46.475114 1503 ts_tablet_manager.cc:1377] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: Deleting tablet data with delete state TABLET_DATA_DELETED I0405 05:40:46.480777 1503 ts_tablet_manager.cc:1390] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0405 05:40:46.480937 1503 log.cc:990] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/wals/b89228c0b8b64f8aa59460436a040572 I0405 05:40:46.481334 1503 ts_tablet_manager.cc:1411] T b89228c0b8b64f8aa59460436a040572 P 3e8fb9a698764665b4082521a37740b3: Deleting consensus metadata I0405 05:40:46.482669 1503 tablet_replica.cc:264] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: stopping tablet replica I0405 05:40:46.482921 1259 catalog_manager.cc:3357] TS 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407): tablet b89228c0b8b64f8aa59460436a040572 (table default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]) successfully deleted I0405 05:40:46.483033 1503 raft_consensus.cc:2143] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Raft consensus shutting down. I0405 05:40:46.483289 1503 raft_consensus.cc:2170] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:40:46.485612 1503 ts_tablet_manager.cc:1377] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: Deleting tablet data with delete state TABLET_DATA_DELETED I0405 05:40:46.491386 1503 ts_tablet_manager.cc:1390] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0405 05:40:46.491554 1503 log.cc:990] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/wals/51136496936e44e8ab763870c232d487 I0405 05:40:46.491973 1503 ts_tablet_manager.cc:1411] T 51136496936e44e8ab763870c232d487 P 3e8fb9a698764665b4082521a37740b3: Deleting consensus metadata I0405 05:40:46.493264 1503 tablet_replica.cc:264] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: stopping tablet replica I0405 05:40:46.493527 1259 catalog_manager.cc:3357] TS 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407): tablet 51136496936e44e8ab763870c232d487 (table default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]) successfully deleted I0405 05:40:46.493636 1503 raft_consensus.cc:2143] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Raft consensus shutting down. I0405 05:40:46.493921 1503 raft_consensus.cc:2170] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:40:46.495937 1503 ts_tablet_manager.cc:1377] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: Deleting tablet data with delete state TABLET_DATA_DELETED I0405 05:40:46.501518 1503 ts_tablet_manager.cc:1390] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0405 05:40:46.501686 1503 log.cc:990] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/wals/dc5edbb341cc46538c98cbc2b2034487 I0405 05:40:46.502115 1503 ts_tablet_manager.cc:1411] T dc5edbb341cc46538c98cbc2b2034487 P 3e8fb9a698764665b4082521a37740b3: Deleting consensus metadata I0405 05:40:46.503388 1503 tablet_replica.cc:264] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: stopping tablet replica I0405 05:40:46.503643 1259 catalog_manager.cc:3357] TS 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407): tablet dc5edbb341cc46538c98cbc2b2034487 (table default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]) successfully deleted I0405 05:40:46.503736 1503 raft_consensus.cc:2143] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 1 LEADER]: Raft consensus shutting down. I0405 05:40:46.504001 1503 raft_consensus.cc:2170] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:40:46.506083 1503 ts_tablet_manager.cc:1377] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: Deleting tablet data with delete state TABLET_DATA_DELETED I0405 05:40:46.511760 1503 ts_tablet_manager.cc:1390] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0405 05:40:46.511924 1503 log.cc:990] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554442812470121-236/minicluster-data/ts-0/wal/wals/1d17dd16c7c44c8690168e2f5b4216ad I0405 05:40:46.512326 1503 ts_tablet_manager.cc:1411] T 1d17dd16c7c44c8690168e2f5b4216ad P 3e8fb9a698764665b4082521a37740b3: Deleting consensus metadata I0405 05:40:46.513965 1259 catalog_manager.cc:3357] TS 3e8fb9a698764665b4082521a37740b3 (127.0.59.1:34407): tablet 1d17dd16c7c44c8690168e2f5b4216ad (table default.loadgen_auto_a3236e41762041af82782d61e2842a2f [id=8bce9b2da0ae47daa75694e0871a2a76]) successfully deleted I0405 05:40:47.453002 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 1311 I0405 05:40:47.477048 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 1249 Shutting down hive metastore. [ OK ] ToolTest.TestLoadgenHmsEnabled (16547 ms) [ RUN ] ToolTest.TestRemoteReplicaCopy I0405 05:40:47.996174 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=0.0.0.0:37487 --webserver_interface=0.0.0.0 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --catalog_manager_wait_for_new_tablets_to_elect_leader=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:48.145953 1508 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:48.146384 1508 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:48.157369 1508 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:40:48.157588 1508 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:48.157721 1508 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:40:48.157891 1508 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:40:48.175189 1508 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/wal --catalog_manager_wait_for_new_tablets_to_elect_leader=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=0.0.0.0:37487 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:48.190552 1508 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 38016us I0405 05:40:48.191511 1508 fs_manager.cc:263] Metadata directory not provided I0405 05:40:48.191658 1508 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:48.191998 1508 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:48.192116 1508 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:48.195221 1508 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "06e107e6b6614951839fe6b2e5853cb7" format_stamp: "Formatted at 2019-04-05 05:40:48 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:48.196014 1508 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "06e107e6b6614951839fe6b2e5853cb7" format_stamp: "Formatted at 2019-04-05 05:40:48 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:48.206341 1508 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s I0405 05:40:48.207661 1508 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:48.208209 1508 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:48.215037 1508 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:40:48.215180 1508 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/wal uuid: "06e107e6b6614951839fe6b2e5853cb7" format_stamp: "Formatted at 2019-04-05 05:40:48 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:48.215447 1508 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:40:48.778342 1508 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.538s user 0.088s sys 0.425s W0405 05:40:48.778565 1508 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.539s user 0.088s sys 0.425s I0405 05:40:48.826830 1508 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:48.895328 1508 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:37487 I0405 05:40:48.898275 1508 webserver.cc:308] Webserver started at http://0.0.0.0:39887/ using document root and password file I0405 05:40:48.899557 1508 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:40:48.903327 1569 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:48.908665 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 1508 I0405 05:40:48.909762 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=0.0.0.0:0 --local_ip_for_outbound_sockets=0.0.0.0 --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-bl6s:37487 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --enable_leader_failure_detection=false with env {} I0405 05:40:48.920336 1569 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7: Bootstrap starting. I0405 05:40:48.923286 1569 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7: No blocks or log segments found. Creating new log. I0405 05:40:48.924728 1569 log.cc:525] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7: Log is configured to *not* fsync() on all Append() calls I0405 05:40:48.927492 1569 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7: No bootstrap required, opened a new log I0405 05:40:48.942478 1569 raft_consensus.cc:340] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06e107e6b6614951839fe6b2e5853cb7" member_type: VOTER } I0405 05:40:48.942895 1569 raft_consensus.cc:366] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:40:48.943051 1569 raft_consensus.cc:705] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 06e107e6b6614951839fe6b2e5853cb7, State: Initialized, Role: FOLLOWER I0405 05:40:48.943612 1569 consensus_queue.cc:229] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06e107e6b6614951839fe6b2e5853cb7" member_type: VOTER } I0405 05:40:48.943984 1569 raft_consensus.cc:380] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:40:48.944162 1569 raft_consensus.cc:472] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:40:48.944384 1569 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:40:48.947613 1569 raft_consensus.cc:494] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06e107e6b6614951839fe6b2e5853cb7" member_type: VOTER } I0405 05:40:48.948119 1569 leader_election.cc:310] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 06e107e6b6614951839fe6b2e5853cb7; no voters: I0405 05:40:48.949930 1572 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:40:48.951037 1569 leader_election.cc:296] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:40:49.050386 1572 raft_consensus.cc:667] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [term 1 LEADER]: Becoming Leader. State: Replica: 06e107e6b6614951839fe6b2e5853cb7, State: Running, Role: LEADER I0405 05:40:49.052390 1572 consensus_queue.cc:206] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06e107e6b6614951839fe6b2e5853cb7" member_type: VOTER } I0405 05:40:49.058995 1569 sys_catalog.cc:337] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "06e107e6b6614951839fe6b2e5853cb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06e107e6b6614951839fe6b2e5853cb7" member_type: VOTER } } I0405 05:40:49.059532 1569 sys_catalog.cc:340] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [sys.catalog]: This master's current role is: LEADER I0405 05:40:49.060681 1574 sys_catalog.cc:337] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "06e107e6b6614951839fe6b2e5853cb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06e107e6b6614951839fe6b2e5853cb7" member_type: VOTER } } I0405 05:40:49.062042 1574 sys_catalog.cc:340] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [sys.catalog]: This master's current role is: LEADER I0405 05:40:49.061877 1573 sys_catalog.cc:337] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 06e107e6b6614951839fe6b2e5853cb7. Latest consensus state: current_term: 1 leader_uuid: "06e107e6b6614951839fe6b2e5853cb7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "06e107e6b6614951839fe6b2e5853cb7" member_type: VOTER } } I0405 05:40:49.062629 1573 sys_catalog.cc:340] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [sys.catalog]: This master's current role is: LEADER I0405 05:40:49.071975 1569 sys_catalog.cc:424] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7 [sys.catalog]: configured and running, proceeding with master startup. I0405 05:40:49.072418 1577 catalog_manager.cc:1055] Loading table and tablet metadata into memory... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:49.078176 1570 flags.cc:406] Enabled unsafe flag: --enable_leader_failure_detection=false W0405 05:40:49.078640 1570 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true I0405 05:40:49.078610 1577 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... W0405 05:40:49.078912 1570 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:49.089748 1570 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:49.090247 1570 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=0.0.0.0 I0405 05:40:49.107564 1570 tablet_server_main.cc:78] Tablet server non-default flags: --enable_leader_failure_detection=false --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=0.0.0.0:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-bl6s:37487 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=0.0.0.0 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:49.108145 1577 catalog_manager.cc:950] Generated new certificate authority record I0405 05:40:49.109647 1577 catalog_manager.cc:1075] Loading token signing keys... I0405 05:40:49.122438 1577 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 06e107e6b6614951839fe6b2e5853cb7: Generated new TSK 0 I0405 05:40:49.134738 1570 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 38516us I0405 05:40:49.135457 1570 fs_manager.cc:263] Metadata directory not provided I0405 05:40:49.135641 1570 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:49.135994 1570 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:49.136154 1570 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:49.140642 1570 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "a045d9deadef4ebfa261aa01aea39485" format_stamp: "Formatted at 2019-04-05 05:40:49 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:49.141681 1570 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "a045d9deadef4ebfa261aa01aea39485" format_stamp: "Formatted at 2019-04-05 05:40:49 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:49.159502 1570 fs_manager.cc:503] Time spent creating directory manager: real 0.017s user 0.005s sys 0.012s I0405 05:40:49.161456 1570 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:49.162222 1570 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:49.175398 1570 fs_manager.cc:419] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s I0405 05:40:49.175590 1570 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/wal uuid: "a045d9deadef4ebfa261aa01aea39485" format_stamp: "Formatted at 2019-04-05 05:40:49 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:49.175935 1570 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:40:49.758512 1570 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.540s user 0.001s sys 0.001s W0405 05:40:49.758718 1570 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.541s user 0.001s sys 0.001s I0405 05:40:49.814221 1570 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:49.819010 1570 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:49.819198 1570 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:50.182339 1570 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:44939 I0405 05:40:50.184707 1570 webserver.cc:308] Webserver started at http://0.0.0.0:36665/ using document root and password file I0405 05:40:50.185760 1570 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:40:50.189851 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 1570 I0405 05:40:50.191285 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=0.0.0.0:0 --local_ip_for_outbound_sockets=0.0.0.0 --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-bl6s:37487 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --enable_leader_failure_detection=false with env {} I0405 05:40:50.226050 1702 heartbeater.cc:345] Connected to a master server at dist-test-slave-dist-test-slave-bl6s:37487 I0405 05:40:50.226444 1702 heartbeater.cc:426] Registering TS with master... I0405 05:40:50.227375 1702 heartbeater.cc:475] Master dist-test-slave-dist-test-slave-bl6s:37487 requested a full tablet report, sending... I0405 05:40:50.229676 1536 ts_manager.cc:159] Registered new tserver with Master: a045d9deadef4ebfa261aa01aea39485 (dist-test-slave-dist-test-slave-bl6s:44939) I0405 05:40:50.232277 1536 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 172.17.0.2:52941 WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:50.328963 1706 flags.cc:406] Enabled unsafe flag: --enable_leader_failure_detection=false W0405 05:40:50.329434 1706 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:50.329675 1706 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:50.338877 1706 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:50.339294 1706 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=0.0.0.0 I0405 05:40:50.366251 1706 tablet_server_main.cc:78] Tablet server non-default flags: --enable_leader_failure_detection=false --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=0.0.0.0:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-bl6s:37487 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=0.0.0.0 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:50.382944 1706 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 39016us I0405 05:40:50.383491 1706 fs_manager.cc:263] Metadata directory not provided I0405 05:40:50.383615 1706 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:50.383903 1706 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:50.384022 1706 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:50.387092 1706 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/instance: uuid: "77947e161a68400dbc7dc55a29079277" format_stamp: "Formatted at 2019-04-05 05:40:50 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:50.387845 1706 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal/instance: uuid: "77947e161a68400dbc7dc55a29079277" format_stamp: "Formatted at 2019-04-05 05:40:50 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:50.400807 1706 fs_manager.cc:503] Time spent creating directory manager: real 0.013s user 0.010s sys 0.004s I0405 05:40:50.402797 1706 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:50.403523 1706 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:50.415395 1706 fs_manager.cc:419] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s I0405 05:40:50.415573 1706 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal uuid: "77947e161a68400dbc7dc55a29079277" format_stamp: "Formatted at 2019-04-05 05:40:50 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:50.415904 1706 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:40:50.982715 1706 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:50.986500 1706 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:50.986639 1706 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:51.116164 1706 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:37841 I0405 05:40:51.118470 1706 webserver.cc:308] Webserver started at http://0.0.0.0:37395/ using document root and password file I0405 05:40:51.119496 1706 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/info.pb I0405 05:40:51.120770 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 1706 I0405 05:40:51.122092 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=0.0.0.0:0 --local_ip_for_outbound_sockets=0.0.0.0 --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-bl6s:37487 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --enable_leader_failure_detection=false with env {} I0405 05:40:51.158946 1827 heartbeater.cc:345] Connected to a master server at dist-test-slave-dist-test-slave-bl6s:37487 I0405 05:40:51.159279 1827 heartbeater.cc:426] Registering TS with master... I0405 05:40:51.159974 1827 heartbeater.cc:475] Master dist-test-slave-dist-test-slave-bl6s:37487 requested a full tablet report, sending... I0405 05:40:51.161542 1536 ts_manager.cc:159] Registered new tserver with Master: 77947e161a68400dbc7dc55a29079277 (dist-test-slave-dist-test-slave-bl6s:37841) I0405 05:40:51.162772 1536 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 172.17.0.2:35801 I0405 05:40:51.236335 1702 heartbeater.cc:467] Master dist-test-slave-dist-test-slave-bl6s:37487 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:51.265430 1831 flags.cc:406] Enabled unsafe flag: --enable_leader_failure_detection=false W0405 05:40:51.265909 1831 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:51.266150 1831 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:51.275563 1831 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:51.275951 1831 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=0.0.0.0 I0405 05:40:51.290565 1831 tablet_server_main.cc:78] Tablet server non-default flags: --enable_leader_failure_detection=false --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=0.0.0.0:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-bl6s:37487 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=0.0.0.0 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:51.306941 1831 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 39516us I0405 05:40:51.307462 1831 fs_manager.cc:263] Metadata directory not provided I0405 05:40:51.307592 1831 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:51.307881 1831 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:40:51.307987 1831 server_base.cc:434] Attempting to create new FS layout instead I0405 05:40:51.311003 1831 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/data/instance: uuid: "f9e91a68485540d99e3acca269700436" format_stamp: "Formatted at 2019-04-05 05:40:51 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:51.311751 1831 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/wal/instance: uuid: "f9e91a68485540d99e3acca269700436" format_stamp: "Formatted at 2019-04-05 05:40:51 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:51.321729 1831 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s I0405 05:40:51.323005 1831 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:51.323570 1831 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:51.330288 1831 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:40:51.330420 1831 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/wal uuid: "f9e91a68485540d99e3acca269700436" format_stamp: "Formatted at 2019-04-05 05:40:51 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:51.330674 1831 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:40:51.863178 1831 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.509s user 0.103s sys 0.398s W0405 05:40:51.863379 1831 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.510s user 0.103s sys 0.398s I0405 05:40:51.904824 1831 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:51.909092 1831 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:40:51.909297 1831 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:40:52.037161 1831 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:34687 I0405 05:40:52.039388 1831 webserver.cc:308] Webserver started at http://0.0.0.0:41089/ using document root and password file I0405 05:40:52.040397 1831 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-2/data/info.pb I0405 05:40:52.045392 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 1831 I0405 05:40:52.065276 1952 heartbeater.cc:345] Connected to a master server at dist-test-slave-dist-test-slave-bl6s:37487 I0405 05:40:52.065551 1952 heartbeater.cc:426] Registering TS with master... I0405 05:40:52.066256 1952 heartbeater.cc:475] Master dist-test-slave-dist-test-slave-bl6s:37487 requested a full tablet report, sending... I0405 05:40:52.068125 1536 ts_manager.cc:159] Registered new tserver with Master: f9e91a68485540d99e3acca269700436 (dist-test-slave-dist-test-slave-bl6s:34687) I0405 05:40:52.069267 1536 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 172.17.0.2:47827 I0405 05:40:52.070883 236 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0405 05:40:52.073642 236 test_util.cc:212] Using random seed: -301629296 I0405 05:40:52.094240 1536 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 172.17.0.2:36920: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\000\252\252\252*\004\001\000TUUU" } partition_schema { range_schema { columns { name: "key" } } } W0405 05:40:52.104604 1536 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0405 05:40:52.146670 1764 tablet_service.cc:1006] Processing CreateTablet for tablet 005c0559778b48938c1273876eb19fd5 (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION VALUES < 715827882 I0405 05:40:52.148619 1764 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 005c0559778b48938c1273876eb19fd5. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:52.148212 1889 tablet_service.cc:1006] Processing CreateTablet for tablet 005c0559778b48938c1273876eb19fd5 (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION VALUES < 715827882 I0405 05:40:52.148851 1639 tablet_service.cc:1006] Processing CreateTablet for tablet 005c0559778b48938c1273876eb19fd5 (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION VALUES < 715827882 I0405 05:40:52.150027 1639 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 005c0559778b48938c1273876eb19fd5. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:52.154687 1889 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 005c0559778b48938c1273876eb19fd5. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:52.148427 1888 tablet_service.cc:1006] Processing CreateTablet for tablet d163abda808b4989885f29b0dc473fbc (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764 I0405 05:40:52.181461 1888 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d163abda808b4989885f29b0dc473fbc. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:52.148752 1887 tablet_service.cc:1006] Processing CreateTablet for tablet 0432df2df5bb4c4f95b65ef94c6b69ff (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION VALUES >= 1431655764 I0405 05:40:52.194731 1887 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0432df2df5bb4c4f95b65ef94c6b69ff. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:52.205103 1973 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436: Bootstrap starting. I0405 05:40:52.217334 1973 tablet_bootstrap.cc:590] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436: No blocks or log segments found. Creating new log. I0405 05:40:52.223645 1973 log.cc:525] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436: Log is configured to *not* fsync() on all Append() calls I0405 05:40:52.232105 1973 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436: No bootstrap required, opened a new log I0405 05:40:52.232677 1973 ts_tablet_manager.cc:1053] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436: Time spent bootstrapping tablet: real 0.028s user 0.009s sys 0.000s I0405 05:40:52.254195 1973 raft_consensus.cc:340] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.255264 1973 raft_consensus.cc:705] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e91a68485540d99e3acca269700436, State: Initialized, Role: FOLLOWER I0405 05:40:52.255781 1973 consensus_queue.cc:229] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.260990 1952 heartbeater.cc:467] Master dist-test-slave-dist-test-slave-bl6s:37487 was elected leader, sending a full tablet report... I0405 05:40:52.273177 1973 ts_tablet_manager.cc:1081] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436: Time spent starting tablet: real 0.040s user 0.018s sys 0.003s I0405 05:40:52.278290 1973 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P f9e91a68485540d99e3acca269700436: Bootstrap starting. I0405 05:40:52.150599 1763 tablet_service.cc:1006] Processing CreateTablet for tablet d163abda808b4989885f29b0dc473fbc (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764 I0405 05:40:52.158437 1638 tablet_service.cc:1006] Processing CreateTablet for tablet d163abda808b4989885f29b0dc473fbc (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764 I0405 05:40:52.279485 1763 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d163abda808b4989885f29b0dc473fbc. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:52.279829 1638 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d163abda808b4989885f29b0dc473fbc. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:52.281883 1973 tablet_bootstrap.cc:590] T d163abda808b4989885f29b0dc473fbc P f9e91a68485540d99e3acca269700436: No blocks or log segments found. Creating new log. I0405 05:40:52.169591 1637 tablet_service.cc:1006] Processing CreateTablet for tablet 0432df2df5bb4c4f95b65ef94c6b69ff (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION VALUES >= 1431655764 I0405 05:40:52.291795 1973 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P f9e91a68485540d99e3acca269700436: No bootstrap required, opened a new log I0405 05:40:52.292140 1973 ts_tablet_manager.cc:1053] T d163abda808b4989885f29b0dc473fbc P f9e91a68485540d99e3acca269700436: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.004s I0405 05:40:52.292335 1637 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0432df2df5bb4c4f95b65ef94c6b69ff. 1 dirs total, 0 dirs full, 0 dirs failed W0405 05:40:52.293829 1953 tablet.cc:1786] T 005c0559778b48938c1273876eb19fd5 P f9e91a68485540d99e3acca269700436: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:40:52.293520 1973 raft_consensus.cc:340] T d163abda808b4989885f29b0dc473fbc P f9e91a68485540d99e3acca269700436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.295181 1973 raft_consensus.cc:705] T d163abda808b4989885f29b0dc473fbc P f9e91a68485540d99e3acca269700436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e91a68485540d99e3acca269700436, State: Initialized, Role: FOLLOWER I0405 05:40:52.295603 1973 consensus_queue.cc:229] T d163abda808b4989885f29b0dc473fbc P f9e91a68485540d99e3acca269700436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.158305 1762 tablet_service.cc:1006] Processing CreateTablet for tablet 0432df2df5bb4c4f95b65ef94c6b69ff (table=test-workload [id=06304d3b2177473bb494a288bb49064c]), partition=RANGE (key) PARTITION VALUES >= 1431655764 I0405 05:40:52.297042 1762 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0432df2df5bb4c4f95b65ef94c6b69ff. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:52.302702 1973 ts_tablet_manager.cc:1081] T d163abda808b4989885f29b0dc473fbc P f9e91a68485540d99e3acca269700436: Time spent starting tablet: real 0.010s user 0.002s sys 0.002s I0405 05:40:52.303823 1973 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P f9e91a68485540d99e3acca269700436: Bootstrap starting. I0405 05:40:52.304683 1975 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485: Bootstrap starting. I0405 05:40:52.308485 1973 tablet_bootstrap.cc:590] T 0432df2df5bb4c4f95b65ef94c6b69ff P f9e91a68485540d99e3acca269700436: No blocks or log segments found. Creating new log. I0405 05:40:52.308882 1975 tablet_bootstrap.cc:590] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485: No blocks or log segments found. Creating new log. I0405 05:40:52.310854 1975 log.cc:525] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485: Log is configured to *not* fsync() on all Append() calls I0405 05:40:52.165192 1827 heartbeater.cc:467] Master dist-test-slave-dist-test-slave-bl6s:37487 was elected leader, sending a full tablet report... I0405 05:40:52.316521 1973 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P f9e91a68485540d99e3acca269700436: No bootstrap required, opened a new log I0405 05:40:52.314324 1975 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485: No bootstrap required, opened a new log I0405 05:40:52.316833 1973 ts_tablet_manager.cc:1053] T 0432df2df5bb4c4f95b65ef94c6b69ff P f9e91a68485540d99e3acca269700436: Time spent bootstrapping tablet: real 0.013s user 0.001s sys 0.005s I0405 05:40:52.317257 1975 ts_tablet_manager.cc:1053] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485: Time spent bootstrapping tablet: real 0.015s user 0.005s sys 0.004s I0405 05:40:52.318512 1974 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Bootstrap starting. I0405 05:40:52.318254 1973 raft_consensus.cc:340] T 0432df2df5bb4c4f95b65ef94c6b69ff P f9e91a68485540d99e3acca269700436 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.318917 1973 raft_consensus.cc:705] T 0432df2df5bb4c4f95b65ef94c6b69ff P f9e91a68485540d99e3acca269700436 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9e91a68485540d99e3acca269700436, State: Initialized, Role: FOLLOWER I0405 05:40:52.319342 1973 consensus_queue.cc:229] T 0432df2df5bb4c4f95b65ef94c6b69ff P f9e91a68485540d99e3acca269700436 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.322391 1974 tablet_bootstrap.cc:590] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: No blocks or log segments found. Creating new log. I0405 05:40:52.323467 1973 ts_tablet_manager.cc:1081] T 0432df2df5bb4c4f95b65ef94c6b69ff P f9e91a68485540d99e3acca269700436: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s I0405 05:40:52.324182 1974 log.cc:525] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Log is configured to *not* fsync() on all Append() calls I0405 05:40:52.328372 1974 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: No bootstrap required, opened a new log I0405 05:40:52.328817 1974 ts_tablet_manager.cc:1053] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.005s I0405 05:40:52.332438 1975 raft_consensus.cc:340] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.333088 1975 raft_consensus.cc:705] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a045d9deadef4ebfa261aa01aea39485, State: Initialized, Role: FOLLOWER I0405 05:40:52.333489 1975 consensus_queue.cc:229] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.336324 1975 ts_tablet_manager.cc:1081] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485: Time spent starting tablet: real 0.019s user 0.016s sys 0.002s I0405 05:40:52.336881 1975 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485: Bootstrap starting. I0405 05:40:52.339402 1975 tablet_bootstrap.cc:590] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485: No blocks or log segments found. Creating new log. I0405 05:40:52.343735 1975 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485: No bootstrap required, opened a new log I0405 05:40:52.344005 1975 ts_tablet_manager.cc:1053] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s I0405 05:40:52.343655 1974 raft_consensus.cc:340] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.344372 1974 raft_consensus.cc:705] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77947e161a68400dbc7dc55a29079277, State: Initialized, Role: FOLLOWER I0405 05:40:52.344724 1974 consensus_queue.cc:229] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.345167 1975 raft_consensus.cc:340] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.345631 1975 raft_consensus.cc:705] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a045d9deadef4ebfa261aa01aea39485, State: Initialized, Role: FOLLOWER I0405 05:40:52.345990 1975 consensus_queue.cc:229] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.347018 1975 ts_tablet_manager.cc:1081] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s I0405 05:40:52.347518 1975 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485: Bootstrap starting. I0405 05:40:52.350651 1975 tablet_bootstrap.cc:590] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485: No blocks or log segments found. Creating new log. I0405 05:40:52.351894 1974 ts_tablet_manager.cc:1081] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Time spent starting tablet: real 0.023s user 0.013s sys 0.009s I0405 05:40:52.352411 1974 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Bootstrap starting. I0405 05:40:52.354806 1975 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485: No bootstrap required, opened a new log I0405 05:40:52.355182 1974 tablet_bootstrap.cc:590] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: No blocks or log segments found. Creating new log. I0405 05:40:52.355211 1975 ts_tablet_manager.cc:1053] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485: Time spent bootstrapping tablet: real 0.008s user 0.006s sys 0.000s I0405 05:40:52.356693 1975 raft_consensus.cc:340] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.357318 1975 raft_consensus.cc:705] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a045d9deadef4ebfa261aa01aea39485, State: Initialized, Role: FOLLOWER I0405 05:40:52.357658 1975 consensus_queue.cc:229] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.358922 1975 ts_tablet_manager.cc:1081] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s I0405 05:40:52.365937 1974 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: No bootstrap required, opened a new log I0405 05:40:52.366312 1974 ts_tablet_manager.cc:1053] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Time spent bootstrapping tablet: real 0.014s user 0.001s sys 0.012s I0405 05:40:52.367591 1974 raft_consensus.cc:340] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.368260 1974 raft_consensus.cc:705] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77947e161a68400dbc7dc55a29079277, State: Initialized, Role: FOLLOWER I0405 05:40:52.368602 1974 consensus_queue.cc:229] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.369984 1974 ts_tablet_manager.cc:1081] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0405 05:40:52.370535 1974 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Bootstrap starting. I0405 05:40:52.372894 1974 tablet_bootstrap.cc:590] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: No blocks or log segments found. Creating new log. I0405 05:40:52.377190 1974 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: No bootstrap required, opened a new log I0405 05:40:52.377472 1974 ts_tablet_manager.cc:1053] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s I0405 05:40:52.378605 1974 raft_consensus.cc:340] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.379032 1974 raft_consensus.cc:705] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77947e161a68400dbc7dc55a29079277, State: Initialized, Role: FOLLOWER W0405 05:40:52.379513 1828 tablet.cc:1786] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:40:52.379374 1974 consensus_queue.cc:229] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:52.381186 1974 ts_tablet_manager.cc:1081] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Time spent starting tablet: real 0.004s user 0.001s sys 0.002s W0405 05:40:52.454445 1703 tablet.cc:1786] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485: Can't schedule compaction. Clean time has not been advanced past its initial value. W0405 05:40:53.162582 2013 ts_tablet_manager.cc:474] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Tablet Copy: Invalid argument: Leader has replica of tablet 0432df2df5bb4c4f95b65ef94c6b69ff with term -1, which is lower than last-logged term 0 on local replica. Rejecting tablet copy request I0405 05:40:54.921394 2038 tablet_replica.cc:264] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: stopping tablet replica I0405 05:40:54.921869 2038 raft_consensus.cc:2143] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Raft consensus shutting down. I0405 05:40:54.922155 2038 raft_consensus.cc:2170] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Raft consensus is shut down! I0405 05:40:54.923707 2038 ts_tablet_manager.cc:1377] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0405 05:40:54.930747 2038 ts_tablet_manager.cc:1390] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0 I0405 05:40:54.930950 2038 log.cc:990] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal/wals/0432df2df5bb4c4f95b65ef94c6b69ff I0405 05:40:54.931483 2038 ts_tablet_manager.cc:676] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Initiating tablet copy from peer a045d9deadef4ebfa261aa01aea39485 (dist-test-slave-dist-test-slave-bl6s:44939) I0405 05:40:54.931919 2038 tablet_copy_client.cc:240] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: tablet copy: Beginning tablet copy session from remote peer at address dist-test-slave-dist-test-slave-bl6s:44939 I0405 05:40:54.940892 1679 tablet_copy_service.cc:135] P a045d9deadef4ebfa261aa01aea39485: Received BeginTabletCopySession request for tablet 0432df2df5bb4c4f95b65ef94c6b69ff from peer 77947e161a68400dbc7dc55a29079277 ({username='slave'} at 172.17.0.2:53513) I0405 05:40:54.941201 1679 tablet_copy_service.cc:156] P a045d9deadef4ebfa261aa01aea39485: Beginning new tablet copy session on tablet 0432df2df5bb4c4f95b65ef94c6b69ff from peer 77947e161a68400dbc7dc55a29079277 at {username='slave'} at 172.17.0.2:53513: session id = 77947e161a68400dbc7dc55a29079277-0432df2df5bb4c4f95b65ef94c6b69ff I0405 05:40:54.945435 1679 tablet_copy_source_session.cc:202] T 0432df2df5bb4c4f95b65ef94c6b69ff P a045d9deadef4ebfa261aa01aea39485: Tablet Copy: opened 0 blocks and 1 log segments I0405 05:40:54.947541 2038 ts_tablet_manager.cc:1377] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Deleting tablet data with delete state TABLET_DATA_COPYING I0405 05:40:54.954541 2038 ts_tablet_manager.cc:1390] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 0.0 I0405 05:40:54.954907 2038 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0432df2df5bb4c4f95b65ef94c6b69ff. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:54.958286 2038 tablet_copy_client.cc:575] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: tablet copy: Starting download of 0 data blocks... I0405 05:40:54.958643 2038 tablet_copy_client.cc:538] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: tablet copy: Starting download of 1 WAL segments... I0405 05:40:54.961375 2038 tablet_copy_client.cc:414] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0405 05:40:54.964939 2038 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Bootstrap starting. I0405 05:40:54.971439 2038 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0405 05:40:54.971897 2038 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Bootstrap complete. I0405 05:40:54.972316 2038 ts_tablet_manager.cc:1053] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.004s I0405 05:40:54.973448 2038 raft_consensus.cc:340] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:54.974089 2038 raft_consensus.cc:705] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77947e161a68400dbc7dc55a29079277, State: Initialized, Role: FOLLOWER I0405 05:40:54.974376 2038 consensus_queue.cc:229] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:54.976668 2038 ts_tablet_manager.cc:1081] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Time spent starting tablet: real 0.004s user 0.005s sys 0.000s I0405 05:40:54.977861 1679 tablet_copy_service.cc:325] P a045d9deadef4ebfa261aa01aea39485: Request end of tablet copy session 77947e161a68400dbc7dc55a29079277-0432df2df5bb4c4f95b65ef94c6b69ff received from {username='slave'} at 172.17.0.2:53513 I0405 05:40:54.978061 1679 tablet_copy_service.cc:413] P a045d9deadef4ebfa261aa01aea39485: ending tablet copy session 77947e161a68400dbc7dc55a29079277-0432df2df5bb4c4f95b65ef94c6b69ff on tablet 0432df2df5bb4c4f95b65ef94c6b69ff with peer 77947e161a68400dbc7dc55a29079277 I0405 05:40:55.986891 1764 tablet_service.cc:1047] Processing DeleteTablet for tablet 005c0559778b48938c1273876eb19fd5 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 172.17.0.2:34278 I0405 05:40:55.988585 2042 tablet_replica.cc:264] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: stopping tablet replica I0405 05:40:55.988994 2042 raft_consensus.cc:2143] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Raft consensus shutting down. I0405 05:40:55.989234 2042 raft_consensus.cc:2170] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Raft consensus is shut down! I0405 05:40:55.990344 2042 ts_tablet_manager.cc:1377] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0405 05:40:55.997014 2042 ts_tablet_manager.cc:1390] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0 I0405 05:40:55.997205 2042 log.cc:990] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Deleting WAL directory at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal/wals/005c0559778b48938c1273876eb19fd5 I0405 05:40:55.999049 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 1706 I0405 05:40:57.255067 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=0.0.0.0:37841 --local_ip_for_outbound_sockets=0.0.0.0 --webserver_port=37395 --webserver_interface=0.0.0.0 --tserver_master_addrs=dist-test-slave-dist-test-slave-bl6s:37487 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --enable_leader_failure_detection=false with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:40:57.385124 2051 flags.cc:406] Enabled unsafe flag: --enable_leader_failure_detection=false W0405 05:40:57.385550 2051 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:40:57.385787 2051 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:40:57.394902 2051 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:40:57.395300 2051 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=0.0.0.0 I0405 05:40:57.409683 2051 tablet_server_main.cc:78] Tablet server non-default flags: --enable_leader_failure_detection=false --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=0.0.0.0:37841 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=37395 --tserver_master_addrs=dist-test-slave-dist-test-slave-bl6s:37487 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=0.0.0.0 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:40:57.426035 2051 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 42516us I0405 05:40:57.426571 2051 fs_manager.cc:263] Metadata directory not provided I0405 05:40:57.426705 2051 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:40:57.432896 2051 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.005s sys 0.001s I0405 05:40:57.433557 2051 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:40:57.434105 2051 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:40:57.440547 2051 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:40:57.440680 2051 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal uuid: "77947e161a68400dbc7dc55a29079277" format_stamp: "Formatted at 2019-04-05 05:40:50 on dist-test-slave-dist-test-slave-bl6s" I0405 05:40:57.441967 2051 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:40:57.977085 2051 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.512s user 0.114s sys 0.368s W0405 05:40:57.977282 2051 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.512s user 0.114s sys 0.369s I0405 05:40:57.998893 2051 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:40:58.002643 2051 ts_tablet_manager.cc:344] Loading tablet metadata (0/2 complete) I0405 05:40:58.013679 2051 ts_tablet_manager.cc:356] Loaded tablet metadata (2 total tablets, 1 live tablets) I0405 05:40:58.013854 2051 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0405 05:40:58.019253 2051 ts_tablet_manager.cc:376] Registered 1 tablets I0405 05:40:58.019990 2068 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Bootstrap starting. I0405 05:40:58.099184 2068 log.cc:525] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Log is configured to *not* fsync() on all Append() calls I0405 05:40:58.103960 2068 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0405 05:40:58.104691 2068 tablet_bootstrap.cc:439] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Bootstrap complete. I0405 05:40:58.106041 2068 ts_tablet_manager.cc:1053] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Time spent bootstrapping tablet: real 0.086s user 0.024s sys 0.020s I0405 05:40:58.135373 2068 raft_consensus.cc:340] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:58.143852 2068 raft_consensus.cc:705] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77947e161a68400dbc7dc55a29079277, State: Initialized, Role: FOLLOWER I0405 05:40:58.144397 2068 consensus_queue.cc:229] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:58.147487 2068 ts_tablet_manager.cc:1081] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Time spent starting tablet: real 0.041s user 0.027s sys 0.013s I0405 05:40:58.206507 2051 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:37841 I0405 05:40:58.209185 2051 webserver.cc:308] Webserver started at http://0.0.0.0:37395/ using document root and password file I0405 05:40:58.210192 2051 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554442812470121-236/minicluster-data/ts-1/data/info.pb W0405 05:40:58.213521 2177 tablet.cc:1786] T 0432df2df5bb4c4f95b65ef94c6b69ff P 77947e161a68400dbc7dc55a29079277: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:40:58.215487 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 2051 I0405 05:40:58.230648 2176 heartbeater.cc:345] Connected to a master server at dist-test-slave-dist-test-slave-bl6s:37487 I0405 05:40:58.230947 2176 heartbeater.cc:426] Registering TS with master... I0405 05:40:58.231609 2176 heartbeater.cc:475] Master dist-test-slave-dist-test-slave-bl6s:37487 requested a full tablet report, sending... I0405 05:40:58.234308 1536 ts_manager.cc:159] Re-registered known tserver with Master: 77947e161a68400dbc7dc55a29079277 (dist-test-slave-dist-test-slave-bl6s:37841) I0405 05:40:58.236848 1536 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 172.17.0.2:57017 I0405 05:40:58.997068 2206 tablet_replica.cc:264] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: stopping tablet replica I0405 05:40:58.997352 2206 raft_consensus.cc:2143] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Raft consensus shutting down. I0405 05:40:58.997568 2206 raft_consensus.cc:2170] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Raft consensus is shut down! I0405 05:40:58.997898 2206 ts_tablet_manager.cc:676] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Initiating tablet copy from peer a045d9deadef4ebfa261aa01aea39485 (dist-test-slave-dist-test-slave-bl6s:44939) I0405 05:40:58.998134 2206 tablet_copy_client.cc:203] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: tablet copy: overwriting existing tombstoned replica with an unknown last-logged opid I0405 05:40:58.998548 2206 tablet_copy_client.cc:240] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: tablet copy: Beginning tablet copy session from remote peer at address dist-test-slave-dist-test-slave-bl6s:44939 I0405 05:40:59.007969 1679 tablet_copy_service.cc:135] P a045d9deadef4ebfa261aa01aea39485: Received BeginTabletCopySession request for tablet 005c0559778b48938c1273876eb19fd5 from peer 77947e161a68400dbc7dc55a29079277 ({username='slave'} at 172.17.0.2:54653) I0405 05:40:59.008249 1679 tablet_copy_service.cc:156] P a045d9deadef4ebfa261aa01aea39485: Beginning new tablet copy session on tablet 005c0559778b48938c1273876eb19fd5 from peer 77947e161a68400dbc7dc55a29079277 at {username='slave'} at 172.17.0.2:54653: session id = 77947e161a68400dbc7dc55a29079277-005c0559778b48938c1273876eb19fd5 I0405 05:40:59.011775 1679 tablet_copy_source_session.cc:202] T 005c0559778b48938c1273876eb19fd5 P a045d9deadef4ebfa261aa01aea39485: Tablet Copy: opened 0 blocks and 1 log segments I0405 05:40:59.013505 2206 ts_tablet_manager.cc:1377] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Deleting tablet data with delete state TABLET_DATA_COPYING I0405 05:40:59.023313 2206 ts_tablet_manager.cc:1390] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId unknown I0405 05:40:59.023710 2206 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 005c0559778b48938c1273876eb19fd5. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:40:59.026898 2206 tablet_copy_client.cc:575] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: tablet copy: Starting download of 0 data blocks... I0405 05:40:59.027226 2206 tablet_copy_client.cc:538] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: tablet copy: Starting download of 1 WAL segments... I0405 05:40:59.029748 2206 tablet_copy_client.cc:414] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0405 05:40:59.033710 2206 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Bootstrap starting. I0405 05:40:59.039275 2206 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0405 05:40:59.039710 2206 tablet_bootstrap.cc:439] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Bootstrap complete. I0405 05:40:59.040002 2206 ts_tablet_manager.cc:1053] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.003s I0405 05:40:59.041110 2206 raft_consensus.cc:340] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:59.041571 2206 raft_consensus.cc:705] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77947e161a68400dbc7dc55a29079277, State: Initialized, Role: FOLLOWER I0405 05:40:59.041900 2206 consensus_queue.cc:229] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:40:59.043632 2176 heartbeater.cc:467] Master dist-test-slave-dist-test-slave-bl6s:37487 was elected leader, sending a full tablet report... I0405 05:40:59.043838 2206 ts_tablet_manager.cc:1081] T 005c0559778b48938c1273876eb19fd5 P 77947e161a68400dbc7dc55a29079277: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0405 05:40:59.045055 1679 tablet_copy_service.cc:325] P a045d9deadef4ebfa261aa01aea39485: Request end of tablet copy session 77947e161a68400dbc7dc55a29079277-005c0559778b48938c1273876eb19fd5 received from {username='slave'} at 172.17.0.2:54653 I0405 05:40:59.045306 1679 tablet_copy_service.cc:413] P a045d9deadef4ebfa261aa01aea39485: ending tablet copy session 77947e161a68400dbc7dc55a29079277-005c0559778b48938c1273876eb19fd5 on tablet 005c0559778b48938c1273876eb19fd5 with peer 77947e161a68400dbc7dc55a29079277 I0405 05:41:00.801565 2235 ts_tablet_manager.cc:676] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Initiating tablet copy from peer a045d9deadef4ebfa261aa01aea39485 (dist-test-slave-dist-test-slave-bl6s:44939) I0405 05:41:00.801985 2235 tablet_copy_client.cc:240] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: tablet copy: Beginning tablet copy session from remote peer at address dist-test-slave-dist-test-slave-bl6s:44939 I0405 05:41:00.803139 1679 tablet_copy_service.cc:135] P a045d9deadef4ebfa261aa01aea39485: Received BeginTabletCopySession request for tablet d163abda808b4989885f29b0dc473fbc from peer 77947e161a68400dbc7dc55a29079277 ({username='slave'} at 172.17.0.2:54653) I0405 05:41:00.803436 1679 tablet_copy_service.cc:156] P a045d9deadef4ebfa261aa01aea39485: Beginning new tablet copy session on tablet d163abda808b4989885f29b0dc473fbc from peer 77947e161a68400dbc7dc55a29079277 at {username='slave'} at 172.17.0.2:54653: session id = 77947e161a68400dbc7dc55a29079277-d163abda808b4989885f29b0dc473fbc I0405 05:41:00.807212 1679 tablet_copy_source_session.cc:202] T d163abda808b4989885f29b0dc473fbc P a045d9deadef4ebfa261aa01aea39485: Tablet Copy: opened 0 blocks and 1 log segments I0405 05:41:00.808977 2235 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d163abda808b4989885f29b0dc473fbc. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:00.817226 2235 tablet_copy_client.cc:575] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: tablet copy: Starting download of 0 data blocks... I0405 05:41:00.817623 2235 tablet_copy_client.cc:538] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: tablet copy: Starting download of 1 WAL segments... I0405 05:41:00.820288 2235 tablet_copy_client.cc:414] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0405 05:41:00.825306 2235 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Bootstrap starting. I0405 05:41:00.834141 2235 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0405 05:41:00.834790 2235 tablet_bootstrap.cc:439] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Bootstrap complete. I0405 05:41:00.835240 2235 ts_tablet_manager.cc:1053] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Time spent bootstrapping tablet: real 0.010s user 0.011s sys 0.000s I0405 05:41:00.836784 2235 raft_consensus.cc:340] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:41:00.837505 2235 raft_consensus.cc:705] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77947e161a68400dbc7dc55a29079277, State: Initialized, Role: FOLLOWER I0405 05:41:00.837930 2235 consensus_queue.cc:229] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "77947e161a68400dbc7dc55a29079277" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 37841 } } peers { permanent_uuid: "a045d9deadef4ebfa261aa01aea39485" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 44939 } } peers { permanent_uuid: "f9e91a68485540d99e3acca269700436" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-bl6s" port: 34687 } } I0405 05:41:00.840600 2235 ts_tablet_manager.cc:1081] T d163abda808b4989885f29b0dc473fbc P 77947e161a68400dbc7dc55a29079277: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s I0405 05:41:00.841719 1679 tablet_copy_service.cc:325] P a045d9deadef4ebfa261aa01aea39485: Request end of tablet copy session 77947e161a68400dbc7dc55a29079277-d163abda808b4989885f29b0dc473fbc received from {username='slave'} at 172.17.0.2:54653 I0405 05:41:00.841995 1679 tablet_copy_service.cc:413] P a045d9deadef4ebfa261aa01aea39485: ending tablet copy session 77947e161a68400dbc7dc55a29079277-d163abda808b4989885f29b0dc473fbc on tablet d163abda808b4989885f29b0dc473fbc with peer 77947e161a68400dbc7dc55a29079277 I0405 05:41:01.856932 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 1570 I0405 05:41:01.875286 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 2051 I0405 05:41:01.898133 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 1831 I0405 05:41:01.917078 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 1508 [ OK ] ToolTest.TestRemoteReplicaCopy (13956 ms) [ RUN ] ToolTest.TestLocalReplicaCMetaOps I0405 05:41:01.951114 236 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.0.59.62:33053 I0405 05:41:01.966135 236 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 44516us I0405 05:41:01.966544 236 fs_manager.cc:263] Metadata directory not provided I0405 05:41:01.966672 236 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:41:01.966882 236 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:41:01.967010 236 server_base.cc:434] Attempting to create new FS layout instead I0405 05:41:01.968016 236 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/master-0-root/instance: uuid: "d2b79ea7a889430eab031db6e2cb2ac9" format_stamp: "Formatted at 2019-04-05 05:41:01 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:01.976666 236 fs_manager.cc:503] Time spent creating directory manager: real 0.008s user 0.010s sys 0.000s I0405 05:41:01.978140 236 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:41:01.984769 236 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0405 05:41:01.984905 236 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/master-0-root uuid: "d2b79ea7a889430eab031db6e2cb2ac9" format_stamp: "Formatted at 2019-04-05 05:41:01 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:01.985129 236 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/master-0-root metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/master-0-root 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:41:02.006266 236 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:41:02.062057 236 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:33053 I0405 05:41:02.064580 236 webserver.cc:308] Webserver started at http://127.0.59.62:40855/ using document root and password file I0405 05:41:02.067323 2293 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:02.080951 2293 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9: Bootstrap starting. I0405 05:41:02.083842 2293 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9: No blocks or log segments found. Creating new log. I0405 05:41:02.085286 2293 log.cc:525] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9: Log is configured to *not* fsync() on all Append() calls I0405 05:41:02.088003 2293 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9: No bootstrap required, opened a new log I0405 05:41:02.099972 2293 raft_consensus.cc:340] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" member_type: VOTER } I0405 05:41:02.100416 2293 raft_consensus.cc:366] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:02.100617 2293 raft_consensus.cc:705] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d2b79ea7a889430eab031db6e2cb2ac9, State: Initialized, Role: FOLLOWER I0405 05:41:02.101195 2293 consensus_queue.cc:229] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" member_type: VOTER } I0405 05:41:02.101624 2293 raft_consensus.cc:380] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:02.101835 2293 raft_consensus.cc:472] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:02.102092 2293 raft_consensus.cc:2886] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:02.105424 2293 raft_consensus.cc:494] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" member_type: VOTER } I0405 05:41:02.105968 2293 leader_election.cc:310] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d2b79ea7a889430eab031db6e2cb2ac9; no voters: I0405 05:41:02.107736 2295 raft_consensus.cc:2640] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:02.108786 2293 leader_election.cc:296] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:02.196424 2295 raft_consensus.cc:667] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 1 LEADER]: Becoming Leader. State: Replica: d2b79ea7a889430eab031db6e2cb2ac9, State: Running, Role: LEADER I0405 05:41:02.196995 2295 consensus_queue.cc:206] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" member_type: VOTER } I0405 05:41:02.203245 2297 sys_catalog.cc:337] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" member_type: VOTER } } I0405 05:41:02.203266 2296 sys_catalog.cc:337] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d2b79ea7a889430eab031db6e2cb2ac9. Latest consensus state: current_term: 1 leader_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" member_type: VOTER } } I0405 05:41:02.203727 2293 sys_catalog.cc:337] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d2b79ea7a889430eab031db6e2cb2ac9" member_type: VOTER } } I0405 05:41:02.204063 2296 sys_catalog.cc:340] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [sys.catalog]: This master's current role is: LEADER I0405 05:41:02.204154 2293 sys_catalog.cc:340] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [sys.catalog]: This master's current role is: LEADER I0405 05:41:02.204733 2297 sys_catalog.cc:340] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [sys.catalog]: This master's current role is: LEADER I0405 05:41:02.206574 2293 sys_catalog.cc:424] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [sys.catalog]: configured and running, proceeding with master startup. I0405 05:41:02.206892 2300 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:41:02.209789 236 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0405 05:41:02.212642 2300 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0405 05:41:02.302448 2300 catalog_manager.cc:950] Generated new certificate authority record I0405 05:41:02.304713 2300 catalog_manager.cc:1075] Loading token signing keys... I0405 05:41:02.316776 2300 catalog_manager.cc:4281] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9: Generated new TSK 0 I0405 05:41:02.351459 236 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 45016us I0405 05:41:02.351832 236 fs_manager.cc:263] Metadata directory not provided I0405 05:41:02.351972 236 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:41:02.352169 236 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:41:02.352288 236 server_base.cc:434] Attempting to create new FS layout instead I0405 05:41:02.353238 236 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/ts-0-root/instance: uuid: "8265df4966c44d19847aef1b7c43a250" format_stamp: "Formatted at 2019-04-05 05:41:02 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:02.363085 236 fs_manager.cc:503] Time spent creating directory manager: real 0.009s user 0.004s sys 0.008s I0405 05:41:02.364338 236 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:41:02.370633 236 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s I0405 05:41:02.370782 236 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/ts-0-root uuid: "8265df4966c44d19847aef1b7c43a250" format_stamp: "Formatted at 2019-04-05 05:41:02 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:02.370998 236 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/ts-0-root metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/ts-0-root 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554442812470121-236/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:41:02.422891 236 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:41:02.423082 236 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:41:02.598392 236 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:42885 I0405 05:41:02.602489 236 webserver.cc:308] Webserver started at http://127.0.59.1:46561/ using document root and password file I0405 05:41:02.633097 2369 heartbeater.cc:345] Connected to a master server at 127.0.59.62:33053 I0405 05:41:02.633642 2369 heartbeater.cc:426] Registering TS with master... I0405 05:41:02.634385 2369 heartbeater.cc:475] Master 127.0.59.62:33053 requested a full tablet report, sending... I0405 05:41:02.636791 2260 ts_manager.cc:159] Registered new tserver with Master: 8265df4966c44d19847aef1b7c43a250 (127.0.59.1:42885) I0405 05:41:02.636860 236 internal_mini_cluster.cc:328] 1 TS(s) registered with all masters after 0.01828937s I0405 05:41:02.639516 2260 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57248 I0405 05:41:02.641759 236 test_util.cc:212] Using random seed: -291061182 I0405 05:41:02.680320 2260 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57250: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:02.722952 2335 tablet_service.cc:1006] Processing CreateTablet for tablet 3af025c3e57b4153b450de7ff79e0bed (table=test-workload [id=b188286381724268a814c4503bd76a09]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:02.723877 2335 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3af025c3e57b4153b450de7ff79e0bed. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:02.746021 2381 tablet_bootstrap.cc:439] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250: Bootstrap starting. I0405 05:41:02.748723 2381 tablet_bootstrap.cc:590] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250: No blocks or log segments found. Creating new log. I0405 05:41:02.759037 2381 tablet_bootstrap.cc:439] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250: No bootstrap required, opened a new log I0405 05:41:02.759439 2381 ts_tablet_manager.cc:1053] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.005s I0405 05:41:02.761420 2381 raft_consensus.cc:340] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8265df4966c44d19847aef1b7c43a250" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 42885 } } I0405 05:41:02.762135 2381 raft_consensus.cc:366] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:02.762353 2381 raft_consensus.cc:705] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8265df4966c44d19847aef1b7c43a250, State: Initialized, Role: FOLLOWER I0405 05:41:02.762904 2381 consensus_queue.cc:229] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8265df4966c44d19847aef1b7c43a250" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 42885 } } I0405 05:41:02.763512 2381 raft_consensus.cc:380] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:02.763717 2381 raft_consensus.cc:472] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:02.763980 2381 raft_consensus.cc:2886] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:02.768800 2381 raft_consensus.cc:494] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8265df4966c44d19847aef1b7c43a250" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 42885 } } I0405 05:41:02.769338 2381 leader_election.cc:310] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8265df4966c44d19847aef1b7c43a250; no voters: I0405 05:41:02.774351 2381 leader_election.cc:296] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:02.774648 2383 raft_consensus.cc:2640] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:02.778329 2383 raft_consensus.cc:667] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 1 LEADER]: Becoming Leader. State: Replica: 8265df4966c44d19847aef1b7c43a250, State: Running, Role: LEADER I0405 05:41:02.778931 2369 heartbeater.cc:467] Master 127.0.59.62:33053 was elected leader, sending a full tablet report... I0405 05:41:02.778693 2383 consensus_queue.cc:206] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8265df4966c44d19847aef1b7c43a250" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 42885 } } I0405 05:41:02.781092 2381 ts_tablet_manager.cc:1081] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250: Time spent starting tablet: real 0.021s user 0.013s sys 0.008s I0405 05:41:02.786111 2260 catalog_manager.cc:3977] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 reported cstate change: term changed from 0 to 1, leader changed from to 8265df4966c44d19847aef1b7c43a250 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "8265df4966c44d19847aef1b7c43a250" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8265df4966c44d19847aef1b7c43a250" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 42885 } health_report { overall_health: HEALTHY } } } I0405 05:41:04.071851 236 tablet_server.cc:165] TabletServer shutting down... I0405 05:41:04.090979 236 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0405 05:41:04.091259 236 tablet_replica.cc:264] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250: stopping tablet replica I0405 05:41:04.091647 236 raft_consensus.cc:2143] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 1 LEADER]: Raft consensus shutting down. I0405 05:41:04.091938 236 raft_consensus.cc:2170] T 3af025c3e57b4153b450de7ff79e0bed P 8265df4966c44d19847aef1b7c43a250 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:41:04.167155 236 tablet_server.cc:179] TabletServer shutdown complete. I0405 05:41:04.167311 236 tablet_server.cc:165] TabletServer shutting down... I0405 05:41:04.167575 236 tablet_server.cc:179] TabletServer shutdown complete. I0405 05:41:09.109493 236 master.cc:270] Master@127.0.59.62:33053 shutting down... I0405 05:41:09.153838 236 raft_consensus.cc:2143] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 1 LEADER]: Raft consensus shutting down. I0405 05:41:09.154214 236 raft_consensus.cc:2170] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9 [term 1 FOLLOWER]: Raft consensus is shut down! I0405 05:41:09.154482 236 tablet_replica.cc:264] T 00000000000000000000000000000000 P d2b79ea7a889430eab031db6e2cb2ac9: stopping tablet replica I0405 05:41:09.177438 236 master.cc:281] Master@127.0.59.62:33053 shutdown complete. [ OK ] ToolTest.TestLocalReplicaCMetaOps (7242 ms) [ RUN ] ToolTest.TestMasterList I0405 05:41:09.195024 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:40899 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:41:09.351415 2426 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:41:09.351868 2426 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:41:09.362673 2426 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:41:09.362830 2426 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:41:09.362951 2426 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:41:09.363095 2426 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:41:09.379729 2426 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:40899 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:41:09.394129 2426 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 48516us I0405 05:41:09.395083 2426 fs_manager.cc:263] Metadata directory not provided I0405 05:41:09.395234 2426 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:41:09.395529 2426 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:41:09.395650 2426 server_base.cc:434] Attempting to create new FS layout instead I0405 05:41:09.398681 2426 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "0bf4407932e74584b699fe9b4dad7f47" format_stamp: "Formatted at 2019-04-05 05:41:09 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:09.399433 2426 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "0bf4407932e74584b699fe9b4dad7f47" format_stamp: "Formatted at 2019-04-05 05:41:09 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:09.409473 2426 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s I0405 05:41:09.410796 2426 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:41:09.411315 2426 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:41:09.418087 2426 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:41:09.418218 2426 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/wal uuid: "0bf4407932e74584b699fe9b4dad7f47" format_stamp: "Formatted at 2019-04-05 05:41:09 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:09.418453 2426 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:41:09.931337 2426 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:41:09.996635 2426 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:40899 I0405 05:41:09.998942 2426 webserver.cc:308] Webserver started at http://127.0.59.62:37479/ using document root and password file I0405 05:41:09.999845 2426 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:41:10.002941 2487 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:10.004969 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 2426 I0405 05:41:10.026630 2487 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47: Bootstrap starting. I0405 05:41:10.027032 236 external_mini_cluster.cc:623] 0 TS(s) registered with all masters I0405 05:41:10.029633 2487 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47: No blocks or log segments found. Creating new log. I0405 05:41:10.031031 2487 log.cc:525] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47: Log is configured to *not* fsync() on all Append() calls I0405 05:41:10.033706 2487 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47: No bootstrap required, opened a new log I0405 05:41:10.045301 2487 raft_consensus.cc:340] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf4407932e74584b699fe9b4dad7f47" member_type: VOTER } I0405 05:41:10.045842 2487 raft_consensus.cc:366] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:10.046020 2487 raft_consensus.cc:705] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bf4407932e74584b699fe9b4dad7f47, State: Initialized, Role: FOLLOWER I0405 05:41:10.046556 2487 consensus_queue.cc:229] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf4407932e74584b699fe9b4dad7f47" member_type: VOTER } I0405 05:41:10.046924 2487 raft_consensus.cc:380] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:10.047092 2487 raft_consensus.cc:472] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:10.047296 2487 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:10.050297 2487 raft_consensus.cc:494] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf4407932e74584b699fe9b4dad7f47" member_type: VOTER } I0405 05:41:10.050783 2487 leader_election.cc:310] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0bf4407932e74584b699fe9b4dad7f47; no voters: I0405 05:41:10.052572 2487 leader_election.cc:296] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:10.052845 2492 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:10.154194 2492 raft_consensus.cc:667] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [term 1 LEADER]: Becoming Leader. State: Replica: 0bf4407932e74584b699fe9b4dad7f47, State: Running, Role: LEADER I0405 05:41:10.154659 2492 consensus_queue.cc:206] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf4407932e74584b699fe9b4dad7f47" member_type: VOTER } I0405 05:41:10.159262 2487 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "0bf4407932e74584b699fe9b4dad7f47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf4407932e74584b699fe9b4dad7f47" member_type: VOTER } } I0405 05:41:10.159824 2487 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [sys.catalog]: This master's current role is: LEADER I0405 05:41:10.159649 2493 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0bf4407932e74584b699fe9b4dad7f47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf4407932e74584b699fe9b4dad7f47" member_type: VOTER } } I0405 05:41:10.161135 2493 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [sys.catalog]: This master's current role is: LEADER I0405 05:41:10.159854 2494 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0bf4407932e74584b699fe9b4dad7f47. Latest consensus state: current_term: 1 leader_uuid: "0bf4407932e74584b699fe9b4dad7f47" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0bf4407932e74584b699fe9b4dad7f47" member_type: VOTER } } I0405 05:41:10.161623 2494 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [sys.catalog]: This master's current role is: LEADER I0405 05:41:10.167080 2496 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:41:10.169553 2487 sys_catalog.cc:424] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47 [sys.catalog]: configured and running, proceeding with master startup. I0405 05:41:10.178035 2496 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0405 05:41:10.204546 2496 catalog_manager.cc:950] Generated new certificate authority record I0405 05:41:10.206656 2496 catalog_manager.cc:1075] Loading token signing keys... I0405 05:41:10.220225 2496 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 0bf4407932e74584b699fe9b4dad7f47: Generated new TSK 0 I0405 05:41:11.835587 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 2426 [ OK ] ToolTest.TestMasterList (2668 ms) [ RUN ] ToolTest.TestListTables I0405 05:41:11.863284 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:32891 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:41:12.019100 2514 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:41:12.019577 2514 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:41:12.030474 2514 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:41:12.030632 2514 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:41:12.030766 2514 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:41:12.030901 2514 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:41:12.047798 2514 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:32891 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:41:12.062798 2514 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50016us I0405 05:41:12.063855 2514 fs_manager.cc:263] Metadata directory not provided I0405 05:41:12.064004 2514 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:41:12.064292 2514 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:41:12.064417 2514 server_base.cc:434] Attempting to create new FS layout instead I0405 05:41:12.067461 2514 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "c5888cfaf92a4ece8d80be615aadcee4" format_stamp: "Formatted at 2019-04-05 05:41:12 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:12.068182 2514 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "c5888cfaf92a4ece8d80be615aadcee4" format_stamp: "Formatted at 2019-04-05 05:41:12 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:12.078110 2514 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s I0405 05:41:12.079393 2514 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:41:12.079900 2514 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:41:12.086655 2514 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:41:12.086805 2514 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/wal uuid: "c5888cfaf92a4ece8d80be615aadcee4" format_stamp: "Formatted at 2019-04-05 05:41:12 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:12.087050 2514 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:41:12.625855 2514 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.508s user 0.000s sys 0.001s W0405 05:41:12.626097 2514 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.508s user 0.001s sys 0.002s I0405 05:41:12.691159 2514 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:41:12.749470 2514 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:32891 I0405 05:41:12.751807 2514 webserver.cc:308] Webserver started at http://127.0.59.62:43547/ using document root and password file I0405 05:41:12.752707 2514 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:41:12.755717 2576 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:12.759579 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 2514 I0405 05:41:12.761301 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.59.1:0 --local_ip_for_outbound_sockets=127.0.59.1 --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:32891 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:41:12.779780 2576 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4: Bootstrap starting. I0405 05:41:12.786675 2576 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4: No blocks or log segments found. Creating new log. I0405 05:41:12.788055 2576 log.cc:525] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4: Log is configured to *not* fsync() on all Append() calls I0405 05:41:12.795399 2576 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4: No bootstrap required, opened a new log I0405 05:41:12.816009 2576 raft_consensus.cc:340] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5888cfaf92a4ece8d80be615aadcee4" member_type: VOTER } I0405 05:41:12.816529 2576 raft_consensus.cc:366] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:12.816721 2576 raft_consensus.cc:705] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5888cfaf92a4ece8d80be615aadcee4, State: Initialized, Role: FOLLOWER I0405 05:41:12.817374 2576 consensus_queue.cc:229] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5888cfaf92a4ece8d80be615aadcee4" member_type: VOTER } I0405 05:41:12.817879 2576 raft_consensus.cc:380] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:12.818097 2576 raft_consensus.cc:472] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:12.818361 2576 raft_consensus.cc:2886] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:12.822712 2576 raft_consensus.cc:494] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5888cfaf92a4ece8d80be615aadcee4" member_type: VOTER } I0405 05:41:12.823314 2576 leader_election.cc:310] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c5888cfaf92a4ece8d80be615aadcee4; no voters: I0405 05:41:12.826364 2576 leader_election.cc:296] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:12.826661 2579 raft_consensus.cc:2640] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:12.919301 2579 raft_consensus.cc:667] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [term 1 LEADER]: Becoming Leader. State: Replica: c5888cfaf92a4ece8d80be615aadcee4, State: Running, Role: LEADER I0405 05:41:12.919958 2579 consensus_queue.cc:206] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5888cfaf92a4ece8d80be615aadcee4" member_type: VOTER } I0405 05:41:12.927471 2576 sys_catalog.cc:337] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "c5888cfaf92a4ece8d80be615aadcee4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5888cfaf92a4ece8d80be615aadcee4" member_type: VOTER } } I0405 05:41:12.927610 2581 sys_catalog.cc:337] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c5888cfaf92a4ece8d80be615aadcee4. Latest consensus state: current_term: 1 leader_uuid: "c5888cfaf92a4ece8d80be615aadcee4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5888cfaf92a4ece8d80be615aadcee4" member_type: VOTER } } I0405 05:41:12.928951 2576 sys_catalog.cc:340] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [sys.catalog]: This master's current role is: LEADER I0405 05:41:12.929673 2581 sys_catalog.cc:340] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [sys.catalog]: This master's current role is: LEADER I0405 05:41:12.929075 2580 sys_catalog.cc:337] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c5888cfaf92a4ece8d80be615aadcee4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c5888cfaf92a4ece8d80be615aadcee4" member_type: VOTER } } I0405 05:41:12.930037 2580 sys_catalog.cc:340] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [sys.catalog]: This master's current role is: LEADER I0405 05:41:12.935477 2576 sys_catalog.cc:424] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4 [sys.catalog]: configured and running, proceeding with master startup. I0405 05:41:12.936285 2583 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:41:12.945056 2583 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:41:12.996908 2577 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:41:12.997514 2577 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0405 05:41:13.009414 2583 catalog_manager.cc:950] Generated new certificate authority record I0405 05:41:13.010915 2583 catalog_manager.cc:1075] Loading token signing keys... W0405 05:41:13.011166 2577 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:41:13.011766 2577 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.1 I0405 05:41:13.021622 2583 catalog_manager.cc:4281] T 00000000000000000000000000000000 P c5888cfaf92a4ece8d80be615aadcee4: Generated new TSK 0 I0405 05:41:13.035357 2577 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:32891 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:41:13.061214 2577 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 50516us I0405 05:41:13.061955 2577 fs_manager.cc:263] Metadata directory not provided I0405 05:41:13.062134 2577 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:41:13.062518 2577 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:41:13.062690 2577 server_base.cc:434] Attempting to create new FS layout instead I0405 05:41:13.067009 2577 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "4e40b00c13b84ea58862bc98124e4b70" format_stamp: "Formatted at 2019-04-05 05:41:13 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:13.068032 2577 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "4e40b00c13b84ea58862bc98124e4b70" format_stamp: "Formatted at 2019-04-05 05:41:13 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:13.083885 2577 fs_manager.cc:503] Time spent creating directory manager: real 0.015s user 0.015s sys 0.001s I0405 05:41:13.086325 2577 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:41:13.087080 2577 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:41:13.098515 2577 fs_manager.cc:419] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s I0405 05:41:13.098714 2577 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/wal uuid: "4e40b00c13b84ea58862bc98124e4b70" format_stamp: "Formatted at 2019-04-05 05:41:13 on dist-test-slave-dist-test-slave-bl6s" I0405 05:41:13.099053 2577 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:41:13.655102 2577 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:41:13.659627 2577 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:41:13.659916 2577 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:41:14.034519 2577 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:34015 I0405 05:41:14.036962 2577 webserver.cc:308] Webserver started at http://127.0.59.1:46879/ using document root and password file I0405 05:41:14.037781 2577 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:41:14.047379 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 2577 I0405 05:41:14.073629 2708 heartbeater.cc:345] Connected to a master server at 127.0.59.62:32891 I0405 05:41:14.073942 2708 heartbeater.cc:426] Registering TS with master... I0405 05:41:14.074568 2708 heartbeater.cc:475] Master 127.0.59.62:32891 requested a full tablet report, sending... I0405 05:41:14.076514 2542 ts_manager.cc:159] Registered new tserver with Master: 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1:34015) I0405 05:41:14.078624 236 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0405 05:41:14.078821 2542 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.1:53433 I0405 05:41:14.096807 236 test_util.cc:212] Using random seed: -279606135 I0405 05:41:14.114840 2542 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33566: name: "kudu.table_0" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.153081 2645 tablet_service.cc:1006] Processing CreateTablet for tablet 949e9e17bab0481ea2545879d358d738 (table=kudu.table_0 [id=c6c2bb220a1c476e9a1ec3dd3a00627e]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.153995 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 949e9e17bab0481ea2545879d358d738. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.169273 2730 tablet_bootstrap.cc:439] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.171921 2730 tablet_bootstrap.cc:590] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.173272 2730 log.cc:525] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70: Log is configured to *not* fsync() on all Append() calls I0405 05:41:14.179422 2730 tablet_bootstrap.cc:439] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.179754 2730 ts_tablet_manager.cc:1053] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.006s I0405 05:41:14.191572 2730 raft_consensus.cc:340] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.192051 2730 raft_consensus.cc:366] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.192210 2730 raft_consensus.cc:705] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.192684 2730 consensus_queue.cc:229] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.193076 2730 raft_consensus.cc:380] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.193256 2730 raft_consensus.cc:472] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.193449 2730 raft_consensus.cc:2886] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.196501 2730 raft_consensus.cc:494] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.197122 2730 leader_election.cc:310] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.199246 2730 leader_election.cc:296] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.199605 2732 raft_consensus.cc:2640] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.298971 2708 heartbeater.cc:467] Master 127.0.59.62:32891 was elected leader, sending a full tablet report... I0405 05:41:14.299365 2730 ts_tablet_manager.cc:1081] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.119s user 0.012s sys 0.011s I0405 05:41:14.300141 2732 raft_consensus.cc:667] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.300699 2732 consensus_queue.cc:206] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.308883 2542 catalog_manager.cc:3977] T 949e9e17bab0481ea2545879d358d738 P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.342339 236 test_util.cc:212] Using random seed: -279360609 I0405 05:41:14.373045 2542 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33570: name: "kudu.table_1" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.384208 2645 tablet_service.cc:1006] Processing CreateTablet for tablet f9a9b86708c1487897cbf87d99fec62b (table=kudu.table_1 [id=7337e4a7be594cd18c4eea876e864990]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.384738 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f9a9b86708c1487897cbf87d99fec62b. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.391942 2730 tablet_bootstrap.cc:439] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.394199 2730 tablet_bootstrap.cc:590] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.399155 2730 tablet_bootstrap.cc:439] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.399534 2730 ts_tablet_manager.cc:1053] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.008s user 0.003s sys 0.004s I0405 05:41:14.400810 2730 raft_consensus.cc:340] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.401141 2730 raft_consensus.cc:366] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.401288 2730 raft_consensus.cc:705] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.401608 2730 consensus_queue.cc:229] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.401983 2730 raft_consensus.cc:380] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.402119 2730 raft_consensus.cc:472] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.402289 2730 raft_consensus.cc:2886] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.405486 2730 raft_consensus.cc:494] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.406010 2730 leader_election.cc:310] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.406440 2730 leader_election.cc:296] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.406584 2732 raft_consensus.cc:2640] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.406936 2732 raft_consensus.cc:667] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.407481 2730 ts_tablet_manager.cc:1081] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.008s user 0.006s sys 0.002s I0405 05:41:14.407336 2732 consensus_queue.cc:206] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.411648 2542 catalog_manager.cc:3977] T f9a9b86708c1487897cbf87d99fec62b P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.424919 236 test_util.cc:212] Using random seed: -279278026 I0405 05:41:14.442914 2543 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33572: name: "kudu.table_2" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.455519 2645 tablet_service.cc:1006] Processing CreateTablet for tablet 2d5f0af69c964ee0be4efc70a6cb673f (table=kudu.table_2 [id=cb18a1aa6728407a8dd2bbcc9fb673ec]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.456064 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 2d5f0af69c964ee0be4efc70a6cb673f. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.463270 2730 tablet_bootstrap.cc:439] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.465543 2730 tablet_bootstrap.cc:590] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.470367 2730 tablet_bootstrap.cc:439] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.470675 2730 ts_tablet_manager.cc:1053] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.001s I0405 05:41:14.471964 2730 raft_consensus.cc:340] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.472288 2730 raft_consensus.cc:366] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.472434 2730 raft_consensus.cc:705] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.472787 2730 consensus_queue.cc:229] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.473143 2730 raft_consensus.cc:380] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.473289 2730 raft_consensus.cc:472] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.473448 2730 raft_consensus.cc:2886] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.476466 2730 raft_consensus.cc:494] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.476977 2730 leader_election.cc:310] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.477497 2730 leader_election.cc:296] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.477604 2732 raft_consensus.cc:2640] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.477944 2732 raft_consensus.cc:667] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.478338 2732 consensus_queue.cc:206] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.478720 2730 ts_tablet_manager.cc:1081] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s I0405 05:41:14.483053 2543 catalog_manager.cc:3977] T 2d5f0af69c964ee0be4efc70a6cb673f P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.492786 236 test_util.cc:212] Using random seed: -279210162 I0405 05:41:14.509989 2543 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33574: name: "kudu.table_3" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.520407 2645 tablet_service.cc:1006] Processing CreateTablet for tablet 4973fa6f680f47079a6c598cec72701e (table=kudu.table_3 [id=0cc2e1e954cb467eb71e23571e1835a6]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.520927 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4973fa6f680f47079a6c598cec72701e. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.528295 2730 tablet_bootstrap.cc:439] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.530786 2730 tablet_bootstrap.cc:590] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.535137 2730 tablet_bootstrap.cc:439] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.535462 2730 ts_tablet_manager.cc:1053] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s I0405 05:41:14.536759 2730 raft_consensus.cc:340] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.537075 2730 raft_consensus.cc:366] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.537200 2730 raft_consensus.cc:705] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.537492 2730 consensus_queue.cc:229] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.537829 2730 raft_consensus.cc:380] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.537968 2730 raft_consensus.cc:472] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.538111 2730 raft_consensus.cc:2886] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.541105 2730 raft_consensus.cc:494] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.541604 2730 leader_election.cc:310] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.542002 2730 leader_election.cc:296] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.542119 2732 raft_consensus.cc:2640] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.542474 2732 raft_consensus.cc:667] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.542750 2730 ts_tablet_manager.cc:1081] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s I0405 05:41:14.542825 2732 consensus_queue.cc:206] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.546419 2543 catalog_manager.cc:3977] T 4973fa6f680f47079a6c598cec72701e P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.556416 236 test_util.cc:212] Using random seed: -279146701 I0405 05:41:14.571197 2543 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33576: name: "kudu.table_4" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.580714 2645 tablet_service.cc:1006] Processing CreateTablet for tablet 27ff08311f804832bef557063fd397c1 (table=kudu.table_4 [id=f901f3a2b6e64179a92a39d5f647a881]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.581316 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 27ff08311f804832bef557063fd397c1. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.588760 2730 tablet_bootstrap.cc:439] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.591321 2730 tablet_bootstrap.cc:590] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.595798 2730 tablet_bootstrap.cc:439] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.596088 2730 ts_tablet_manager.cc:1053] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s I0405 05:41:14.597175 2730 raft_consensus.cc:340] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.597503 2730 raft_consensus.cc:366] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.597630 2730 raft_consensus.cc:705] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.597990 2730 consensus_queue.cc:229] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.598359 2730 raft_consensus.cc:380] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.598497 2730 raft_consensus.cc:472] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.598655 2730 raft_consensus.cc:2886] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.602123 2730 raft_consensus.cc:494] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.602504 2730 leader_election.cc:310] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.602876 2730 leader_election.cc:296] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.603003 2732 raft_consensus.cc:2640] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.603341 2732 raft_consensus.cc:667] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.603678 2730 ts_tablet_manager.cc:1081] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s I0405 05:41:14.603718 2732 consensus_queue.cc:206] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.607764 2543 catalog_manager.cc:3977] T 27ff08311f804832bef557063fd397c1 P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.616472 236 test_util.cc:212] Using random seed: -279086472 I0405 05:41:14.630681 2543 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33578: name: "kudu.table_5" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.640625 2645 tablet_service.cc:1006] Processing CreateTablet for tablet 18aaef92169e4e578a7d442b95cb130e (table=kudu.table_5 [id=d0c1bcc37b004408ba3d75a8ba543e33]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.641199 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 18aaef92169e4e578a7d442b95cb130e. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.648847 2730 tablet_bootstrap.cc:439] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.651477 2730 tablet_bootstrap.cc:590] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.654680 2730 tablet_bootstrap.cc:439] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.654966 2730 ts_tablet_manager.cc:1053] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s I0405 05:41:14.656332 2730 raft_consensus.cc:340] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.656718 2730 raft_consensus.cc:366] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.656858 2730 raft_consensus.cc:705] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.657233 2730 consensus_queue.cc:229] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.657621 2730 raft_consensus.cc:380] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.657757 2730 raft_consensus.cc:472] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.657956 2730 raft_consensus.cc:2886] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.661064 2730 raft_consensus.cc:494] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.661485 2730 leader_election.cc:310] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.661988 2730 leader_election.cc:296] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.662107 2732 raft_consensus.cc:2640] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.662431 2732 raft_consensus.cc:667] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.662812 2732 consensus_queue.cc:206] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.663108 2730 ts_tablet_manager.cc:1081] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.008s user 0.005s sys 0.002s I0405 05:41:14.668275 2543 catalog_manager.cc:3977] T 18aaef92169e4e578a7d442b95cb130e P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.677767 236 test_util.cc:212] Using random seed: -279025178 I0405 05:41:14.707630 2543 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33580: name: "kudu.table_6" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.719555 2645 tablet_service.cc:1006] Processing CreateTablet for tablet 7ce0ce8e4653401b83dbd0ad0bd340e2 (table=kudu.table_6 [id=e72cdef5a55d42639aa781d85282748f]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.720254 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 7ce0ce8e4653401b83dbd0ad0bd340e2. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.730712 2730 tablet_bootstrap.cc:439] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.732985 2730 tablet_bootstrap.cc:590] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.735983 2730 tablet_bootstrap.cc:439] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.736323 2730 ts_tablet_manager.cc:1053] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.001s I0405 05:41:14.737532 2730 raft_consensus.cc:340] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.737886 2730 raft_consensus.cc:366] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.738009 2730 raft_consensus.cc:705] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.738340 2730 consensus_queue.cc:229] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.738683 2730 raft_consensus.cc:380] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.738804 2730 raft_consensus.cc:472] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.738946 2730 raft_consensus.cc:2886] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.742396 2730 raft_consensus.cc:494] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.742763 2730 leader_election.cc:310] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.743090 2730 leader_election.cc:296] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.743239 2732 raft_consensus.cc:2640] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.743731 2732 raft_consensus.cc:667] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.743851 2730 ts_tablet_manager.cc:1081] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s I0405 05:41:14.744194 2732 consensus_queue.cc:206] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.751648 2543 catalog_manager.cc:3977] T 7ce0ce8e4653401b83dbd0ad0bd340e2 P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.761939 236 test_util.cc:212] Using random seed: -278941006 I0405 05:41:14.776697 2543 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33582: name: "kudu.table_7" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.786979 2645 tablet_service.cc:1006] Processing CreateTablet for tablet e7fba6a61ff7459e9ff0dac556edfd16 (table=kudu.table_7 [id=879c92e3b365437ab6ab2e33a8d20da6]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.787524 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e7fba6a61ff7459e9ff0dac556edfd16. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.794313 2730 tablet_bootstrap.cc:439] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.796649 2730 tablet_bootstrap.cc:590] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.800165 2730 tablet_bootstrap.cc:439] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.800407 2730 ts_tablet_manager.cc:1053] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s I0405 05:41:14.801780 2730 raft_consensus.cc:340] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.802258 2730 raft_consensus.cc:366] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.802392 2730 raft_consensus.cc:705] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.802795 2730 consensus_queue.cc:229] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.803257 2730 raft_consensus.cc:380] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.803406 2730 raft_consensus.cc:472] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.803557 2730 raft_consensus.cc:2886] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.806784 2730 raft_consensus.cc:494] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.807168 2730 leader_election.cc:310] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.807633 2730 leader_election.cc:296] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.807760 2732 raft_consensus.cc:2640] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.808110 2732 raft_consensus.cc:667] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.808483 2732 consensus_queue.cc:206] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.808758 2730 ts_tablet_manager.cc:1081] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s I0405 05:41:14.812239 2543 catalog_manager.cc:3977] T e7fba6a61ff7459e9ff0dac556edfd16 P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.824013 236 test_util.cc:212] Using random seed: -278878933 I0405 05:41:14.839243 2543 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33584: name: "kudu.table_8" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.849943 2645 tablet_service.cc:1006] Processing CreateTablet for tablet 7c1c80db29c5465f97180d9c66ed9018 (table=kudu.table_8 [id=7969752d0e5e4f3590c4b096ba6983f5]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.850502 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 7c1c80db29c5465f97180d9c66ed9018. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.857339 2730 tablet_bootstrap.cc:439] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.859731 2730 tablet_bootstrap.cc:590] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.863391 2730 tablet_bootstrap.cc:439] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.863723 2730 ts_tablet_manager.cc:1053] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s I0405 05:41:14.864918 2730 raft_consensus.cc:340] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.865290 2730 raft_consensus.cc:366] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.865433 2730 raft_consensus.cc:705] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.865761 2730 consensus_queue.cc:229] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.866135 2730 raft_consensus.cc:380] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.866271 2730 raft_consensus.cc:472] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.866449 2730 raft_consensus.cc:2886] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.869633 2730 raft_consensus.cc:494] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.870076 2730 leader_election.cc:310] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.870442 2730 leader_election.cc:296] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.870560 2732 raft_consensus.cc:2640] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.870860 2732 raft_consensus.cc:667] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.871228 2730 ts_tablet_manager.cc:1081] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s I0405 05:41:14.871268 2732 consensus_queue.cc:206] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.874891 2543 catalog_manager.cc:3977] T 7c1c80db29c5465f97180d9c66ed9018 P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:14.884841 236 test_util.cc:212] Using random seed: -278818102 I0405 05:41:14.899210 2543 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33586: name: "kudu.table_9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:41:14.909605 2645 tablet_service.cc:1006] Processing CreateTablet for tablet 961c198d75a141e2b1432b1117815998 (table=kudu.table_9 [id=157e215e3c8748aabb19a192d30d74dd]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:41:14.910148 2645 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 961c198d75a141e2b1432b1117815998. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:41:14.916929 2730 tablet_bootstrap.cc:439] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70: Bootstrap starting. I0405 05:41:14.919432 2730 tablet_bootstrap.cc:590] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70: No blocks or log segments found. Creating new log. I0405 05:41:14.922490 2730 tablet_bootstrap.cc:439] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70: No bootstrap required, opened a new log I0405 05:41:14.922741 2730 ts_tablet_manager.cc:1053] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s I0405 05:41:14.924216 2730 raft_consensus.cc:340] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.924633 2730 raft_consensus.cc:366] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:41:14.924906 2730 raft_consensus.cc:705] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Initialized, Role: FOLLOWER I0405 05:41:14.925272 2730 consensus_queue.cc:229] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.925649 2730 raft_consensus.cc:380] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:41:14.925773 2730 raft_consensus.cc:472] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:41:14.925932 2730 raft_consensus.cc:2886] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:41:14.929191 2730 raft_consensus.cc:494] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.929577 2730 leader_election.cc:310] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e40b00c13b84ea58862bc98124e4b70; no voters: I0405 05:41:14.930069 2730 leader_election.cc:296] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:41:14.930202 2732 raft_consensus.cc:2640] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:41:14.930498 2732 raft_consensus.cc:667] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [term 1 LEADER]: Becoming Leader. State: Replica: 4e40b00c13b84ea58862bc98124e4b70, State: Running, Role: LEADER I0405 05:41:14.930864 2732 consensus_queue.cc:206] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } } I0405 05:41:14.931136 2730 ts_tablet_manager.cc:1081] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s I0405 05:41:14.935040 2543 catalog_manager.cc:3977] T 961c198d75a141e2b1432b1117815998 P 4e40b00c13b84ea58862bc98124e4b70 reported cstate change: term changed from 0 to 1, leader changed from to 4e40b00c13b84ea58862bc98124e4b70 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4e40b00c13b84ea58862bc98124e4b70" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e40b00c13b84ea58862bc98124e4b70" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34015 } health_report { overall_health: HEALTHY } } } I0405 05:41:50.656548 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 2577 I0405 05:41:50.678174 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 2514 [ OK ] ToolTest.TestListTables (38855 ms) [ RUN ] ToolTest.TestHmsPrecheck 2019-04-05 05:41:51: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/derby.log log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvH0aH1/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvH0aH1/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Starting hive metastore on port 0 2870 T1 odu.Log4JLogger.info Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2881 T1 odu.Log4JLogger.info Property datanucleus.cache.level2 unknown - will be ignored I0405 05:42:01.340632 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:36859 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:42:01.496654 3188 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:42:01.497149 3188 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:42:01.508388 3188 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:42:01.508556 3188 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:42:01.508714 3188 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:42:01.508855 3188 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:42:01.526065 3188 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:36859 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:42:01.540630 3188 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 74516us I0405 05:42:01.541765 3188 fs_manager.cc:263] Metadata directory not provided I0405 05:42:01.541946 3188 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:42:01.542275 3188 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:42:01.542389 3188 server_base.cc:434] Attempting to create new FS layout instead I0405 05:42:01.545442 3188 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "55c5b0b3a0b64545810b61836985798e" format_stamp: "Formatted at 2019-04-05 05:42:01 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:01.546262 3188 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "55c5b0b3a0b64545810b61836985798e" format_stamp: "Formatted at 2019-04-05 05:42:01 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:01.556793 3188 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.005s sys 0.005s I0405 05:42:01.558094 3188 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:42:01.558634 3188 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:42:01.565640 3188 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:42:01.565765 3188 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal uuid: "55c5b0b3a0b64545810b61836985798e" format_stamp: "Formatted at 2019-04-05 05:42:01 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:01.566033 3188 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:42:02.092701 3188 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:42:02.149993 3188 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:36859 I0405 05:42:02.152554 3188 webserver.cc:308] Webserver started at http://127.0.59.62:35303/ using document root and password file I0405 05:42:02.153602 3188 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:42:02.156795 3249 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:02.161417 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 3188 I0405 05:42:02.162972 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.59.1:0 --local_ip_for_outbound_sockets=127.0.59.1 --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:36859 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:42:02.177253 3249 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: Bootstrap starting. I0405 05:42:02.180758 3249 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: No blocks or log segments found. Creating new log. I0405 05:42:02.182507 3249 log.cc:525] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: Log is configured to *not* fsync() on all Append() calls I0405 05:42:02.185500 3249 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: No bootstrap required, opened a new log I0405 05:42:02.206112 3249 raft_consensus.cc:340] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } I0405 05:42:02.206619 3249 raft_consensus.cc:366] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:02.206817 3249 raft_consensus.cc:705] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c5b0b3a0b64545810b61836985798e, State: Initialized, Role: FOLLOWER I0405 05:42:02.207496 3249 consensus_queue.cc:229] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } I0405 05:42:02.208000 3249 raft_consensus.cc:380] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:02.208250 3249 raft_consensus.cc:472] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:02.208519 3249 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:02.213124 3249 raft_consensus.cc:494] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } I0405 05:42:02.213757 3249 leader_election.cc:310] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55c5b0b3a0b64545810b61836985798e; no voters: I0405 05:42:02.215637 3249 leader_election.cc:296] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:02.215955 3252 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:02.318596 3252 raft_consensus.cc:667] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 1 LEADER]: Becoming Leader. State: Replica: 55c5b0b3a0b64545810b61836985798e, State: Running, Role: LEADER I0405 05:42:02.319088 3252 consensus_queue.cc:206] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } I0405 05:42:02.323513 3249 sys_catalog.cc:337] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "55c5b0b3a0b64545810b61836985798e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } } I0405 05:42:02.323572 3254 sys_catalog.cc:337] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55c5b0b3a0b64545810b61836985798e. Latest consensus state: current_term: 1 leader_uuid: "55c5b0b3a0b64545810b61836985798e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } } I0405 05:42:02.323513 3253 sys_catalog.cc:337] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "55c5b0b3a0b64545810b61836985798e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } } I0405 05:42:02.324080 3249 sys_catalog.cc:340] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: This master's current role is: LEADER I0405 05:42:02.324112 3254 sys_catalog.cc:340] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: This master's current role is: LEADER I0405 05:42:02.324120 3253 sys_catalog.cc:340] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: This master's current role is: LEADER I0405 05:42:02.327322 3249 sys_catalog.cc:424] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: configured and running, proceeding with master startup. W0405 05:42:02.336066 3257 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0405 05:42:02.336324 3257 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0405 05:42:02.336664 3256 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:42:02.339872 3256 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:42:02.361315 3250 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:42:02.361876 3250 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:42:02.377054 3250 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:42:02.377585 3250 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.1 I0405 05:42:02.398988 3250 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:36859 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:42:02.399416 3256 catalog_manager.cc:950] Generated new certificate authority record I0405 05:42:02.401623 3256 catalog_manager.cc:1075] Loading token signing keys... I0405 05:42:02.424464 3250 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 75016us I0405 05:42:02.425258 3250 fs_manager.cc:263] Metadata directory not provided I0405 05:42:02.425446 3250 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:42:02.425796 3250 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:42:02.425968 3250 server_base.cc:434] Attempting to create new FS layout instead I0405 05:42:02.429409 3256 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: Generated new TSK 0 I0405 05:42:02.429723 3250 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "1f47cd09f5484f14b00848e4d0df5edb" format_stamp: "Formatted at 2019-04-05 05:42:02 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:02.430683 3250 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "1f47cd09f5484f14b00848e4d0df5edb" format_stamp: "Formatted at 2019-04-05 05:42:02 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:02.441042 3250 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.009s sys 0.001s I0405 05:42:02.442332 3250 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:42:02.442850 3250 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:42:02.449560 3250 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:42:02.449689 3250 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/wal uuid: "1f47cd09f5484f14b00848e4d0df5edb" format_stamp: "Formatted at 2019-04-05 05:42:02 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:02.449951 3250 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:42:03.019611 3250 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.541s user 0.130s sys 0.411s W0405 05:42:03.019816 3250 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.542s user 0.130s sys 0.411s I0405 05:42:03.079560 3250 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:42:03.084117 3250 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:42:03.084328 3250 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:42:03.276338 3250 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:33883 I0405 05:42:03.279660 3250 webserver.cc:308] Webserver started at http://127.0.59.1:39669/ using document root and password file I0405 05:42:03.280776 3250 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:42:03.287591 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 3250 I0405 05:42:03.312011 3382 heartbeater.cc:345] Connected to a master server at 127.0.59.62:36859 I0405 05:42:03.312397 3382 heartbeater.cc:426] Registering TS with master... I0405 05:42:03.313081 3382 heartbeater.cc:475] Master 127.0.59.62:36859 requested a full tablet report, sending... I0405 05:42:03.315295 3216 ts_manager.cc:159] Registered new tserver with Master: 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1:33883) I0405 05:42:03.317986 3216 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.1:54755 I0405 05:42:03.318146 236 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0405 05:42:03.354034 3216 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51726: name: "a.b" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:03.408082 3319 tablet_service.cc:1006] Processing CreateTablet for tablet 12b8e24237724b87b477d37b2d11af36 (table=a.b [id=3a54afd54eb54a48a74c15e107a6a784]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:03.408915 3319 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 12b8e24237724b87b477d37b2d11af36. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:03.427002 3398 tablet_bootstrap.cc:439] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb: Bootstrap starting. I0405 05:42:03.434116 3398 tablet_bootstrap.cc:590] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb: No blocks or log segments found. Creating new log. I0405 05:42:03.435714 3398 log.cc:525] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb: Log is configured to *not* fsync() on all Append() calls I0405 05:42:03.443310 3398 tablet_bootstrap.cc:439] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb: No bootstrap required, opened a new log I0405 05:42:03.443754 3398 ts_tablet_manager.cc:1053] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent bootstrapping tablet: real 0.017s user 0.000s sys 0.006s I0405 05:42:03.462177 3398 raft_consensus.cc:340] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.462863 3398 raft_consensus.cc:366] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:03.463089 3398 raft_consensus.cc:705] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Initialized, Role: FOLLOWER I0405 05:42:03.463698 3398 consensus_queue.cc:229] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.464265 3398 raft_consensus.cc:380] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:03.464514 3398 raft_consensus.cc:472] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:03.464773 3398 raft_consensus.cc:2886] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:03.469630 3398 raft_consensus.cc:494] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.470350 3398 leader_election.cc:310] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f47cd09f5484f14b00848e4d0df5edb; no voters: I0405 05:42:03.474428 3398 leader_election.cc:296] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:03.474740 3400 raft_consensus.cc:2640] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:03.553885 3400 raft_consensus.cc:667] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 LEADER]: Becoming Leader. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Running, Role: LEADER I0405 05:42:03.554589 3400 consensus_queue.cc:206] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.556321 3382 heartbeater.cc:467] Master 127.0.59.62:36859 was elected leader, sending a full tablet report... I0405 05:42:03.557425 3398 ts_tablet_manager.cc:1081] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent starting tablet: real 0.113s user 0.023s sys 0.012s I0405 05:42:03.561260 3216 catalog_manager.cc:3977] T 12b8e24237724b87b477d37b2d11af36 P 1f47cd09f5484f14b00848e4d0df5edb reported cstate change: term changed from 0 to 1, leader changed from to 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1). New cstate: current_term: 1 leader_uuid: "1f47cd09f5484f14b00848e4d0df5edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } health_report { overall_health: HEALTHY } } } I0405 05:42:03.595919 3216 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51726: name: "foo.bar" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:03.606957 3319 tablet_service.cc:1006] Processing CreateTablet for tablet c8ca0c7520d94e03a129169e50615953 (table=foo.bar [id=6a9dc5a1e5eb47e4b58b45e7c01918f4]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:03.607650 3319 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c8ca0c7520d94e03a129169e50615953. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:03.617147 3398 tablet_bootstrap.cc:439] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb: Bootstrap starting. I0405 05:42:03.619910 3398 tablet_bootstrap.cc:590] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb: No blocks or log segments found. Creating new log. I0405 05:42:03.623893 3398 tablet_bootstrap.cc:439] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb: No bootstrap required, opened a new log I0405 05:42:03.624258 3398 ts_tablet_manager.cc:1053] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.002s I0405 05:42:03.625495 3398 raft_consensus.cc:340] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.625849 3398 raft_consensus.cc:366] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:03.625991 3398 raft_consensus.cc:705] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Initialized, Role: FOLLOWER I0405 05:42:03.626348 3398 consensus_queue.cc:229] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.626716 3398 raft_consensus.cc:380] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:03.626850 3398 raft_consensus.cc:472] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:03.627045 3398 raft_consensus.cc:2886] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:03.630424 3398 raft_consensus.cc:494] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.630859 3398 leader_election.cc:310] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f47cd09f5484f14b00848e4d0df5edb; no voters: I0405 05:42:03.631239 3398 leader_election.cc:296] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:03.631417 3400 raft_consensus.cc:2640] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:03.632120 3398 ts_tablet_manager.cc:1081] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s I0405 05:42:03.631996 3400 raft_consensus.cc:667] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 LEADER]: Becoming Leader. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Running, Role: LEADER I0405 05:42:03.632491 3400 consensus_queue.cc:206] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.637138 3216 catalog_manager.cc:3977] T c8ca0c7520d94e03a129169e50615953 P 1f47cd09f5484f14b00848e4d0df5edb reported cstate change: term changed from 0 to 1, leader changed from to 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1). New cstate: current_term: 1 leader_uuid: "1f47cd09f5484f14b00848e4d0df5edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } health_report { overall_health: HEALTHY } } } I0405 05:42:03.646883 3215 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51726: name: "FOO.bar" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:03.658051 3319 tablet_service.cc:1006] Processing CreateTablet for tablet 34167c1783a54a0aabae8c84200108c3 (table=FOO.bar [id=da7cb7b87c234d45b5d9e60b9ee98de4]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:03.658740 3319 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 34167c1783a54a0aabae8c84200108c3. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:03.672508 3398 tablet_bootstrap.cc:439] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb: Bootstrap starting. I0405 05:42:03.675151 3398 tablet_bootstrap.cc:590] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb: No blocks or log segments found. Creating new log. I0405 05:42:03.679258 3398 tablet_bootstrap.cc:439] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb: No bootstrap required, opened a new log I0405 05:42:03.679563 3398 ts_tablet_manager.cc:1053] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent bootstrapping tablet: real 0.007s user 0.000s sys 0.006s I0405 05:42:03.680775 3398 raft_consensus.cc:340] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.681135 3398 raft_consensus.cc:366] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:03.681270 3398 raft_consensus.cc:705] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Initialized, Role: FOLLOWER I0405 05:42:03.681635 3398 consensus_queue.cc:229] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.682080 3398 raft_consensus.cc:380] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:03.682252 3398 raft_consensus.cc:472] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:03.682477 3398 raft_consensus.cc:2886] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:03.685896 3398 raft_consensus.cc:494] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.686416 3398 leader_election.cc:310] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f47cd09f5484f14b00848e4d0df5edb; no voters: I0405 05:42:03.686805 3398 leader_election.cc:296] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:03.686954 3400 raft_consensus.cc:2640] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:03.687469 3400 raft_consensus.cc:667] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 LEADER]: Becoming Leader. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Running, Role: LEADER I0405 05:42:03.688164 3398 ts_tablet_manager.cc:1081] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s I0405 05:42:03.687933 3400 consensus_queue.cc:206] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.692554 3215 catalog_manager.cc:3977] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb reported cstate change: term changed from 0 to 1, leader changed from to 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1). New cstate: current_term: 1 leader_uuid: "1f47cd09f5484f14b00848e4d0df5edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } health_report { overall_health: HEALTHY } } } I0405 05:42:03.719195 3215 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51726: name: "foo.BAR" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:03.731773 3319 tablet_service.cc:1006] Processing CreateTablet for tablet 2bf3cff34de740a78a567b70a7c744b8 (table=foo.BAR [id=7c4b983d0b8d465f9c80b05478b28a1a]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:03.732488 3319 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 2bf3cff34de740a78a567b70a7c744b8. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:03.742082 3398 tablet_bootstrap.cc:439] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb: Bootstrap starting. I0405 05:42:03.744366 3398 tablet_bootstrap.cc:590] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb: No blocks or log segments found. Creating new log. I0405 05:42:03.762475 3398 tablet_bootstrap.cc:439] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb: No bootstrap required, opened a new log I0405 05:42:03.762794 3398 ts_tablet_manager.cc:1053] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent bootstrapping tablet: real 0.021s user 0.002s sys 0.007s I0405 05:42:03.763972 3398 raft_consensus.cc:340] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.764309 3398 raft_consensus.cc:366] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:03.764441 3398 raft_consensus.cc:705] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Initialized, Role: FOLLOWER I0405 05:42:03.764807 3398 consensus_queue.cc:229] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.765166 3398 raft_consensus.cc:380] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:03.765297 3398 raft_consensus.cc:472] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:03.765456 3398 raft_consensus.cc:2886] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:03.769014 3398 raft_consensus.cc:494] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.769522 3398 leader_election.cc:310] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f47cd09f5484f14b00848e4d0df5edb; no voters: I0405 05:42:03.770035 3398 leader_election.cc:296] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:03.770237 3400 raft_consensus.cc:2640] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:03.770571 3400 raft_consensus.cc:667] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 LEADER]: Becoming Leader. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Running, Role: LEADER I0405 05:42:03.770948 3400 consensus_queue.cc:206] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.771414 3398 ts_tablet_manager.cc:1081] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s I0405 05:42:03.775689 3215 catalog_manager.cc:3977] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb reported cstate change: term changed from 0 to 1, leader changed from to 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1). New cstate: current_term: 1 leader_uuid: "1f47cd09f5484f14b00848e4d0df5edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } health_report { overall_health: HEALTHY } } } I0405 05:42:03.808164 3215 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51726: name: "fuzz" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:03.819723 3319 tablet_service.cc:1006] Processing CreateTablet for tablet d0d5e0410a684afab87e022bd3c88dc9 (table=fuzz [id=ef1fb4df187548fd92ede5a2d447adb8]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:03.820430 3319 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d0d5e0410a684afab87e022bd3c88dc9. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:03.827788 3398 tablet_bootstrap.cc:439] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb: Bootstrap starting. I0405 05:42:03.830320 3398 tablet_bootstrap.cc:590] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb: No blocks or log segments found. Creating new log. I0405 05:42:03.833585 3398 tablet_bootstrap.cc:439] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb: No bootstrap required, opened a new log I0405 05:42:03.833917 3398 ts_tablet_manager.cc:1053] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent bootstrapping tablet: real 0.006s user 0.006s sys 0.000s I0405 05:42:03.835196 3398 raft_consensus.cc:340] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.835713 3398 raft_consensus.cc:366] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:03.835872 3398 raft_consensus.cc:705] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Initialized, Role: FOLLOWER I0405 05:42:03.836256 3398 consensus_queue.cc:229] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.836599 3398 raft_consensus.cc:380] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:03.836774 3398 raft_consensus.cc:472] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:03.836943 3398 raft_consensus.cc:2886] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:03.840065 3398 raft_consensus.cc:494] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.840529 3398 leader_election.cc:310] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f47cd09f5484f14b00848e4d0df5edb; no voters: I0405 05:42:03.840987 3398 leader_election.cc:296] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:03.841135 3400 raft_consensus.cc:2640] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:03.841490 3400 raft_consensus.cc:667] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 LEADER]: Becoming Leader. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Running, Role: LEADER I0405 05:42:03.842083 3398 ts_tablet_manager.cc:1081] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s I0405 05:42:03.841897 3400 consensus_queue.cc:206] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.845450 3215 catalog_manager.cc:3977] T d0d5e0410a684afab87e022bd3c88dc9 P 1f47cd09f5484f14b00848e4d0df5edb reported cstate change: term changed from 0 to 1, leader changed from to 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1). New cstate: current_term: 1 leader_uuid: "1f47cd09f5484f14b00848e4d0df5edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } health_report { overall_health: HEALTHY } } } I0405 05:42:03.856791 3215 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51726: name: "FUZZ" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:03.866361 3319 tablet_service.cc:1006] Processing CreateTablet for tablet 1a859fe5c96c45cbbae95f0c7c3d7206 (table=FUZZ [id=e3f1c3e03d1f43b5b9f9bf2f6b0e4eb0]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:03.866888 3319 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1a859fe5c96c45cbbae95f0c7c3d7206. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:03.873836 3398 tablet_bootstrap.cc:439] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb: Bootstrap starting. I0405 05:42:03.876790 3398 tablet_bootstrap.cc:590] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb: No blocks or log segments found. Creating new log. I0405 05:42:03.880270 3398 tablet_bootstrap.cc:439] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb: No bootstrap required, opened a new log I0405 05:42:03.880568 3398 ts_tablet_manager.cc:1053] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.002s I0405 05:42:03.882073 3398 raft_consensus.cc:340] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.882459 3398 raft_consensus.cc:366] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:03.882630 3398 raft_consensus.cc:705] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Initialized, Role: FOLLOWER I0405 05:42:03.882966 3398 consensus_queue.cc:229] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.883293 3398 raft_consensus.cc:380] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:03.883417 3398 raft_consensus.cc:472] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:03.883558 3398 raft_consensus.cc:2886] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:03.886761 3398 raft_consensus.cc:494] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.887171 3398 leader_election.cc:310] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f47cd09f5484f14b00848e4d0df5edb; no voters: I0405 05:42:03.887570 3398 leader_election.cc:296] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:03.887701 3400 raft_consensus.cc:2640] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:03.888147 3400 raft_consensus.cc:667] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 LEADER]: Becoming Leader. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Running, Role: LEADER I0405 05:42:03.888685 3398 ts_tablet_manager.cc:1081] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s I0405 05:42:03.888547 3400 consensus_queue.cc:206] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.892869 3215 catalog_manager.cc:3977] T 1a859fe5c96c45cbbae95f0c7c3d7206 P 1f47cd09f5484f14b00848e4d0df5edb reported cstate change: term changed from 0 to 1, leader changed from to 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1). New cstate: current_term: 1 leader_uuid: "1f47cd09f5484f14b00848e4d0df5edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } health_report { overall_health: HEALTHY } } } I0405 05:42:03.903687 3215 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51726: name: "a.b!" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:03.914010 3319 tablet_service.cc:1006] Processing CreateTablet for tablet 0268b7aba8e9463cb05c48be5d9d8952 (table=a.b! [id=b90f89546db44d6fadd6b3e8fb814577]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:03.914563 3319 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0268b7aba8e9463cb05c48be5d9d8952. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:03.922335 3398 tablet_bootstrap.cc:439] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb: Bootstrap starting. I0405 05:42:03.924652 3398 tablet_bootstrap.cc:590] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb: No blocks or log segments found. Creating new log. I0405 05:42:03.927605 3398 tablet_bootstrap.cc:439] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb: No bootstrap required, opened a new log I0405 05:42:03.927873 3398 ts_tablet_manager.cc:1053] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s I0405 05:42:03.929026 3398 raft_consensus.cc:340] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.929358 3398 raft_consensus.cc:366] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:03.929497 3398 raft_consensus.cc:705] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Initialized, Role: FOLLOWER I0405 05:42:03.929937 3398 consensus_queue.cc:229] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.930371 3398 raft_consensus.cc:380] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:03.930506 3398 raft_consensus.cc:472] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:03.930670 3398 raft_consensus.cc:2886] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:03.933689 3398 raft_consensus.cc:494] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.934211 3398 leader_election.cc:310] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f47cd09f5484f14b00848e4d0df5edb; no voters: I0405 05:42:03.934604 3398 leader_election.cc:296] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:03.934728 3400 raft_consensus.cc:2640] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:03.935055 3400 raft_consensus.cc:667] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 LEADER]: Becoming Leader. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Running, Role: LEADER I0405 05:42:03.935444 3398 ts_tablet_manager.cc:1081] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s I0405 05:42:03.935433 3400 consensus_queue.cc:206] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.939539 3215 catalog_manager.cc:3977] T 0268b7aba8e9463cb05c48be5d9d8952 P 1f47cd09f5484f14b00848e4d0df5edb reported cstate change: term changed from 0 to 1, leader changed from to 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1). New cstate: current_term: 1 leader_uuid: "1f47cd09f5484f14b00848e4d0df5edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } health_report { overall_health: HEALTHY } } } I0405 05:42:03.950078 3215 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51726: name: "A.B!" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:03.960249 3319 tablet_service.cc:1006] Processing CreateTablet for tablet 85d1fd8a04b34c63b83731a43406c3e2 (table=A.B! [id=6419ae1fd53c4574aa1796680da63b20]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:03.960889 3319 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 85d1fd8a04b34c63b83731a43406c3e2. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:03.968600 3398 tablet_bootstrap.cc:439] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb: Bootstrap starting. I0405 05:42:03.971210 3398 tablet_bootstrap.cc:590] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb: No blocks or log segments found. Creating new log. I0405 05:42:03.974058 3398 tablet_bootstrap.cc:439] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb: No bootstrap required, opened a new log I0405 05:42:03.974325 3398 ts_tablet_manager.cc:1053] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent bootstrapping tablet: real 0.006s user 0.001s sys 0.004s I0405 05:42:03.975567 3398 raft_consensus.cc:340] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.975905 3398 raft_consensus.cc:366] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:03.976054 3398 raft_consensus.cc:705] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Initialized, Role: FOLLOWER I0405 05:42:03.976349 3398 consensus_queue.cc:229] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.976671 3398 raft_consensus.cc:380] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:03.976796 3398 raft_consensus.cc:472] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:03.976944 3398 raft_consensus.cc:2886] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:03.979871 3398 raft_consensus.cc:494] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.980355 3398 leader_election.cc:310] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1f47cd09f5484f14b00848e4d0df5edb; no voters: I0405 05:42:03.980726 3398 leader_election.cc:296] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:03.980852 3400 raft_consensus.cc:2640] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:03.981194 3400 raft_consensus.cc:667] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [term 1 LEADER]: Becoming Leader. State: Replica: 1f47cd09f5484f14b00848e4d0df5edb, State: Running, Role: LEADER I0405 05:42:03.981674 3398 ts_tablet_manager.cc:1081] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s I0405 05:42:03.981561 3400 consensus_queue.cc:206] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } } I0405 05:42:03.985476 3215 catalog_manager.cc:3977] T 85d1fd8a04b34c63b83731a43406c3e2 P 1f47cd09f5484f14b00848e4d0df5edb reported cstate change: term changed from 0 to 1, leader changed from to 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1). New cstate: current_term: 1 leader_uuid: "1f47cd09f5484f14b00848e4d0df5edb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 33883 } health_report { overall_health: HEALTHY } } } I0405 05:42:06.550732 3215 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51732: table { table_name: "FOO.bar" } new_table_name: "foo.bar2" modify_external_catalogs: true I0405 05:42:06.575786 3452 tablet.cc:1269] T 34167c1783a54a0aabae8c84200108c3 P 1f47cd09f5484f14b00848e4d0df5edb: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0405 05:42:06.587666 3215 catalog_manager.cc:4423] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: foo.bar2 [id=da7cb7b87c234d45b5d9e60b9ee98de4] alter complete (version 1) W0405 05:42:06.726406 3201 debug-util.cc:397] Leaking SignalData structure 0x7b08000290a0 after lost signal to thread 3189 I0405 05:42:08.327495 3215 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:51734: table { table_name: "foo.BAR" } new_table_name: "foo.bar3" modify_external_catalogs: true I0405 05:42:08.341130 3473 tablet.cc:1269] T 2bf3cff34de740a78a567b70a7c744b8 P 1f47cd09f5484f14b00848e4d0df5edb: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0405 05:42:08.352619 3215 catalog_manager.cc:4423] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: foo.bar3 [id=7c4b983d0b8d465f9c80b05478b28a1a] alter complete (version 1) I0405 05:42:11.128908 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 3188 I0405 05:42:11.149930 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:36859 --webserver_interface=127.0.59.62 --webserver_port=35303 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:41253 --hive_metastore_sasl_enabled=false with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:42:11.309095 3487 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:42:11.309661 3487 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:42:11.321552 3487 flags.cc:406] Enabled experimental flag: --hive_metastore_sasl_enabled=false W0405 05:42:11.321703 3487 flags.cc:406] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:41253 W0405 05:42:11.321853 3487 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:42:11.321981 3487 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:42:11.322089 3487 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:42:11.322227 3487 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:42:11.339824 3487 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal --hive_metastore_uris=thrift://127.0.0.1:41253 --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:36859 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=35303 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:42:11.354368 3487 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 79516us I0405 05:42:11.355337 3487 fs_manager.cc:263] Metadata directory not provided I0405 05:42:11.355546 3487 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:42:11.362397 3487 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.006s sys 0.001s I0405 05:42:11.363090 3487 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:42:11.363653 3487 file_cache.cc:466] Constructed file cache lbm with capacity 419430 W0405 05:42:11.365833 3382 heartbeater.cc:587] Failed to heartbeat to 127.0.59.62:36859 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.0.59.62:36859: connect: Connection refused (error 111) I0405 05:42:11.371295 3487 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s I0405 05:42:11.371434 3487 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal uuid: "55c5b0b3a0b64545810b61836985798e" format_stamp: "Formatted at 2019-04-05 05:42:01 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:11.372855 3487 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:42:11.885365 3487 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:42:11.954813 3487 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:36859 I0405 05:42:11.957901 3487 webserver.cc:308] Webserver started at http://127.0.59.62:35303/ using document root and password file I0405 05:42:11.959143 3487 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:42:11.961300 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 3487 I0405 05:42:11.976313 3549 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: Bootstrap starting. I0405 05:42:12.020054 3549 log.cc:525] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: Log is configured to *not* fsync() on all Append() calls I0405 05:42:12.071831 3549 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: Bootstrap replayed 1/1 log segments. Stats: ops{read=33 overwritten=0 applied=33 ignored=0} inserts{seen=18 ignored=0} mutations{seen=22 ignored=0} orphaned_commits=0. Pending: 0 replicates I0405 05:42:12.072542 3549 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: Bootstrap complete. I0405 05:42:12.088191 3549 raft_consensus.cc:340] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } I0405 05:42:12.090188 3549 raft_consensus.cc:705] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 55c5b0b3a0b64545810b61836985798e, State: Initialized, Role: FOLLOWER I0405 05:42:12.090775 3549 consensus_queue.cc:229] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 33, Last appended: 1.33, Last appended by leader: 33, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } I0405 05:42:12.091145 3549 raft_consensus.cc:380] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:12.091327 3549 raft_consensus.cc:472] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:12.091533 3549 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 1 FOLLOWER]: Advancing to term 2 I0405 05:42:12.097575 3549 raft_consensus.cc:494] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } I0405 05:42:12.098084 3549 leader_election.cc:310] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 55c5b0b3a0b64545810b61836985798e; no voters: I0405 05:42:12.099794 3549 leader_election.cc:296] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [CANDIDATE]: Term 2 election: Requested vote from peers I0405 05:42:12.100062 3553 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 2 FOLLOWER]: Leader election won for term 2 I0405 05:42:12.188027 3553 raft_consensus.cc:667] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [term 2 LEADER]: Becoming Leader. State: Replica: 55c5b0b3a0b64545810b61836985798e, State: Running, Role: LEADER I0405 05:42:12.188900 3553 consensus_queue.cc:206] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 1.33, Last appended by leader: 33, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } I0405 05:42:12.192443 3549 sys_catalog.cc:337] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "55c5b0b3a0b64545810b61836985798e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } } I0405 05:42:12.193109 3549 sys_catalog.cc:340] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: This master's current role is: LEADER I0405 05:42:12.193151 3554 sys_catalog.cc:337] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 55c5b0b3a0b64545810b61836985798e. Latest consensus state: current_term: 2 leader_uuid: "55c5b0b3a0b64545810b61836985798e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } } I0405 05:42:12.193789 3554 sys_catalog.cc:340] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: This master's current role is: LEADER I0405 05:42:12.194697 3555 sys_catalog.cc:337] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "55c5b0b3a0b64545810b61836985798e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "55c5b0b3a0b64545810b61836985798e" member_type: VOTER } } I0405 05:42:12.195421 3555 sys_catalog.cc:340] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: This master's current role is: LEADER I0405 05:42:12.197167 3549 sys_catalog.cc:424] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e [sys.catalog]: configured and running, proceeding with master startup. I0405 05:42:12.197471 3558 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:42:12.208855 3558 catalog_manager.cc:354] Loaded metadata for table a.b [id=3a54afd54eb54a48a74c15e107a6a784] I0405 05:42:12.209373 3558 catalog_manager.cc:354] Loaded metadata for table A.B! [id=6419ae1fd53c4574aa1796680da63b20] I0405 05:42:12.209936 3558 catalog_manager.cc:354] Loaded metadata for table foo.bar [id=6a9dc5a1e5eb47e4b58b45e7c01918f4] I0405 05:42:12.210494 3558 catalog_manager.cc:354] Loaded metadata for table foo.bar3 [id=7c4b983d0b8d465f9c80b05478b28a1a] I0405 05:42:12.210906 3558 catalog_manager.cc:354] Loaded metadata for table a.b! [id=b90f89546db44d6fadd6b3e8fb814577] I0405 05:42:12.211349 3558 catalog_manager.cc:354] Loaded metadata for table foo.bar2 [id=da7cb7b87c234d45b5d9e60b9ee98de4] I0405 05:42:12.211884 3558 catalog_manager.cc:354] Loaded metadata for table FUZZ [id=e3f1c3e03d1f43b5b9f9bf2f6b0e4eb0] I0405 05:42:12.212476 3558 catalog_manager.cc:354] Loaded metadata for table fuzz [id=ef1fb4df187548fd92ede5a2d447adb8] I0405 05:42:12.219681 3558 catalog_manager.cc:408] Loaded metadata for tablet 0268b7aba8e9463cb05c48be5d9d8952 (table a.b! [id=b90f89546db44d6fadd6b3e8fb814577]) I0405 05:42:12.220227 3558 catalog_manager.cc:408] Loaded metadata for tablet 12b8e24237724b87b477d37b2d11af36 (table a.b [id=3a54afd54eb54a48a74c15e107a6a784]) I0405 05:42:12.222005 3558 catalog_manager.cc:408] Loaded metadata for tablet 1a859fe5c96c45cbbae95f0c7c3d7206 (table FUZZ [id=e3f1c3e03d1f43b5b9f9bf2f6b0e4eb0]) I0405 05:42:12.222522 3558 catalog_manager.cc:408] Loaded metadata for tablet 2bf3cff34de740a78a567b70a7c744b8 (table foo.bar3 [id=7c4b983d0b8d465f9c80b05478b28a1a]) I0405 05:42:12.223002 3558 catalog_manager.cc:408] Loaded metadata for tablet 34167c1783a54a0aabae8c84200108c3 (table foo.bar2 [id=da7cb7b87c234d45b5d9e60b9ee98de4]) I0405 05:42:12.223493 3558 catalog_manager.cc:408] Loaded metadata for tablet 85d1fd8a04b34c63b83731a43406c3e2 (table A.B! [id=6419ae1fd53c4574aa1796680da63b20]) I0405 05:42:12.223954 3558 catalog_manager.cc:408] Loaded metadata for tablet c8ca0c7520d94e03a129169e50615953 (table foo.bar [id=6a9dc5a1e5eb47e4b58b45e7c01918f4]) I0405 05:42:12.224402 3558 catalog_manager.cc:408] Loaded metadata for tablet d0d5e0410a684afab87e022bd3c88dc9 (table fuzz [id=ef1fb4df187548fd92ede5a2d447adb8]) I0405 05:42:12.224797 3558 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0405 05:42:12.241642 3558 catalog_manager.cc:1075] Loading token signing keys... I0405 05:42:12.244179 3558 catalog_manager.cc:4292] T 00000000000000000000000000000000 P 55c5b0b3a0b64545810b61836985798e: Loaded TSK: 0 I0405 05:42:12.253891 3561 hms_notification_log_listener.cc:228] Skipping Hive Metastore notification log poll: Service unavailable: Catalog manager is not initialized. State: Starting I0405 05:42:12.377377 3382 heartbeater.cc:345] Connected to a master server at 127.0.59.62:36859 I0405 05:42:12.381314 3516 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "1f47cd09f5484f14b00848e4d0df5edb" instance_seqno: 1554442923246233) as {username='slave'} at 127.0.59.1:52815; Asking this server to re-register. I0405 05:42:12.382400 3382 heartbeater.cc:426] Registering TS with master... I0405 05:42:12.382753 3382 heartbeater.cc:475] Master 127.0.59.62:36859 requested a full tablet report, sending... I0405 05:42:12.385617 3516 ts_manager.cc:159] Registered new tserver with Master: 1f47cd09f5484f14b00848e4d0df5edb (127.0.59.1:33883) I0405 05:42:12.388525 236 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0405 05:42:12.403254 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 3250 I0405 05:42:12.423733 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 3487 Shutting down hive metastore. [ OK ] ToolTest.TestHmsPrecheck (22234 ms) [ RUN ] ToolTest.TestDumpFSWithNonDefaultMetadataDir I0405 05:42:12.954772 236 fs_manager.cc:248] Data directories (fs_data_dirs) not provided I0405 05:42:12.954943 236 fs_manager.cc:249] Using write-ahead log directory (fs_wal_dir) as data directory I0405 05:42:12.956207 236 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554442812470121-236/test/wal/instance: uuid: "640a1e9af0b84bd7b814865a65088283" format_stamp: "Formatted at 2019-04-05 05:42:12 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:12.957154 236 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554442812470121-236/test/meta/instance: uuid: "640a1e9af0b84bd7b814865a65088283" format_stamp: "Formatted at 2019-04-05 05:42:12 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:12.966154 236 fs_manager.cc:503] Time spent creating directory manager: real 0.009s user 0.010s sys 0.001s I0405 05:42:12.967905 236 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:42:12.973951 236 fs_report.cc:352] FS layout report -------------------- wal directory: metadata directory: 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554442812470121-236/test/wal/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:42:12.974275 236 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.001s sys 0.000s I0405 05:42:12.974402 236 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554442812470121-236/test/wal,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554442812470121-236/test/meta uuid: "640a1e9af0b84bd7b814865a65088283" format_stamp: "Formatted at 2019-04-05 05:42:12 on dist-test-slave-dist-test-slave-bl6s" [ OK ] ToolTest.TestDumpFSWithNonDefaultMetadataDir (2479 ms) [----------] 13 tests from ToolTest (122920 ms total) [----------] 2 tests from ToolTestKerberosParameterized/ToolTestKerberosParameterized [ RUN ] ToolTestKerberosParameterized/ToolTestKerberosParameterized.TestHmsDowngrade/0 2019-04-05 05:42:16: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/derby.log log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvH0aH1/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvH0aH1/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Starting hive metastore on port 0 2603 T1 odu.Log4JLogger.info Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2614 T1 odu.Log4JLogger.info Property datanucleus.cache.level2 unknown - will be ignored I0405 05:42:26.097158 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:40923 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:43405 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:42:26.252496 3703 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:42:26.252948 3703 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:42:26.263687 3703 flags.cc:406] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:43405 W0405 05:42:26.263830 3703 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:42:26.263965 3703 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:42:26.264089 3703 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:42:26.264232 3703 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:42:26.281579 3703 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/wal --hive_metastore_uris=thrift://127.0.0.1:43405 --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:40923 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:42:26.295796 3703 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 87016us I0405 05:42:26.296766 3703 fs_manager.cc:263] Metadata directory not provided I0405 05:42:26.296937 3703 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:42:26.297235 3703 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:42:26.297353 3703 server_base.cc:434] Attempting to create new FS layout instead I0405 05:42:26.300420 3703 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "0e402f07ccde421b911681c8e6df45cc" format_stamp: "Formatted at 2019-04-05 05:42:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:26.301196 3703 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "0e402f07ccde421b911681c8e6df45cc" format_stamp: "Formatted at 2019-04-05 05:42:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:26.311738 3703 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.010s sys 0.003s I0405 05:42:26.313005 3703 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:42:26.313532 3703 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:42:26.320809 3703 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s I0405 05:42:26.321038 3703 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/wal uuid: "0e402f07ccde421b911681c8e6df45cc" format_stamp: "Formatted at 2019-04-05 05:42:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:26.321288 3703 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:42:26.952831 3703 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:42:27.007051 3703 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:40923 I0405 05:42:27.009362 3703 webserver.cc:308] Webserver started at http://127.0.59.62:34375/ using document root and password file I0405 05:42:27.010273 3703 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:42:27.011319 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 3703 I0405 05:42:27.012631 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.59.1:0 --local_ip_for_outbound_sockets=127.0.59.1 --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40923 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:42:27.013700 3764 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:27.043032 3764 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc: Bootstrap starting. I0405 05:42:27.050004 3764 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc: No blocks or log segments found. Creating new log. I0405 05:42:27.051439 3764 log.cc:525] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc: Log is configured to *not* fsync() on all Append() calls I0405 05:42:27.059339 3764 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc: No bootstrap required, opened a new log I0405 05:42:27.073428 3764 raft_consensus.cc:340] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e402f07ccde421b911681c8e6df45cc" member_type: VOTER } I0405 05:42:27.073842 3764 raft_consensus.cc:366] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:27.074043 3764 raft_consensus.cc:705] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e402f07ccde421b911681c8e6df45cc, State: Initialized, Role: FOLLOWER I0405 05:42:27.074581 3764 consensus_queue.cc:229] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e402f07ccde421b911681c8e6df45cc" member_type: VOTER } I0405 05:42:27.074975 3764 raft_consensus.cc:380] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:27.075155 3764 raft_consensus.cc:472] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:27.075361 3764 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:27.078491 3764 raft_consensus.cc:494] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e402f07ccde421b911681c8e6df45cc" member_type: VOTER } I0405 05:42:27.079003 3764 leader_election.cc:310] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0e402f07ccde421b911681c8e6df45cc; no voters: I0405 05:42:27.080771 3764 leader_election.cc:296] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:27.081121 3767 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:27.184077 3767 raft_consensus.cc:667] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [term 1 LEADER]: Becoming Leader. State: Replica: 0e402f07ccde421b911681c8e6df45cc, State: Running, Role: LEADER I0405 05:42:27.184649 3767 consensus_queue.cc:206] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e402f07ccde421b911681c8e6df45cc" member_type: VOTER } I0405 05:42:27.188726 3768 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0e402f07ccde421b911681c8e6df45cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e402f07ccde421b911681c8e6df45cc" member_type: VOTER } } I0405 05:42:27.188788 3769 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0e402f07ccde421b911681c8e6df45cc. Latest consensus state: current_term: 1 leader_uuid: "0e402f07ccde421b911681c8e6df45cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e402f07ccde421b911681c8e6df45cc" member_type: VOTER } } I0405 05:42:27.189613 3768 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [sys.catalog]: This master's current role is: LEADER I0405 05:42:27.189244 3764 sys_catalog.cc:337] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "0e402f07ccde421b911681c8e6df45cc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0e402f07ccde421b911681c8e6df45cc" member_type: VOTER } } I0405 05:42:27.189633 3769 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [sys.catalog]: This master's current role is: LEADER I0405 05:42:27.189918 3764 sys_catalog.cc:340] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [sys.catalog]: This master's current role is: LEADER I0405 05:42:27.193720 3764 sys_catalog.cc:424] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc [sys.catalog]: configured and running, proceeding with master startup. I0405 05:42:27.193756 3771 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:42:27.201117 3771 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:42:27.210237 3765 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:42:27.210767 3765 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:42:27.225880 3765 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:42:27.226455 3765 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.1 I0405 05:42:27.236680 3771 catalog_manager.cc:950] Generated new certificate authority record I0405 05:42:27.238833 3771 catalog_manager.cc:1075] Loading token signing keys... I0405 05:42:27.248095 3765 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:40923 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:42:27.251734 3771 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 0e402f07ccde421b911681c8e6df45cc: Generated new TSK 0 I0405 05:42:27.257599 3780 hms_notification_log_listener.cc:228] Skipping Hive Metastore notification log poll: Service unavailable: Catalog manager is not initialized. State: Starting I0405 05:42:27.273867 3765 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 87516us I0405 05:42:27.274598 3765 fs_manager.cc:263] Metadata directory not provided I0405 05:42:27.274786 3765 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:42:27.275183 3765 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:42:27.275352 3765 server_base.cc:434] Attempting to create new FS layout instead I0405 05:42:27.279932 3765 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" format_stamp: "Formatted at 2019-04-05 05:42:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:27.280972 3765 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" format_stamp: "Formatted at 2019-04-05 05:42:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:27.296998 3765 fs_manager.cc:503] Time spent creating directory manager: real 0.016s user 0.013s sys 0.000s I0405 05:42:27.298957 3765 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:42:27.299680 3765 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:42:27.310766 3765 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:42:27.310987 3765 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/wal uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" format_stamp: "Formatted at 2019-04-05 05:42:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:27.311339 3765 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:42:27.897539 3765 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.551s user 0.144s sys 0.362s W0405 05:42:27.897745 3765 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.551s user 0.144s sys 0.362s I0405 05:42:27.939113 3765 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:42:27.947795 3765 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:42:27.948256 3765 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:42:28.227550 3765 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:35315 I0405 05:42:28.242358 3765 webserver.cc:308] Webserver started at http://127.0.59.1:34171/ using document root and password file I0405 05:42:28.243237 3765 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:42:28.252876 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 3765 I0405 05:42:28.275210 3898 heartbeater.cc:345] Connected to a master server at 127.0.59.62:40923 I0405 05:42:28.275490 3898 heartbeater.cc:426] Registering TS with master... I0405 05:42:28.276082 3898 heartbeater.cc:475] Master 127.0.59.62:40923 requested a full tablet report, sending... I0405 05:42:28.278180 3731 ts_manager.cc:159] Registered new tserver with Master: c91cb7c7444046fb89c1e4c9c9fd523c (127.0.59.1:35315) I0405 05:42:28.279851 236 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0405 05:42:28.280791 3731 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.1:48819 I0405 05:42:28.488867 3731 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58152: name: "default.a" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:29.005434 3835 tablet_service.cc:1006] Processing CreateTablet for tablet 1688bb0a87a54418a4f3f2138936bb82 (table=default.a [id=a8446371f2a646589d9430b3aec192b5]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:29.006346 3835 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1688bb0a87a54418a4f3f2138936bb82. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:29.021492 3927 tablet_bootstrap.cc:439] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c: Bootstrap starting. I0405 05:42:29.024598 3927 tablet_bootstrap.cc:590] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c: No blocks or log segments found. Creating new log. I0405 05:42:29.025970 3927 log.cc:525] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c: Log is configured to *not* fsync() on all Append() calls I0405 05:42:29.028383 3927 tablet_bootstrap.cc:439] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c: No bootstrap required, opened a new log I0405 05:42:29.028693 3927 ts_tablet_manager.cc:1053] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c: Time spent bootstrapping tablet: real 0.008s user 0.002s sys 0.003s I0405 05:42:29.041182 3927 raft_consensus.cc:340] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35315 } } I0405 05:42:29.041671 3927 raft_consensus.cc:366] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:29.041851 3927 raft_consensus.cc:705] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c91cb7c7444046fb89c1e4c9c9fd523c, State: Initialized, Role: FOLLOWER I0405 05:42:29.042300 3927 consensus_queue.cc:229] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35315 } } I0405 05:42:29.042712 3927 raft_consensus.cc:380] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:29.042906 3927 raft_consensus.cc:472] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:29.043133 3927 raft_consensus.cc:2886] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:29.046257 3927 raft_consensus.cc:494] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35315 } } I0405 05:42:29.046700 3927 leader_election.cc:310] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c91cb7c7444046fb89c1e4c9c9fd523c; no voters: I0405 05:42:29.048339 3929 raft_consensus.cc:2640] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:29.049340 3927 leader_election.cc:296] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:29.051220 3898 heartbeater.cc:467] Master 127.0.59.62:40923 was elected leader, sending a full tablet report... I0405 05:42:29.051908 3927 ts_tablet_manager.cc:1081] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c: Time spent starting tablet: real 0.023s user 0.020s sys 0.002s I0405 05:42:29.051385 3929 raft_consensus.cc:667] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [term 1 LEADER]: Becoming Leader. State: Replica: c91cb7c7444046fb89c1e4c9c9fd523c, State: Running, Role: LEADER I0405 05:42:29.109015 3929 consensus_queue.cc:206] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35315 } } I0405 05:42:29.114262 3731 catalog_manager.cc:3977] T 1688bb0a87a54418a4f3f2138936bb82 P c91cb7c7444046fb89c1e4c9c9fd523c reported cstate change: term changed from 0 to 1, leader changed from to c91cb7c7444046fb89c1e4c9c9fd523c (127.0.59.1). New cstate: current_term: 1 leader_uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c91cb7c7444046fb89c1e4c9c9fd523c" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35315 } health_report { overall_health: HEALTHY } } } I0405 05:42:37.166564 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 3765 I0405 05:42:37.184144 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 3703 Shutting down hive metastore. [ OK ] ToolTestKerberosParameterized/ToolTestKerberosParameterized.TestHmsDowngrade/0 (22299 ms) [ RUN ] ToolTestKerberosParameterized/ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata/0 2019-04-05 05:42:38: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/derby.log log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvH0aH1/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-taskvH0aH1/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Starting hive metastore on port 0 2772 T1 odu.Log4JLogger.info Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2783 T1 odu.Log4JLogger.info Property datanucleus.cache.level2 unknown - will be ignored I0405 05:42:48.461087 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:37377 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:42:48.616901 4118 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:42:48.617357 4118 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:42:48.628159 4118 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:42:48.628315 4118 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:42:48.628448 4118 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:42:48.628578 4118 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:42:48.645442 4118 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:37377 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:42:48.659868 4118 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 98016us I0405 05:42:48.660830 4118 fs_manager.cc:263] Metadata directory not provided I0405 05:42:48.660985 4118 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:42:48.661286 4118 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:42:48.661399 4118 server_base.cc:434] Attempting to create new FS layout instead I0405 05:42:48.664511 4118 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "4af8078b9655499dae6f7fcf329372e0" format_stamp: "Formatted at 2019-04-05 05:42:48 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:48.665277 4118 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "4af8078b9655499dae6f7fcf329372e0" format_stamp: "Formatted at 2019-04-05 05:42:48 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:48.675554 4118 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.011s sys 0.001s I0405 05:42:48.676847 4118 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:42:48.677366 4118 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:42:48.684165 4118 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:42:48.684296 4118 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal uuid: "4af8078b9655499dae6f7fcf329372e0" format_stamp: "Formatted at 2019-04-05 05:42:48 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:48.684535 4118 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:42:49.195358 4118 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:42:49.261312 4118 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:37377 I0405 05:42:49.263954 4118 webserver.cc:308] Webserver started at http://127.0.59.62:37333/ using document root and password file I0405 05:42:49.264917 4118 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:42:49.268074 4179 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:49.275415 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 4118 I0405 05:42:49.276595 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.59.1:0 --local_ip_for_outbound_sockets=127.0.59.1 --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:37377 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:42:49.284186 4179 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: Bootstrap starting. I0405 05:42:49.291162 4179 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: No blocks or log segments found. Creating new log. I0405 05:42:49.292634 4179 log.cc:525] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: Log is configured to *not* fsync() on all Append() calls I0405 05:42:49.300096 4179 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: No bootstrap required, opened a new log I0405 05:42:49.320593 4179 raft_consensus.cc:340] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } I0405 05:42:49.321121 4179 raft_consensus.cc:366] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:49.321316 4179 raft_consensus.cc:705] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4af8078b9655499dae6f7fcf329372e0, State: Initialized, Role: FOLLOWER I0405 05:42:49.321983 4179 consensus_queue.cc:229] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } I0405 05:42:49.322609 4179 raft_consensus.cc:380] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:49.322844 4179 raft_consensus.cc:472] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:49.323113 4179 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:49.327677 4179 raft_consensus.cc:494] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } I0405 05:42:49.328320 4179 leader_election.cc:310] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4af8078b9655499dae6f7fcf329372e0; no voters: I0405 05:42:49.330591 4182 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:49.331907 4179 leader_election.cc:296] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:49.401677 4182 raft_consensus.cc:667] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 1 LEADER]: Becoming Leader. State: Replica: 4af8078b9655499dae6f7fcf329372e0, State: Running, Role: LEADER I0405 05:42:49.402341 4182 consensus_queue.cc:206] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } I0405 05:42:49.411664 4179 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "4af8078b9655499dae6f7fcf329372e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } } I0405 05:42:49.411792 4183 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4af8078b9655499dae6f7fcf329372e0. Latest consensus state: current_term: 1 leader_uuid: "4af8078b9655499dae6f7fcf329372e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } } I0405 05:42:49.412185 4179 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: This master's current role is: LEADER I0405 05:42:49.412421 4183 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: This master's current role is: LEADER I0405 05:42:49.411877 4184 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4af8078b9655499dae6f7fcf329372e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } } I0405 05:42:49.413161 4184 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: This master's current role is: LEADER I0405 05:42:49.416380 4179 sys_catalog.cc:424] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: configured and running, proceeding with master startup. I0405 05:42:49.416574 4187 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:42:49.421571 4187 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0405 05:42:49.454704 4187 catalog_manager.cc:950] Generated new certificate authority record I0405 05:42:49.456948 4187 catalog_manager.cc:1075] Loading token signing keys... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:42:49.473696 4180 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:42:49.474195 4180 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0405 05:42:49.477048 4187 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: Generated new TSK 0 W0405 05:42:49.484738 4180 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:42:49.485146 4180 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.1 I0405 05:42:49.509665 4180 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:37377 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:42:49.525921 4180 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 98516us I0405 05:42:49.526482 4180 fs_manager.cc:263] Metadata directory not provided I0405 05:42:49.526619 4180 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:42:49.526899 4180 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:42:49.527021 4180 server_base.cc:434] Attempting to create new FS layout instead I0405 05:42:49.530040 4180 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" format_stamp: "Formatted at 2019-04-05 05:42:49 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:49.530789 4180 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" format_stamp: "Formatted at 2019-04-05 05:42:49 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:49.551254 4180 fs_manager.cc:503] Time spent creating directory manager: real 0.020s user 0.008s sys 0.012s I0405 05:42:49.552587 4180 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:42:49.553169 4180 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:42:49.563182 4180 fs_manager.cc:419] Time spent opening block manager: real 0.005s user 0.004s sys 0.000s I0405 05:42:49.563344 4180 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/wal uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" format_stamp: "Formatted at 2019-04-05 05:42:49 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:49.563603 4180 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:42:50.119056 4180 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:42:50.123216 4180 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:42:50.123363 4180 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:42:50.490351 4180 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:35311 I0405 05:42:50.493062 4180 webserver.cc:308] Webserver started at http://127.0.59.1:39271/ using document root and password file I0405 05:42:50.493960 4180 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:42:50.498823 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 4180 I0405 05:42:50.536785 4311 heartbeater.cc:345] Connected to a master server at 127.0.59.62:37377 I0405 05:42:50.537087 4311 heartbeater.cc:426] Registering TS with master... I0405 05:42:50.537606 4311 heartbeater.cc:475] Master 127.0.59.62:37377 requested a full tablet report, sending... I0405 05:42:50.539415 4145 ts_manager.cc:159] Registered new tserver with Master: 4bc155b3b94b4d13a7ff6b5208f924b5 (127.0.59.1:35311) I0405 05:42:50.541277 236 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0405 05:42:50.541661 4145 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.1:51187 I0405 05:42:50.584694 4145 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57066: name: "default.duplicate_hms_tables" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:50.628944 4248 tablet_service.cc:1006] Processing CreateTablet for tablet 2ba79d8c7c004d4e9728ab6467de7c1a (table=default.duplicate_hms_tables [id=824d6a4622844c2c9d470d94977f21d8]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:50.630111 4248 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 2ba79d8c7c004d4e9728ab6467de7c1a. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:50.655031 4330 tablet_bootstrap.cc:439] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5: Bootstrap starting. I0405 05:42:50.658067 4330 tablet_bootstrap.cc:590] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5: No blocks or log segments found. Creating new log. I0405 05:42:50.659731 4330 log.cc:525] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5: Log is configured to *not* fsync() on all Append() calls I0405 05:42:50.663365 4330 tablet_bootstrap.cc:439] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5: No bootstrap required, opened a new log I0405 05:42:50.663713 4330 ts_tablet_manager.cc:1053] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s I0405 05:42:50.675990 4330 raft_consensus.cc:340] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:50.676489 4330 raft_consensus.cc:366] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:50.676666 4330 raft_consensus.cc:705] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Initialized, Role: FOLLOWER I0405 05:42:50.677134 4330 consensus_queue.cc:229] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:50.677527 4330 raft_consensus.cc:380] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:50.677711 4330 raft_consensus.cc:472] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:50.677928 4330 raft_consensus.cc:2886] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:50.680963 4330 raft_consensus.cc:494] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:50.681437 4330 leader_election.cc:310] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bc155b3b94b4d13a7ff6b5208f924b5; no voters: I0405 05:42:50.686341 4330 leader_election.cc:296] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:50.686621 4332 raft_consensus.cc:2640] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:50.771473 4311 heartbeater.cc:467] Master 127.0.59.62:37377 was elected leader, sending a full tablet report... I0405 05:42:50.772356 4332 raft_consensus.cc:667] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Running, Role: LEADER I0405 05:42:50.772758 4330 ts_tablet_manager.cc:1081] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent starting tablet: real 0.109s user 0.020s sys 0.006s I0405 05:42:50.773041 4332 consensus_queue.cc:206] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:50.779381 4145 catalog_manager.cc:3977] T 2ba79d8c7c004d4e9728ab6467de7c1a P 4bc155b3b94b4d13a7ff6b5208f924b5 reported cstate change: term changed from 0 to 1, leader changed from to 4bc155b3b94b4d13a7ff6b5208f924b5 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } health_report { overall_health: HEALTHY } } } I0405 05:42:51.632486 4145 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57066: name: "default.hive-incompatible-name" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:51.646003 4248 tablet_service.cc:1006] Processing CreateTablet for tablet 8dbb9b8842c0408a877a7f2005afb029 (table=default.hive-incompatible-name [id=0c2c0d4976cd4b048f3d34f277c6b471]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:51.646724 4248 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8dbb9b8842c0408a877a7f2005afb029. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:51.654525 4363 tablet_bootstrap.cc:439] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5: Bootstrap starting. I0405 05:42:51.656730 4363 tablet_bootstrap.cc:590] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5: No blocks or log segments found. Creating new log. I0405 05:42:51.659721 4363 tablet_bootstrap.cc:439] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5: No bootstrap required, opened a new log I0405 05:42:51.659981 4363 ts_tablet_manager.cc:1053] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s I0405 05:42:51.661403 4363 raft_consensus.cc:340] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.661887 4363 raft_consensus.cc:366] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:51.662106 4363 raft_consensus.cc:705] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Initialized, Role: FOLLOWER I0405 05:42:51.662523 4363 consensus_queue.cc:229] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.663007 4363 raft_consensus.cc:380] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:51.663174 4363 raft_consensus.cc:472] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:51.663369 4363 raft_consensus.cc:2886] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:51.667690 4363 raft_consensus.cc:494] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.668149 4363 leader_election.cc:310] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bc155b3b94b4d13a7ff6b5208f924b5; no voters: I0405 05:42:51.669333 4363 leader_election.cc:296] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:51.669606 4365 raft_consensus.cc:2640] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:51.671355 4365 raft_consensus.cc:667] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Running, Role: LEADER I0405 05:42:51.671614 4363 ts_tablet_manager.cc:1081] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent starting tablet: real 0.011s user 0.009s sys 0.003s I0405 05:42:51.671808 4365 consensus_queue.cc:206] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.675806 4145 catalog_manager.cc:3977] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5 reported cstate change: term changed from 0 to 1, leader changed from to 4bc155b3b94b4d13a7ff6b5208f924b5 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } health_report { overall_health: HEALTHY } } } I0405 05:42:51.683775 4146 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57066: name: "no_database" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:51.693289 4248 tablet_service.cc:1006] Processing CreateTablet for tablet 93070ff1ad7a496dbed55f5a6dba2854 (table=no_database [id=df24d5d4b1dd4b1aaf5dd9d71dbd5700]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:51.693840 4248 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 93070ff1ad7a496dbed55f5a6dba2854. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:51.701180 4363 tablet_bootstrap.cc:439] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5: Bootstrap starting. I0405 05:42:51.703418 4363 tablet_bootstrap.cc:590] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5: No blocks or log segments found. Creating new log. I0405 05:42:51.706773 4363 tablet_bootstrap.cc:439] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5: No bootstrap required, opened a new log I0405 05:42:51.707046 4363 ts_tablet_manager.cc:1053] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s I0405 05:42:51.708223 4363 raft_consensus.cc:340] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.708627 4363 raft_consensus.cc:366] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:51.708768 4363 raft_consensus.cc:705] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Initialized, Role: FOLLOWER I0405 05:42:51.709096 4363 consensus_queue.cc:229] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.709444 4363 raft_consensus.cc:380] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:51.709578 4363 raft_consensus.cc:472] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:51.709738 4363 raft_consensus.cc:2886] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:51.712570 4363 raft_consensus.cc:494] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.712960 4363 leader_election.cc:310] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bc155b3b94b4d13a7ff6b5208f924b5; no voters: I0405 05:42:51.713348 4363 leader_election.cc:296] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:51.713505 4365 raft_consensus.cc:2640] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:51.713939 4365 raft_consensus.cc:667] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Running, Role: LEADER I0405 05:42:51.714149 4363 ts_tablet_manager.cc:1081] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s I0405 05:42:51.714303 4365 consensus_queue.cc:206] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.717782 4146 catalog_manager.cc:3977] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5 reported cstate change: term changed from 0 to 1, leader changed from to 4bc155b3b94b4d13a7ff6b5208f924b5 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } health_report { overall_health: HEALTHY } } } I0405 05:42:51.724203 4145 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57066: name: "non_existent_database.table" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:51.733857 4248 tablet_service.cc:1006] Processing CreateTablet for tablet de7738d93c944c339074d70d24539970 (table=non_existent_database.table [id=af55143dd1fe43d1b68265bb7cf5a666]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:51.734408 4248 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet de7738d93c944c339074d70d24539970. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:51.741677 4363 tablet_bootstrap.cc:439] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5: Bootstrap starting. I0405 05:42:51.743980 4363 tablet_bootstrap.cc:590] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5: No blocks or log segments found. Creating new log. I0405 05:42:51.747216 4363 tablet_bootstrap.cc:439] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5: No bootstrap required, opened a new log I0405 05:42:51.747483 4363 ts_tablet_manager.cc:1053] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s I0405 05:42:51.748843 4363 raft_consensus.cc:340] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.749289 4363 raft_consensus.cc:366] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:51.749440 4363 raft_consensus.cc:705] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Initialized, Role: FOLLOWER I0405 05:42:51.749792 4363 consensus_queue.cc:229] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.750187 4363 raft_consensus.cc:380] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:51.750326 4363 raft_consensus.cc:472] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:51.750483 4363 raft_consensus.cc:2886] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:51.753378 4363 raft_consensus.cc:494] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.753902 4363 leader_election.cc:310] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bc155b3b94b4d13a7ff6b5208f924b5; no voters: I0405 05:42:51.754398 4363 leader_election.cc:296] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:51.754513 4365 raft_consensus.cc:2640] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:51.755101 4365 raft_consensus.cc:667] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Running, Role: LEADER I0405 05:42:51.755229 4363 ts_tablet_manager.cc:1081] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s I0405 05:42:51.755429 4365 consensus_queue.cc:206] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.760943 4145 catalog_manager.cc:3977] T de7738d93c944c339074d70d24539970 P 4bc155b3b94b4d13a7ff6b5208f924b5 reported cstate change: term changed from 0 to 1, leader changed from to 4bc155b3b94b4d13a7ff6b5208f924b5 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } health_report { overall_health: HEALTHY } } } I0405 05:42:51.823222 4145 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57066: name: "impala::default.conflicting_legacy_table" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:51.833884 4248 tablet_service.cc:1006] Processing CreateTablet for tablet 9e1b12f8139c4f858f6db72f0cdfdc65 (table=impala::default.conflicting_legacy_table [id=dc1d76d5685b472094cd964069dd4afd]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:51.834414 4248 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9e1b12f8139c4f858f6db72f0cdfdc65. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:51.841929 4363 tablet_bootstrap.cc:439] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5: Bootstrap starting. I0405 05:42:51.844311 4363 tablet_bootstrap.cc:590] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5: No blocks or log segments found. Creating new log. I0405 05:42:51.847199 4363 tablet_bootstrap.cc:439] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5: No bootstrap required, opened a new log I0405 05:42:51.847443 4363 ts_tablet_manager.cc:1053] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s I0405 05:42:51.848680 4363 raft_consensus.cc:340] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.849031 4363 raft_consensus.cc:366] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:51.849212 4363 raft_consensus.cc:705] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Initialized, Role: FOLLOWER I0405 05:42:51.849625 4363 consensus_queue.cc:229] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.850021 4363 raft_consensus.cc:380] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:51.850162 4363 raft_consensus.cc:472] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:51.850332 4363 raft_consensus.cc:2886] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:51.853350 4363 raft_consensus.cc:494] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.853852 4363 leader_election.cc:310] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bc155b3b94b4d13a7ff6b5208f924b5; no voters: I0405 05:42:51.854243 4363 leader_election.cc:296] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:51.854476 4367 raft_consensus.cc:2640] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:51.854931 4367 raft_consensus.cc:667] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Running, Role: LEADER I0405 05:42:51.855329 4363 ts_tablet_manager.cc:1081] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s I0405 05:42:51.855337 4367 consensus_queue.cc:206] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.863363 4145 catalog_manager.cc:3977] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5 reported cstate change: term changed from 0 to 1, leader changed from to 4bc155b3b94b4d13a7ff6b5208f924b5 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } health_report { overall_health: HEALTHY } } } I0405 05:42:51.870213 4146 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57066: name: "default.conflicting_legacy_table" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0405 05:42:51.879765 4248 tablet_service.cc:1006] Processing CreateTablet for tablet 9e9d495fd4b34a6b9b383b9ea3b80fee (table=default.conflicting_legacy_table [id=88a6afd04f4146c384a89232462074d4]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:42:51.880271 4248 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9e9d495fd4b34a6b9b383b9ea3b80fee. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:42:51.887079 4363 tablet_bootstrap.cc:439] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5: Bootstrap starting. I0405 05:42:51.889506 4363 tablet_bootstrap.cc:590] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5: No blocks or log segments found. Creating new log. I0405 05:42:51.893157 4363 tablet_bootstrap.cc:439] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5: No bootstrap required, opened a new log I0405 05:42:51.893553 4363 ts_tablet_manager.cc:1053] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.001s I0405 05:42:51.894843 4363 raft_consensus.cc:340] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.895200 4363 raft_consensus.cc:366] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:42:51.895318 4363 raft_consensus.cc:705] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Initialized, Role: FOLLOWER I0405 05:42:51.895624 4363 consensus_queue.cc:229] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.895961 4363 raft_consensus.cc:380] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:51.896082 4363 raft_consensus.cc:472] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:51.896275 4363 raft_consensus.cc:2886] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:42:51.899264 4363 raft_consensus.cc:494] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.899718 4363 leader_election.cc:310] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4bc155b3b94b4d13a7ff6b5208f924b5; no voters: I0405 05:42:51.900141 4363 leader_election.cc:296] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:42:51.900255 4365 raft_consensus.cc:2640] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:42:51.900600 4365 raft_consensus.cc:667] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [term 1 LEADER]: Becoming Leader. State: Replica: 4bc155b3b94b4d13a7ff6b5208f924b5, State: Running, Role: LEADER I0405 05:42:51.901003 4363 ts_tablet_manager.cc:1081] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s I0405 05:42:51.900991 4365 consensus_queue.cc:206] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } } I0405 05:42:51.905267 4146 catalog_manager.cc:3977] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5 reported cstate change: term changed from 0 to 1, leader changed from to 4bc155b3b94b4d13a7ff6b5208f924b5 (127.0.59.1). New cstate: current_term: 1 leader_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 35311 } health_report { overall_health: HEALTHY } } } I0405 05:42:51.914654 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 4118 I0405 05:42:51.934339 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:37377 --webserver_interface=127.0.59.62 --webserver_port=37333 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:34401 --hive_metastore_sasl_enabled=false with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:42:52.094704 4384 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:42:52.095165 4384 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:42:52.106215 4384 flags.cc:406] Enabled experimental flag: --hive_metastore_sasl_enabled=false W0405 05:42:52.106356 4384 flags.cc:406] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:34401 W0405 05:42:52.106454 4384 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:42:52.106545 4384 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:42:52.106647 4384 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:42:52.106765 4384 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:42:52.138353 4384 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal --hive_metastore_uris=thrift://127.0.0.1:34401 --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:37377 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=37333 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:42:52.161887 4384 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 100016us I0405 05:42:52.163138 4384 fs_manager.cc:263] Metadata directory not provided I0405 05:42:52.163355 4384 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:42:52.175487 4384 fs_manager.cc:399] Time spent opening directory manager: real 0.009s user 0.000s sys 0.008s I0405 05:42:52.176415 4384 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:42:52.177107 4384 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:42:52.185833 4384 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:42:52.185971 4384 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal uuid: "4af8078b9655499dae6f7fcf329372e0" format_stamp: "Formatted at 2019-04-05 05:42:48 on dist-test-slave-dist-test-slave-bl6s" I0405 05:42:52.187340 4384 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:42:52.733574 4384 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:42:52.800506 4384 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:37377 I0405 05:42:52.803329 4384 webserver.cc:308] Webserver started at http://127.0.59.62:37333/ using document root and password file I0405 05:42:52.804394 4384 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:42:52.809340 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 4384 I0405 05:42:52.821506 4445 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: Bootstrap starting. I0405 05:42:52.859858 4445 log.cc:525] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: Log is configured to *not* fsync() on all Append() calls I0405 05:42:52.894484 4445 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: Bootstrap replayed 1/1 log segments. Stats: ops{read=21 overwritten=0 applied=21 ignored=0} inserts{seen=14 ignored=0} mutations{seen=12 ignored=0} orphaned_commits=0. Pending: 0 replicates I0405 05:42:52.895279 4445 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: Bootstrap complete. I0405 05:42:52.909143 4445 raft_consensus.cc:340] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } I0405 05:42:52.911031 4445 raft_consensus.cc:705] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4af8078b9655499dae6f7fcf329372e0, State: Initialized, Role: FOLLOWER I0405 05:42:52.911624 4445 consensus_queue.cc:229] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 21, Last appended: 1.21, Last appended by leader: 21, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } I0405 05:42:52.912030 4445 raft_consensus.cc:380] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:42:52.912256 4445 raft_consensus.cc:472] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:42:52.912598 4445 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 1 FOLLOWER]: Advancing to term 2 I0405 05:42:52.919744 4445 raft_consensus.cc:494] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } I0405 05:42:52.920279 4445 leader_election.cc:310] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4af8078b9655499dae6f7fcf329372e0; no voters: I0405 05:42:52.922415 4445 leader_election.cc:296] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [CANDIDATE]: Term 2 election: Requested vote from peers W0405 05:42:52.925765 4311 heartbeater.cc:587] Failed to heartbeat to 127.0.59.62:37377 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting I0405 05:42:52.922722 4451 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 2 FOLLOWER]: Leader election won for term 2 I0405 05:42:53.018048 4451 raft_consensus.cc:667] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [term 2 LEADER]: Becoming Leader. State: Replica: 4af8078b9655499dae6f7fcf329372e0, State: Running, Role: LEADER I0405 05:42:53.018723 4451 consensus_queue.cc:206] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 21, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } I0405 05:42:53.022286 4445 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "4af8078b9655499dae6f7fcf329372e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } } I0405 05:42:53.022753 4445 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: This master's current role is: LEADER I0405 05:42:53.023759 4453 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "4af8078b9655499dae6f7fcf329372e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } } I0405 05:42:53.025465 4453 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: This master's current role is: LEADER I0405 05:42:53.027262 4445 sys_catalog.cc:424] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: configured and running, proceeding with master startup. I0405 05:42:53.027338 4456 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:42:53.027878 4452 sys_catalog.cc:337] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4af8078b9655499dae6f7fcf329372e0. Latest consensus state: current_term: 2 leader_uuid: "4af8078b9655499dae6f7fcf329372e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4af8078b9655499dae6f7fcf329372e0" member_type: VOTER } } I0405 05:42:53.028404 4452 sys_catalog.cc:340] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0 [sys.catalog]: This master's current role is: LEADER I0405 05:42:53.033991 4456 catalog_manager.cc:354] Loaded metadata for table default.hive-incompatible-name [id=0c2c0d4976cd4b048f3d34f277c6b471] I0405 05:42:53.034770 4456 catalog_manager.cc:354] Loaded metadata for table default.duplicate_hms_tables [id=824d6a4622844c2c9d470d94977f21d8] I0405 05:42:53.035410 4456 catalog_manager.cc:354] Loaded metadata for table default.conflicting_legacy_table [id=88a6afd04f4146c384a89232462074d4] I0405 05:42:53.036108 4456 catalog_manager.cc:354] Loaded metadata for table non_existent_database.table [id=af55143dd1fe43d1b68265bb7cf5a666] I0405 05:42:53.036726 4456 catalog_manager.cc:354] Loaded metadata for table impala::default.conflicting_legacy_table [id=dc1d76d5685b472094cd964069dd4afd] I0405 05:42:53.037389 4456 catalog_manager.cc:354] Loaded metadata for table no_database [id=df24d5d4b1dd4b1aaf5dd9d71dbd5700] I0405 05:42:53.041147 4456 catalog_manager.cc:408] Loaded metadata for tablet 2ba79d8c7c004d4e9728ab6467de7c1a (table default.duplicate_hms_tables [id=824d6a4622844c2c9d470d94977f21d8]) I0405 05:42:53.041939 4456 catalog_manager.cc:408] Loaded metadata for tablet 8dbb9b8842c0408a877a7f2005afb029 (table default.hive-incompatible-name [id=0c2c0d4976cd4b048f3d34f277c6b471]) I0405 05:42:53.042697 4456 catalog_manager.cc:408] Loaded metadata for tablet 93070ff1ad7a496dbed55f5a6dba2854 (table no_database [id=df24d5d4b1dd4b1aaf5dd9d71dbd5700]) I0405 05:42:53.043421 4456 catalog_manager.cc:408] Loaded metadata for tablet 9e1b12f8139c4f858f6db72f0cdfdc65 (table impala::default.conflicting_legacy_table [id=dc1d76d5685b472094cd964069dd4afd]) I0405 05:42:53.044121 4456 catalog_manager.cc:408] Loaded metadata for tablet 9e9d495fd4b34a6b9b383b9ea3b80fee (table default.conflicting_legacy_table [id=88a6afd04f4146c384a89232462074d4]) I0405 05:42:53.044852 4456 catalog_manager.cc:408] Loaded metadata for tablet de7738d93c944c339074d70d24539970 (table non_existent_database.table [id=af55143dd1fe43d1b68265bb7cf5a666]) I0405 05:42:53.045464 4456 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0405 05:42:53.051638 4456 catalog_manager.cc:1075] Loading token signing keys... I0405 05:42:53.054751 4456 catalog_manager.cc:4292] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: Loaded TSK: 0 I0405 05:42:53.059275 4459 hms_notification_log_listener.cc:228] Skipping Hive Metastore notification log poll: Service unavailable: Catalog manager is not initialized. State: Starting I0405 05:42:53.931004 4412 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "4bc155b3b94b4d13a7ff6b5208f924b5" instance_seqno: 1554442970411638) as {username='slave'} at 127.0.59.1:50551; Asking this server to re-register. I0405 05:42:53.932467 4311 heartbeater.cc:426] Registering TS with master... I0405 05:42:53.932888 4311 heartbeater.cc:475] Master 127.0.59.62:37377 requested a full tablet report, sending... I0405 05:42:53.935904 4412 ts_manager.cc:159] Registered new tserver with Master: 4bc155b3b94b4d13a7ff6b5208f924b5 (127.0.59.1:35311) I0405 05:42:53.937093 236 external_mini_cluster.cc:623] 1 TS(s) registered with all masters 05:42:57.006 [HMS - ERROR - pool-8-thread-4] (RetryingHMSHandler.java:204) AlreadyExistsException(message:Table conflicting_legacy_table already exists) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1452) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1539) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:148) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) at com.sun.proxy.$Proxy23.create_table_with_environment_context(Unknown Source) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:11191) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:11175) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:103) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 05:42:57.013 [HMS - ERROR - pool-8-thread-4] (RetryingHMSHandler.java:204) InvalidObjectException(message:non_existent_database) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1543) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:148) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) at com.sun.proxy.$Proxy23.create_table_with_environment_context(Unknown Source) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:11191) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:11175) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:103) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) I0405 05:42:57.300814 4412 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57080: table { table_name: "impala::default.conflicting_legacy_table" } new_table_name: "default.conflicting_legacy_table" modify_external_catalogs: false 23566 T27 odu.Log4JLogger.warn WARN Metadata has jdbc-type of null yet this is not valid. Ignored W0405 05:43:04.723230 4318 hms_client.cc:265] Time spent drop HMS table: real 4.437s user 0.000s sys 0.000s I0405 05:43:05.576139 4459 catalog_manager.cc:1944] Deleting table default.duplicate_hms_tables_2 [id=824d6a4622844c2c9d470d94977f21d8] in response to Hive Metastore notification log event 6 W0405 05:43:05.577642 4459 hms_notification_log_listener.cc:297] Failed to handle Hive Metastore notification: 6 DROP_TABLE default.duplicate_hms_tables_2: Not found: the table ID refers to a different table 'default.duplicate_hms_tables' than 'default.duplicate_hms_tables_2': table_id: "824d6a4622844c2c9d470d94977f21d8" table_name: "default.duplicate_hms_tables_2" I0405 05:43:05.589953 4412 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57090: table { table_name: "default.hive-incompatible-name" } new_table_name: "default.hive_compatible_name" modify_external_catalogs: false I0405 05:43:05.613358 4536 tablet.cc:1269] T 8dbb9b8842c0408a877a7f2005afb029 P 4bc155b3b94b4d13a7ff6b5208f924b5: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0405 05:43:05.625116 4412 catalog_manager.cc:4423] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: default.hive_compatible_name [id=0c2c0d4976cd4b048f3d34f277c6b471] alter complete (version 1) I0405 05:43:07.403749 4412 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57094: table { table_name: "no_database" } new_table_name: "default.with_database" modify_external_catalogs: false I0405 05:43:07.418886 4557 tablet.cc:1269] T 93070ff1ad7a496dbed55f5a6dba2854 P 4bc155b3b94b4d13a7ff6b5208f924b5: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0405 05:43:07.430490 4412 catalog_manager.cc:4423] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: default.with_database [id=df24d5d4b1dd4b1aaf5dd9d71dbd5700] alter complete (version 1) I0405 05:43:09.287515 4412 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57096: table { table_name: "default.conflicting_legacy_table" } new_table_name: "default.non_conflicting_legacy_table" modify_external_catalogs: false I0405 05:43:09.303608 4584 tablet.cc:1269] T 9e9d495fd4b34a6b9b383b9ea3b80fee P 4bc155b3b94b4d13a7ff6b5208f924b5: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0405 05:43:09.316826 4412 catalog_manager.cc:4423] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: default.non_conflicting_legacy_table [id=88a6afd04f4146c384a89232462074d4] alter complete (version 1) I0405 05:43:11.608937 4412 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:57098: table { table_name: "impala::default.conflicting_legacy_table" } new_table_name: "default.conflicting_legacy_table" modify_external_catalogs: false I0405 05:43:11.621454 4632 tablet.cc:1269] T 9e1b12f8139c4f858f6db72f0cdfdc65 P 4bc155b3b94b4d13a7ff6b5208f924b5: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0405 05:43:11.634239 4412 catalog_manager.cc:4423] T 00000000000000000000000000000000 P 4af8078b9655499dae6f7fcf329372e0: default.conflicting_legacy_table [id=dc1d76d5685b472094cd964069dd4afd] alter complete (version 1) I0405 05:43:14.820900 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 4180 I0405 05:43:14.840113 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 4384 Shutting down hive metastore. [ OK ] ToolTestKerberosParameterized/ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata/0 (37673 ms) [----------] 2 tests from ToolTestKerberosParameterized/ToolTestKerberosParameterized (59972 ms total) [----------] 1 test from CopyTableParameterized/ToolTestCopyTableParameterized [ RUN ] CopyTableParameterized/ToolTestCopyTableParameterized.TestCopyTable/2 I0405 05:43:15.404861 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:36931 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:15.586869 4656 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:15.587353 4656 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:15.598687 4656 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:43:15.598884 4656 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:15.598978 4656 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:43:15.599102 4656 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:43:15.617321 4656 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:36931 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:15.632474 4656 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 111516us I0405 05:43:15.633498 4656 fs_manager.cc:263] Metadata directory not provided I0405 05:43:15.633649 4656 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:15.633982 4656 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:15.634107 4656 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:15.637318 4656 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "604a3fb15ca04687abafce158c56004c" format_stamp: "Formatted at 2019-04-05 05:43:15 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:15.638131 4656 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "604a3fb15ca04687abafce158c56004c" format_stamp: "Formatted at 2019-04-05 05:43:15 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:15.650035 4656 fs_manager.cc:503] Time spent creating directory manager: real 0.012s user 0.010s sys 0.001s I0405 05:43:15.651474 4656 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:15.652045 4656 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:15.659498 4656 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:43:15.659642 4656 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/wal uuid: "604a3fb15ca04687abafce158c56004c" format_stamp: "Formatted at 2019-04-05 05:43:15 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:15.659909 4656 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:16.147625 4656 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:16.218370 4656 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:36931 I0405 05:43:16.221041 4656 webserver.cc:308] Webserver started at http://127.0.59.62:46579/ using document root and password file I0405 05:43:16.222013 4656 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:43:16.223902 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 4656 I0405 05:43:16.225205 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.59.1:0 --local_ip_for_outbound_sockets=127.0.59.1 --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:36931 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:43:16.226068 4717 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:16.254942 4717 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c: Bootstrap starting. I0405 05:43:16.262447 4717 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c: No blocks or log segments found. Creating new log. I0405 05:43:16.264186 4717 log.cc:525] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c: Log is configured to *not* fsync() on all Append() calls I0405 05:43:16.275822 4717 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c: No bootstrap required, opened a new log I0405 05:43:16.292073 4717 raft_consensus.cc:340] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604a3fb15ca04687abafce158c56004c" member_type: VOTER } I0405 05:43:16.292520 4717 raft_consensus.cc:366] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:16.292706 4717 raft_consensus.cc:705] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 604a3fb15ca04687abafce158c56004c, State: Initialized, Role: FOLLOWER I0405 05:43:16.293300 4717 consensus_queue.cc:229] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604a3fb15ca04687abafce158c56004c" member_type: VOTER } I0405 05:43:16.293736 4717 raft_consensus.cc:380] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:43:16.293967 4717 raft_consensus.cc:472] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:43:16.294170 4717 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:16.297760 4717 raft_consensus.cc:494] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604a3fb15ca04687abafce158c56004c" member_type: VOTER } I0405 05:43:16.298374 4717 leader_election.cc:310] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 604a3fb15ca04687abafce158c56004c; no voters: I0405 05:43:16.302237 4717 leader_election.cc:296] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:43:16.302584 4720 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:43:16.387495 4720 raft_consensus.cc:667] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [term 1 LEADER]: Becoming Leader. State: Replica: 604a3fb15ca04687abafce158c56004c, State: Running, Role: LEADER I0405 05:43:16.388082 4720 consensus_queue.cc:206] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604a3fb15ca04687abafce158c56004c" member_type: VOTER } I0405 05:43:16.391978 4717 sys_catalog.cc:337] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "604a3fb15ca04687abafce158c56004c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604a3fb15ca04687abafce158c56004c" member_type: VOTER } } I0405 05:43:16.392545 4717 sys_catalog.cc:340] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [sys.catalog]: This master's current role is: LEADER I0405 05:43:16.392267 4722 sys_catalog.cc:337] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 604a3fb15ca04687abafce158c56004c. Latest consensus state: current_term: 1 leader_uuid: "604a3fb15ca04687abafce158c56004c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604a3fb15ca04687abafce158c56004c" member_type: VOTER } } I0405 05:43:16.392904 4722 sys_catalog.cc:340] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [sys.catalog]: This master's current role is: LEADER I0405 05:43:16.393296 4721 sys_catalog.cc:337] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "604a3fb15ca04687abafce158c56004c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "604a3fb15ca04687abafce158c56004c" member_type: VOTER } } I0405 05:43:16.393950 4721 sys_catalog.cc:340] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [sys.catalog]: This master's current role is: LEADER I0405 05:43:16.400123 4717 sys_catalog.cc:424] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c [sys.catalog]: configured and running, proceeding with master startup. I0405 05:43:16.401023 4724 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:43:16.408356 4724 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:16.445298 4718 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:16.445832 4718 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:16.455596 4718 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:16.456041 4718 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.1 I0405 05:43:16.473057 4718 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:36931 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:16.479689 4724 catalog_manager.cc:950] Generated new certificate authority record I0405 05:43:16.481182 4724 catalog_manager.cc:1075] Loading token signing keys... I0405 05:43:16.491242 4718 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 112016us I0405 05:43:16.491865 4718 fs_manager.cc:263] Metadata directory not provided I0405 05:43:16.492002 4718 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:16.492302 4718 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:16.492422 4718 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:16.495945 4718 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "cbc453f8e03d4d5aa2af63d527f2493b" format_stamp: "Formatted at 2019-04-05 05:43:16 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:16.496788 4718 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "cbc453f8e03d4d5aa2af63d527f2493b" format_stamp: "Formatted at 2019-04-05 05:43:16 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:16.499208 4724 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c: Generated new TSK 0 I0405 05:43:16.511575 4718 fs_manager.cc:503] Time spent creating directory manager: real 0.014s user 0.008s sys 0.008s I0405 05:43:16.513073 4718 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:16.513748 4718 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:16.524000 4718 fs_manager.cc:419] Time spent opening block manager: real 0.005s user 0.000s sys 0.004s I0405 05:43:16.524163 4718 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/wal uuid: "cbc453f8e03d4d5aa2af63d527f2493b" format_stamp: "Formatted at 2019-04-05 05:43:16 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:16.524451 4718 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:17.095036 4718 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:17.099449 4718 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:43:17.099655 4718 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:43:17.478359 4718 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:36653 I0405 05:43:17.482311 4718 webserver.cc:308] Webserver started at http://127.0.59.1:42593/ using document root and password file I0405 05:43:17.483243 4718 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:43:17.485146 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 4718 I0405 05:43:17.521450 4849 heartbeater.cc:345] Connected to a master server at 127.0.59.62:36931 I0405 05:43:17.521862 4849 heartbeater.cc:426] Registering TS with master... I0405 05:43:17.522465 4849 heartbeater.cc:475] Master 127.0.59.62:36931 requested a full tablet report, sending... I0405 05:43:17.524379 4684 ts_manager.cc:159] Registered new tserver with Master: cbc453f8e03d4d5aa2af63d527f2493b (127.0.59.1:36653) I0405 05:43:17.526358 4684 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.1:38127 I0405 05:43:17.526669 236 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0405 05:43:17.529196 236 test_util.cc:212] Using random seed: -156173747 I0405 05:43:17.563026 4684 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51960: name: "ToolTestCopyTableParameterized" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:43:17.617951 4786 tablet_service.cc:1006] Processing CreateTablet for tablet d5d62cc7ea70461eb1be7803388a4460 (table=ToolTestCopyTableParameterized [id=04d34a80145549c29e4d3aa0d257ab21]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:43:17.618934 4786 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d5d62cc7ea70461eb1be7803388a4460. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:17.636095 4866 tablet_bootstrap.cc:439] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b: Bootstrap starting. I0405 05:43:17.639696 4866 tablet_bootstrap.cc:590] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b: No blocks or log segments found. Creating new log. I0405 05:43:17.641371 4866 log.cc:525] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b: Log is configured to *not* fsync() on all Append() calls I0405 05:43:17.644491 4866 tablet_bootstrap.cc:439] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b: No bootstrap required, opened a new log I0405 05:43:17.644899 4866 ts_tablet_manager.cc:1053] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.007s I0405 05:43:17.657793 4866 raft_consensus.cc:340] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } } I0405 05:43:17.658398 4866 raft_consensus.cc:366] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:17.658599 4866 raft_consensus.cc:705] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbc453f8e03d4d5aa2af63d527f2493b, State: Initialized, Role: FOLLOWER I0405 05:43:17.659118 4866 consensus_queue.cc:229] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } } I0405 05:43:17.659535 4866 raft_consensus.cc:380] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:43:17.659744 4866 raft_consensus.cc:472] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:43:17.659937 4866 raft_consensus.cc:2886] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:17.663427 4866 raft_consensus.cc:494] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } } I0405 05:43:17.664103 4866 leader_election.cc:310] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbc453f8e03d4d5aa2af63d527f2493b; no voters: I0405 05:43:17.666241 4868 raft_consensus.cc:2640] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:43:17.667624 4866 leader_election.cc:296] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:43:17.670401 4868 raft_consensus.cc:667] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [term 1 LEADER]: Becoming Leader. State: Replica: cbc453f8e03d4d5aa2af63d527f2493b, State: Running, Role: LEADER I0405 05:43:17.671463 4868 consensus_queue.cc:206] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } } I0405 05:43:17.673943 4866 ts_tablet_manager.cc:1081] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b: Time spent starting tablet: real 0.029s user 0.022s sys 0.002s I0405 05:43:17.670842 4849 heartbeater.cc:467] Master 127.0.59.62:36931 was elected leader, sending a full tablet report... I0405 05:43:17.741742 4684 catalog_manager.cc:3977] T d5d62cc7ea70461eb1be7803388a4460 P cbc453f8e03d4d5aa2af63d527f2493b reported cstate change: term changed from 0 to 1, leader changed from to cbc453f8e03d4d5aa2af63d527f2493b (127.0.59.1). New cstate: current_term: 1 leader_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } health_report { overall_health: HEALTHY } } } I0405 05:43:17.902205 236 test_util.cc:212] Using random seed: -155801114 I0405 05:43:17.921573 4681 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51966: name: "kudu.table.copy.to" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:43:17.932230 4786 tablet_service.cc:1006] Processing CreateTablet for tablet d774851af5274c219800865b17fb9ede (table=kudu.table.copy.to [id=ba06fbfcfddc4f11ac2fe5b193a45cab]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:43:17.932827 4786 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet d774851af5274c219800865b17fb9ede. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:17.939692 4866 tablet_bootstrap.cc:439] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b: Bootstrap starting. I0405 05:43:17.941987 4866 tablet_bootstrap.cc:590] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b: No blocks or log segments found. Creating new log. I0405 05:43:17.945458 4866 tablet_bootstrap.cc:439] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b: No bootstrap required, opened a new log I0405 05:43:17.945742 4866 ts_tablet_manager.cc:1053] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s I0405 05:43:17.946955 4866 raft_consensus.cc:340] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } } I0405 05:43:17.947283 4866 raft_consensus.cc:366] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:17.947479 4866 raft_consensus.cc:705] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cbc453f8e03d4d5aa2af63d527f2493b, State: Initialized, Role: FOLLOWER I0405 05:43:17.947935 4866 consensus_queue.cc:229] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } } I0405 05:43:17.948406 4866 raft_consensus.cc:380] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:43:17.948599 4866 raft_consensus.cc:472] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:43:17.948798 4866 raft_consensus.cc:2886] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:17.952052 4866 raft_consensus.cc:494] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } } I0405 05:43:17.952423 4866 leader_election.cc:310] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: cbc453f8e03d4d5aa2af63d527f2493b; no voters: I0405 05:43:17.952808 4866 leader_election.cc:296] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:43:17.952994 4868 raft_consensus.cc:2640] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:43:17.953336 4868 raft_consensus.cc:667] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 1 LEADER]: Becoming Leader. State: Replica: cbc453f8e03d4d5aa2af63d527f2493b, State: Running, Role: LEADER I0405 05:43:17.953642 4866 ts_tablet_manager.cc:1081] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s I0405 05:43:17.953742 4868 consensus_queue.cc:206] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } } I0405 05:43:17.958017 4682 catalog_manager.cc:3977] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b reported cstate change: term changed from 0 to 1, leader changed from to cbc453f8e03d4d5aa2af63d527f2493b (127.0.59.1). New cstate: current_term: 1 leader_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "cbc453f8e03d4d5aa2af63d527f2493b" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 36653 } health_report { overall_health: HEALTHY } } } I0405 05:43:24.240389 4677 catalog_manager.cc:1890] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:51966: table { table_name: "kudu.table.copy.to" } modify_external_catalogs: true I0405 05:43:24.248574 4677 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 604a3fb15ca04687abafce158c56004c: Sending DeleteTablet for 1 replicas of tablet d774851af5274c219800865b17fb9ede I0405 05:43:24.248886 4677 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet d774851af5274c219800865b17fb9ede on cbc453f8e03d4d5aa2af63d527f2493b (127.0.59.1:36653) (Table deleted at 2019-04-05 05:43:24 UTC) I0405 05:43:24.250114 4786 tablet_service.cc:1047] Processing DeleteTablet for tablet d774851af5274c219800865b17fb9ede with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-05 05:43:24 UTC) from {username='slave'} at 127.0.0.1:46292 I0405 05:43:24.252741 4946 tablet_replica.cc:264] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b: stopping tablet replica I0405 05:43:24.253193 4946 raft_consensus.cc:2143] T d774851af5274c219800865b17fb9ede P cbc453f8e03d4d5aa2af63d527f2493b [term 1 LEADER]: Raft consensus shutting down. I0405 05:43:24.252703 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 4718 W0405 05:43:24.278954 4664 catalog_manager.cc:3121] TS cbc453f8e03d4d5aa2af63d527f2493b (127.0.59.1:36653): Delete Tablet RPC failed for tablet d774851af5274c219800865b17fb9ede: Network error: recv got EOF from 127.0.59.1:36653 (error 108) I0405 05:43:24.279278 4664 catalog_manager.cc:3157] Scheduling retry of d774851af5274c219800865b17fb9ede Delete Tablet RPC for TS=cbc453f8e03d4d5aa2af63d527f2493b with a delay of 32 ms (attempt = 1) I0405 05:43:24.290455 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 4656 [ OK ] CopyTableParameterized/ToolTestCopyTableParameterized.TestCopyTable/2 (8925 ms) [----------] 1 test from CopyTableParameterized/ToolTestCopyTableParameterized (8925 ms total) [----------] 1 test from SerializationModes/ControlShellToolTest [ RUN ] SerializationModes/ControlShellToolTest.TestControlShell/0 I0405 05:43:24.554150 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.4.212.254:39447 --webserver_interface=127.4.212.254 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:24.700610 4954 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:24.701092 4954 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:24.712409 4954 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:43:24.712577 4954 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:24.712705 4954 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:43:24.712847 4954 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:43:24.730327 4954 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.4.212.254:39447 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.4.212.254 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:24.745494 4954 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 116016us I0405 05:43:24.746515 4954 fs_manager.cc:263] Metadata directory not provided I0405 05:43:24.746659 4954 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:24.746956 4954 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:24.747068 4954 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:24.750160 4954 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "3c97231598334592ab82ec88e885726d" format_stamp: "Formatted at 2019-04-05 05:43:24 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:24.750910 4954 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "3c97231598334592ab82ec88e885726d" format_stamp: "Formatted at 2019-04-05 05:43:24 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:24.760993 4954 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s I0405 05:43:24.762356 4954 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:24.762861 4954 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:24.770009 4954 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:43:24.770133 4954 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal uuid: "3c97231598334592ab82ec88e885726d" format_stamp: "Formatted at 2019-04-05 05:43:24 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:24.770390 4954 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:43:25.313822 4954 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.519s user 0.080s sys 0.436s W0405 05:43:25.314041 4954 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.519s user 0.080s sys 0.436s I0405 05:43:25.347301 4954 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:25.412227 4954 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.254:39447 I0405 05:43:25.414590 4954 webserver.cc:308] Webserver started at http://127.4.212.254:36139/ using document root and password file I0405 05:43:25.415489 4954 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:43:25.418614 5015 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:25.425209 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 4954 I0405 05:43:25.426695 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.4.212.193:0 --local_ip_for_outbound_sockets=127.4.212.193 --webserver_interface=127.4.212.193 --webserver_port=0 --tserver_master_addrs=127.4.212.254:39447 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:43:25.440793 5015 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Bootstrap starting. I0405 05:43:25.447698 5015 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: No blocks or log segments found. Creating new log. I0405 05:43:25.449115 5015 log.cc:525] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Log is configured to *not* fsync() on all Append() calls I0405 05:43:25.459870 5015 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: No bootstrap required, opened a new log I0405 05:43:25.480468 5015 raft_consensus.cc:340] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } I0405 05:43:25.481000 5015 raft_consensus.cc:366] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:25.481353 5015 raft_consensus.cc:705] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c97231598334592ab82ec88e885726d, State: Initialized, Role: FOLLOWER I0405 05:43:25.482173 5015 consensus_queue.cc:229] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } I0405 05:43:25.482678 5015 raft_consensus.cc:380] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:43:25.482908 5015 raft_consensus.cc:472] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:43:25.483166 5015 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:25.487752 5015 raft_consensus.cc:494] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } I0405 05:43:25.488418 5015 leader_election.cc:310] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c97231598334592ab82ec88e885726d; no voters: I0405 05:43:25.490814 5018 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:43:25.492159 5015 leader_election.cc:296] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:43:25.563848 5018 raft_consensus.cc:667] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 1 LEADER]: Becoming Leader. State: Replica: 3c97231598334592ab82ec88e885726d, State: Running, Role: LEADER I0405 05:43:25.564497 5018 consensus_queue.cc:206] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } I0405 05:43:25.571617 5015 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "3c97231598334592ab82ec88e885726d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } } I0405 05:43:25.571635 5019 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c97231598334592ab82ec88e885726d. Latest consensus state: current_term: 1 leader_uuid: "3c97231598334592ab82ec88e885726d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } } I0405 05:43:25.572051 5015 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: This master's current role is: LEADER I0405 05:43:25.572166 5019 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: This master's current role is: LEADER I0405 05:43:25.573074 5020 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3c97231598334592ab82ec88e885726d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } } I0405 05:43:25.573662 5020 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: This master's current role is: LEADER I0405 05:43:25.578801 5015 sys_catalog.cc:424] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: configured and running, proceeding with master startup. I0405 05:43:25.580516 5022 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:43:25.588341 5022 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:25.613315 5016 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:25.614428 5016 flags.cc:406] Enabled unsafe flag: --never_fsync=true I0405 05:43:25.616225 5022 catalog_manager.cc:950] Generated new certificate authority record I0405 05:43:25.617678 5022 catalog_manager.cc:1075] Loading token signing keys... I0405 05:43:25.627225 5022 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Generated new TSK 0 W0405 05:43:25.630445 5016 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:25.631036 5016 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.212.193 I0405 05:43:25.668879 5016 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.4.212.193:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.4.212.193 --webserver_port=0 --tserver_master_addrs=127.4.212.254:39447 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.4.212.193 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:25.695277 5016 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 116516us I0405 05:43:25.696023 5016 fs_manager.cc:263] Metadata directory not provided I0405 05:43:25.696204 5016 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:25.696570 5016 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:25.696741 5016 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:25.701324 5016 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "a9b170577d0e4912a7153f1c6ba7159e" format_stamp: "Formatted at 2019-04-05 05:43:25 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:25.702431 5016 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "a9b170577d0e4912a7153f1c6ba7159e" format_stamp: "Formatted at 2019-04-05 05:43:25 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:25.717610 5016 fs_manager.cc:503] Time spent creating directory manager: real 0.015s user 0.014s sys 0.001s I0405 05:43:25.719554 5016 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:25.720296 5016 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:25.731295 5016 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:43:25.731474 5016 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal uuid: "a9b170577d0e4912a7153f1c6ba7159e" format_stamp: "Formatted at 2019-04-05 05:43:25 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:25.731817 5016 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:43:26.275673 5016 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.512s user 0.079s sys 0.392s W0405 05:43:26.275985 5016 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.512s user 0.079s sys 0.392s I0405 05:43:26.333112 5016 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:26.336640 5016 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:43:26.336794 5016 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:43:26.674443 5016 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.193:42999 I0405 05:43:26.678468 5016 webserver.cc:308] Webserver started at http://127.4.212.193:46467/ using document root and password file I0405 05:43:26.679574 5016 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:43:26.680688 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 5016 I0405 05:43:26.681612 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.4.212.194:0 --local_ip_for_outbound_sockets=127.4.212.194 --webserver_interface=127.4.212.194 --webserver_port=0 --tserver_master_addrs=127.4.212.254:39447 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:43:26.722894 5147 heartbeater.cc:345] Connected to a master server at 127.4.212.254:39447 I0405 05:43:26.723183 5147 heartbeater.cc:426] Registering TS with master... I0405 05:43:26.723729 5147 heartbeater.cc:475] Master 127.4.212.254:39447 requested a full tablet report, sending... I0405 05:43:26.727304 4982 ts_manager.cc:159] Registered new tserver with Master: a9b170577d0e4912a7153f1c6ba7159e (127.4.212.193:42999) I0405 05:43:26.729220 4982 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.4.212.193:49243 WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:26.889214 5150 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:26.889801 5150 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:26.905562 5150 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:26.906220 5150 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.212.194 I0405 05:43:26.929070 5150 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.4.212.194:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb --webserver_interface=127.4.212.194 --webserver_port=0 --tserver_master_addrs=127.4.212.254:39447 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.4.212.194 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:26.954917 5150 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 117016us I0405 05:43:26.955631 5150 fs_manager.cc:263] Metadata directory not provided I0405 05:43:26.955818 5150 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:26.956187 5150 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:26.956349 5150 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:26.960714 5150 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/instance: uuid: "f28b75d4df344cd19ab34804be9b9d63" format_stamp: "Formatted at 2019-04-05 05:43:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:26.961764 5150 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal/instance: uuid: "f28b75d4df344cd19ab34804be9b9d63" format_stamp: "Formatted at 2019-04-05 05:43:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:26.988808 5150 fs_manager.cc:503] Time spent creating directory manager: real 0.027s user 0.014s sys 0.012s I0405 05:43:26.990851 5150 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:26.991596 5150 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:27.003305 5150 fs_manager.cc:419] Time spent opening block manager: real 0.003s user 0.000s sys 0.003s I0405 05:43:27.003499 5150 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal uuid: "f28b75d4df344cd19ab34804be9b9d63" format_stamp: "Formatted at 2019-04-05 05:43:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:27.003859 5150 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:27.534683 5150 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:27.538184 5150 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:43:27.538317 5150 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:43:27.663432 5150 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.194:39023 I0405 05:43:27.667763 5150 webserver.cc:308] Webserver started at http://127.4.212.194:43895/ using document root and password file I0405 05:43:27.670320 5150 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb I0405 05:43:27.678820 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 5150 I0405 05:43:27.679823 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.4.212.195:0 --local_ip_for_outbound_sockets=127.4.212.195 --webserver_interface=127.4.212.195 --webserver_port=0 --tserver_master_addrs=127.4.212.254:39447 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:43:27.692054 5272 heartbeater.cc:345] Connected to a master server at 127.4.212.254:39447 I0405 05:43:27.692409 5272 heartbeater.cc:426] Registering TS with master... I0405 05:43:27.693092 5272 heartbeater.cc:475] Master 127.4.212.254:39447 requested a full tablet report, sending... I0405 05:43:27.694649 4982 ts_manager.cc:159] Registered new tserver with Master: f28b75d4df344cd19ab34804be9b9d63 (127.4.212.194:39023) I0405 05:43:27.695945 4982 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.4.212.194:51639 I0405 05:43:27.731739 5147 heartbeater.cc:467] Master 127.4.212.254:39447 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:27.811646 5276 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:27.812084 5276 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:27.821468 5276 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:27.821885 5276 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.212.195 I0405 05:43:27.837246 5276 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.4.212.195:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb --webserver_interface=127.4.212.195 --webserver_port=0 --tserver_master_addrs=127.4.212.254:39447 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.4.212.195 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:27.855072 5276 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 117516us I0405 05:43:27.855599 5276 fs_manager.cc:263] Metadata directory not provided I0405 05:43:27.855741 5276 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:27.856127 5276 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:27.856245 5276 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:27.859607 5276 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/instance: uuid: "f680039782c94dec8973193a9551a58a" format_stamp: "Formatted at 2019-04-05 05:43:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:27.860438 5276 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal/instance: uuid: "f680039782c94dec8973193a9551a58a" format_stamp: "Formatted at 2019-04-05 05:43:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:27.871163 5276 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.009s sys 0.003s I0405 05:43:27.872500 5276 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:27.873142 5276 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:27.880162 5276 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:43:27.880287 5276 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal uuid: "f680039782c94dec8973193a9551a58a" format_stamp: "Formatted at 2019-04-05 05:43:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:27.880492 5276 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:28.392138 5276 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:28.395743 5276 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:43:28.395884 5276 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:43:28.524524 5276 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.195:38171 I0405 05:43:28.527010 5276 webserver.cc:308] Webserver started at http://127.4.212.195:46465/ using document root and password file I0405 05:43:28.527845 5276 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb I0405 05:43:28.531811 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 5276 I0405 05:43:28.558634 5397 heartbeater.cc:345] Connected to a master server at 127.4.212.254:39447 I0405 05:43:28.558984 5397 heartbeater.cc:426] Registering TS with master... I0405 05:43:28.559693 5397 heartbeater.cc:475] Master 127.4.212.254:39447 requested a full tablet report, sending... I0405 05:43:28.561375 4982 ts_manager.cc:159] Registered new tserver with Master: f680039782c94dec8973193a9551a58a (127.4.212.195:38171) I0405 05:43:28.563026 4982 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.4.212.195:42409 I0405 05:43:28.567780 4947 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0405 05:43:28.585342 4982 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44860: name: "test" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } W0405 05:43:28.595057 4982 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0405 05:43:28.627411 5334 tablet_service.cc:1006] Processing CreateTablet for tablet ed1b5efee9d944d9be9ba3f1f91153d0 (table=test [id=a5fd86641bfd49bb956371b449cc4999]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:43:28.628052 5209 tablet_service.cc:1006] Processing CreateTablet for tablet ed1b5efee9d944d9be9ba3f1f91153d0 (table=test [id=a5fd86641bfd49bb956371b449cc4999]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:43:28.628496 5334 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ed1b5efee9d944d9be9ba3f1f91153d0. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:28.628999 5209 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ed1b5efee9d944d9be9ba3f1f91153d0. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:28.630017 5084 tablet_service.cc:1006] Processing CreateTablet for tablet ed1b5efee9d944d9be9ba3f1f91153d0 (table=test [id=a5fd86641bfd49bb956371b449cc4999]), partition=RANGE (foo) PARTITION UNBOUNDED I0405 05:43:28.630800 5084 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ed1b5efee9d944d9be9ba3f1f91153d0. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:28.647994 5418 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Bootstrap starting. I0405 05:43:28.651094 5420 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Bootstrap starting. I0405 05:43:28.651726 5419 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Bootstrap starting. I0405 05:43:28.654865 5420 tablet_bootstrap.cc:590] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: No blocks or log segments found. Creating new log. I0405 05:43:28.654980 5418 tablet_bootstrap.cc:590] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: No blocks or log segments found. Creating new log. I0405 05:43:28.656756 5418 log.cc:525] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Log is configured to *not* fsync() on all Append() calls I0405 05:43:28.656756 5420 log.cc:525] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Log is configured to *not* fsync() on all Append() calls I0405 05:43:28.658565 5419 tablet_bootstrap.cc:590] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: No blocks or log segments found. Creating new log. I0405 05:43:28.660241 5419 log.cc:525] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Log is configured to *not* fsync() on all Append() calls I0405 05:43:28.663476 5420 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: No bootstrap required, opened a new log I0405 05:43:28.663914 5420 ts_tablet_manager.cc:1053] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Time spent bootstrapping tablet: real 0.013s user 0.000s sys 0.012s I0405 05:43:28.664311 5418 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: No bootstrap required, opened a new log I0405 05:43:28.664714 5418 ts_tablet_manager.cc:1053] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Time spent bootstrapping tablet: real 0.017s user 0.004s sys 0.003s I0405 05:43:28.667831 5419 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: No bootstrap required, opened a new log I0405 05:43:28.668289 5419 ts_tablet_manager.cc:1053] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.004s I0405 05:43:28.677712 5420 raft_consensus.cc:340] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.678383 5420 raft_consensus.cc:366] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:28.678568 5420 raft_consensus.cc:705] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f680039782c94dec8973193a9551a58a, State: Initialized, Role: FOLLOWER I0405 05:43:28.679085 5420 consensus_queue.cc:229] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.682257 5418 raft_consensus.cc:340] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.683177 5418 raft_consensus.cc:366] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:28.683416 5418 raft_consensus.cc:705] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b170577d0e4912a7153f1c6ba7159e, State: Initialized, Role: FOLLOWER I0405 05:43:28.683586 5397 heartbeater.cc:467] Master 127.4.212.254:39447 was elected leader, sending a full tablet report... I0405 05:43:28.684084 5418 consensus_queue.cc:229] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.684862 5420 ts_tablet_manager.cc:1081] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Time spent starting tablet: real 0.021s user 0.017s sys 0.002s I0405 05:43:28.686390 5419 raft_consensus.cc:340] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.687238 5419 raft_consensus.cc:366] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:28.687464 5419 raft_consensus.cc:705] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f28b75d4df344cd19ab34804be9b9d63, State: Initialized, Role: FOLLOWER I0405 05:43:28.688097 5419 consensus_queue.cc:229] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.688892 5418 ts_tablet_manager.cc:1081] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Time spent starting tablet: real 0.024s user 0.019s sys 0.004s I0405 05:43:28.690740 5425 raft_consensus.cc:472] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0405 05:43:28.691092 5425 raft_consensus.cc:494] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.694300 5272 heartbeater.cc:467] Master 127.4.212.254:39447 was elected leader, sending a full tablet report... I0405 05:43:28.697454 5419 ts_tablet_manager.cc:1081] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Time spent starting tablet: real 0.029s user 0.020s sys 0.002s I0405 05:43:28.700167 5425 leader_election.cc:296] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f680039782c94dec8973193a9551a58a (127.4.212.195:38171), f28b75d4df344cd19ab34804be9b9d63 (127.4.212.194:39023) I0405 05:43:28.703032 5354 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "a9b170577d0e4912a7153f1c6ba7159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f680039782c94dec8973193a9551a58a" is_pre_election: true I0405 05:43:28.703680 5354 raft_consensus.cc:2346] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b170577d0e4912a7153f1c6ba7159e in term 0. I0405 05:43:28.704151 5229 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "a9b170577d0e4912a7153f1c6ba7159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f28b75d4df344cd19ab34804be9b9d63" is_pre_election: true I0405 05:43:28.704782 5229 raft_consensus.cc:2346] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b170577d0e4912a7153f1c6ba7159e in term 0. I0405 05:43:28.704596 5038 leader_election.cc:310] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b170577d0e4912a7153f1c6ba7159e, f680039782c94dec8973193a9551a58a; no voters: W0405 05:43:28.766455 5038 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.212.195:38171, user_credentials={real_user=slave}} blocked reactor thread for 62015.8us I0405 05:43:28.766564 5425 raft_consensus.cc:2640] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 0 FOLLOWER]: Leader pre-election won for term 1 W0405 05:43:28.766793 5035 outbound_call.cc:287] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.212.194:39023, user_credentials={real_user=slave}} blocked reactor thread for 61112us I0405 05:43:28.766921 5425 raft_consensus.cc:472] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0405 05:43:28.767134 5425 raft_consensus.cc:2886] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:28.770507 5425 raft_consensus.cc:494] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.771677 5425 leader_election.cc:296] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 1 election: Requested vote from peers f680039782c94dec8973193a9551a58a (127.4.212.195:38171), f28b75d4df344cd19ab34804be9b9d63 (127.4.212.194:39023) I0405 05:43:28.772342 5354 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "a9b170577d0e4912a7153f1c6ba7159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f680039782c94dec8973193a9551a58a" I0405 05:43:28.772455 5229 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "a9b170577d0e4912a7153f1c6ba7159e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f28b75d4df344cd19ab34804be9b9d63" I0405 05:43:28.772723 5354 raft_consensus.cc:2886] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:28.772855 5229 raft_consensus.cc:2886] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:28.776634 5354 raft_consensus.cc:2346] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b170577d0e4912a7153f1c6ba7159e in term 1. I0405 05:43:28.776774 5229 raft_consensus.cc:2346] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b170577d0e4912a7153f1c6ba7159e in term 1. I0405 05:43:28.777318 5038 leader_election.cc:310] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a9b170577d0e4912a7153f1c6ba7159e, f680039782c94dec8973193a9551a58a; no voters: I0405 05:43:28.777860 5425 raft_consensus.cc:2640] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:43:28.779161 5425 raft_consensus.cc:667] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 1 LEADER]: Becoming Leader. State: Replica: a9b170577d0e4912a7153f1c6ba7159e, State: Running, Role: LEADER I0405 05:43:28.779608 5425 consensus_queue.cc:206] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:28.784915 4982 catalog_manager.cc:3977] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e reported cstate change: term changed from 0 to 1, leader changed from to a9b170577d0e4912a7153f1c6ba7159e (127.4.212.193). New cstate: current_term: 1 leader_uuid: "a9b170577d0e4912a7153f1c6ba7159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } health_report { overall_health: UNKNOWN } } } I0405 05:43:28.817142 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 5016 I0405 05:43:28.836568 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.4.212.193:42999 --local_ip_for_outbound_sockets=127.4.212.193 --webserver_port=46467 --webserver_interface=127.4.212.193 --tserver_master_addrs=127.4.212.254:39447 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} W0405 05:43:28.786183 5398 tablet.cc:1786] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Can't schedule compaction. Clean time has not been advanced past its initial value. W0405 05:43:28.924329 5273 tablet.cc:1786] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Can't schedule compaction. Clean time has not been advanced past its initial value. WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:28.974301 5431 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:28.974761 5431 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:28.984257 5431 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:28.984673 5431 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.212.193 I0405 05:43:29.000538 5431 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.4.212.193:42999 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.4.212.193 --webserver_port=46467 --tserver_master_addrs=127.4.212.254:39447 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.4.212.193 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:29.018329 5431 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 118516us I0405 05:43:29.018923 5431 fs_manager.cc:263] Metadata directory not provided I0405 05:43:29.019071 5431 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:29.025480 5431 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.006s sys 0.000s I0405 05:43:29.026262 5431 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:29.026840 5431 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:29.033768 5431 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:43:29.033941 5431 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal uuid: "a9b170577d0e4912a7153f1c6ba7159e" format_stamp: "Formatted at 2019-04-05 05:43:25 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:29.035301 5431 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:29.563102 5431 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:29.567369 5431 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0405 05:43:29.574632 5431 ts_tablet_manager.cc:356] Loaded tablet metadata (1 total tablets, 1 live tablets) I0405 05:43:29.574833 5431 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0405 05:43:29.581550 5431 ts_tablet_manager.cc:376] Registered 1 tablets I0405 05:43:29.582350 5448 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Bootstrap starting. I0405 05:43:29.672000 5448 log.cc:525] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Log is configured to *not* fsync() on all Append() calls I0405 05:43:29.681097 5448 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0405 05:43:29.681999 5448 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Bootstrap complete. I0405 05:43:29.683303 5448 ts_tablet_manager.cc:1053] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Time spent bootstrapping tablet: real 0.101s user 0.028s sys 0.023s I0405 05:43:29.712016 5448 raft_consensus.cc:340] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 1 FOLLOWER]: Replica starting. Triggering 1 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:29.721490 5448 raft_consensus.cc:705] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b170577d0e4912a7153f1c6ba7159e, State: Initialized, Role: FOLLOWER I0405 05:43:29.722190 5448 consensus_queue.cc:229] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:29.725175 5448 ts_tablet_manager.cc:1081] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Time spent starting tablet: real 0.042s user 0.029s sys 0.008s I0405 05:43:29.777140 5431 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.193:42999 I0405 05:43:29.779444 5431 webserver.cc:308] Webserver started at http://127.4.212.193:46467/ using document root and password file I0405 05:43:29.780239 5431 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb W0405 05:43:29.783047 5556 tablet.cc:1786] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:43:29.783891 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 5431 I0405 05:43:29.784641 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 4954 W0405 05:43:29.804458 5558 negotiation.cc:313] Failed RPC negotiation. Trace: 0405 05:43:29.782950 (+ 0us) reactor.cc:583] Submitting negotiation task for client connection to 127.4.212.254:39447 0405 05:43:29.785391 (+ 2441us) negotiation.cc:98] Waiting for socket to connect 0405 05:43:29.785454 (+ 63us) client_negotiation.cc:167] Beginning negotiation 0405 05:43:29.785792 (+ 338us) client_negotiation.cc:244] Sending NEGOTIATE NegotiatePB request 0405 05:43:29.803618 (+ 17826us) negotiation.cc:304] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.212.254:39447: BlockingRecv error: recv error from 0.0.0.0:0: Transport endpoint is not connected (error 107) Metrics: {"client-negotiator.queue_time_us":1701,"thread_start_us":1405,"threads_started":1} W0405 05:43:29.805236 5555 heartbeater.cc:587] Failed to heartbeat to 127.4.212.254:39447 (0 consecutive failures): Network error: Failed to ping master at 127.4.212.254:39447: Client connection negotiation failed: client connection to 127.4.212.254:39447: BlockingRecv error: recv error from 0.0.0.0:0: Transport endpoint is not connected (error 107) I0405 05:43:29.807677 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.4.212.254:39447 --webserver_interface=127.4.212.254 --webserver_port=36139 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} W0405 05:43:29.812059 5555 heartbeater.cc:380] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:29.958590 5560 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:29.959012 5560 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:29.970118 5560 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:43:29.970268 5560 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:29.970371 5560 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:43:29.970485 5560 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:43:29.988605 5560 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.4.212.254:39447 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.4.212.254 --webserver_port=36139 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:30.003278 5560 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 119016us I0405 05:43:30.004329 5560 fs_manager.cc:263] Metadata directory not provided I0405 05:43:30.004513 5560 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:30.011231 5560 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.002s sys 0.002s I0405 05:43:30.011924 5560 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:30.012457 5560 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:30.019557 5560 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.002s I0405 05:43:30.019704 5560 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal uuid: "3c97231598334592ab82ec88e885726d" format_stamp: "Formatted at 2019-04-05 05:43:24 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:30.021064 5560 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:30.326690 5572 raft_consensus.cc:472] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0405 05:43:30.327083 5572 raft_consensus.cc:494] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:30.328838 5572 leader_election.cc:296] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a9b170577d0e4912a7153f1c6ba7159e (127.4.212.193:42999), f28b75d4df344cd19ab34804be9b9d63 (127.4.212.194:39023) I0405 05:43:30.349251 5229 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "f680039782c94dec8973193a9551a58a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f28b75d4df344cd19ab34804be9b9d63" is_pre_election: true I0405 05:43:30.349704 5512 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "f680039782c94dec8973193a9551a58a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b170577d0e4912a7153f1c6ba7159e" is_pre_election: true I0405 05:43:30.349774 5229 raft_consensus.cc:2346] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f680039782c94dec8973193a9551a58a in term 1. I0405 05:43:30.350513 5512 raft_consensus.cc:2293] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f680039782c94dec8973193a9551a58a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0405 05:43:30.351080 5285 leader_election.cc:310] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f28b75d4df344cd19ab34804be9b9d63, f680039782c94dec8973193a9551a58a; no voters: I0405 05:43:30.352149 5572 raft_consensus.cc:2640] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 1 FOLLOWER]: Leader pre-election won for term 2 I0405 05:43:30.352355 5572 raft_consensus.cc:472] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0405 05:43:30.352547 5572 raft_consensus.cc:2886] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 1 FOLLOWER]: Advancing to term 2 I0405 05:43:30.357079 5572 raft_consensus.cc:494] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:30.359122 5512 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "f680039782c94dec8973193a9551a58a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9b170577d0e4912a7153f1c6ba7159e" I0405 05:43:30.359232 5229 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "f680039782c94dec8973193a9551a58a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f28b75d4df344cd19ab34804be9b9d63" I0405 05:43:30.359661 5512 raft_consensus.cc:2886] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 1 FOLLOWER]: Advancing to term 2 I0405 05:43:30.359787 5229 raft_consensus.cc:2886] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 1 FOLLOWER]: Advancing to term 2 I0405 05:43:30.363924 5229 raft_consensus.cc:2346] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f680039782c94dec8973193a9551a58a in term 2. I0405 05:43:30.364845 5285 leader_election.cc:310] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f28b75d4df344cd19ab34804be9b9d63, f680039782c94dec8973193a9551a58a; no voters: I0405 05:43:30.365945 5512 raft_consensus.cc:2293] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f680039782c94dec8973193a9551a58a for term 2 because replica has last-logged OpId of term: 1 index: 1, which is greater than that of the candidate, which has last-logged OpId of term: 0 index: 0. I0405 05:43:30.367594 5572 leader_election.cc:296] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [CANDIDATE]: Term 2 election: Requested vote from peers a9b170577d0e4912a7153f1c6ba7159e (127.4.212.193:42999), f28b75d4df344cd19ab34804be9b9d63 (127.4.212.194:39023) I0405 05:43:30.367956 5572 raft_consensus.cc:2640] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 2 FOLLOWER]: Leader election won for term 2 I0405 05:43:30.368216 5572 raft_consensus.cc:667] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 2 LEADER]: Becoming Leader. State: Replica: f680039782c94dec8973193a9551a58a, State: Running, Role: LEADER I0405 05:43:30.368726 5572 consensus_queue.cc:206] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } W0405 05:43:30.376646 5397 heartbeater.cc:587] Failed to heartbeat to 127.4.212.254:39447 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.212.254:39447: connect: Connection refused (error 111) I0405 05:43:30.541060 5560 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:30.617228 5560 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.254:39447 I0405 05:43:30.619758 5560 webserver.cc:308] Webserver started at http://127.4.212.254:36139/ using document root and password file I0405 05:43:30.620740 5560 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:43:30.629724 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 5560 I0405 05:43:30.631096 5628 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Bootstrap starting. I0405 05:43:30.631350 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 5431 I0405 05:43:30.647944 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 5150 I0405 05:43:30.665184 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 5276 I0405 05:43:30.669013 5628 log.cc:525] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Log is configured to *not* fsync() on all Append() calls I0405 05:43:30.684880 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 5560 I0405 05:43:30.703629 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.4.212.254:39447 --webserver_interface=127.4.212.254 --webserver_port=36139 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:30.858279 5630 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:30.858858 5630 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:30.870694 5630 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:43:30.870848 5630 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:30.871081 5630 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:43:30.871229 5630 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:43:30.889400 5630 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.4.212.254:39447 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.4.212.254 --webserver_port=36139 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:30.904225 5630 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 119016us I0405 05:43:30.905186 5630 fs_manager.cc:263] Metadata directory not provided I0405 05:43:30.905333 5630 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:30.911985 5630 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.004s sys 0.001s I0405 05:43:30.912781 5630 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:30.913337 5630 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:30.920619 5630 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:43:30.920778 5630 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal uuid: "3c97231598334592ab82ec88e885726d" format_stamp: "Formatted at 2019-04-05 05:43:24 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:30.922163 5630 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:31.449623 5630 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:31.503935 5630 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.254:39447 I0405 05:43:31.506614 5630 webserver.cc:308] Webserver started at http://127.4.212.254:36139/ using document root and password file I0405 05:43:31.507625 5630 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:43:31.515410 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 5630 I0405 05:43:31.516185 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.4.212.193:42999 --local_ip_for_outbound_sockets=127.4.212.193 --webserver_port=46467 --webserver_interface=127.4.212.193 --tserver_master_addrs=127.4.212.254:39447 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:43:31.518152 5691 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Bootstrap starting. I0405 05:43:31.521070 5691 tablet_bootstrap.cc:656] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Previous recovery directory found at /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal/wals/00000000000000000000000000000000.recovery: Replaying log files from this location instead of /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal/wals/00000000000000000000000000000000 I0405 05:43:31.521234 5691 tablet_bootstrap.cc:663] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Deleting old log files from previous recovery attempt in /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/master-0/wal/wals/00000000000000000000000000000000 I0405 05:43:31.546155 5691 log.cc:525] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Log is configured to *not* fsync() on all Append() calls I0405 05:43:31.563797 5691 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=4 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates I0405 05:43:31.564437 5691 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Bootstrap complete. I0405 05:43:31.585042 5691 raft_consensus.cc:340] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } I0405 05:43:31.587152 5691 raft_consensus.cc:705] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c97231598334592ab82ec88e885726d, State: Initialized, Role: FOLLOWER I0405 05:43:31.587812 5691 consensus_queue.cc:229] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } I0405 05:43:31.588191 5691 raft_consensus.cc:380] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:43:31.588383 5691 raft_consensus.cc:472] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:43:31.588587 5691 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 1 FOLLOWER]: Advancing to term 2 I0405 05:43:31.594122 5691 raft_consensus.cc:494] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } I0405 05:43:31.594628 5691 leader_election.cc:310] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3c97231598334592ab82ec88e885726d; no voters: I0405 05:43:31.596334 5694 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 2 FOLLOWER]: Leader election won for term 2 WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:31.649981 5692 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:31.650470 5692 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:31.659835 5692 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:31.660253 5692 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.212.193 I0405 05:43:31.679334 5692 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.4.212.193:42999 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.4.212.193 --webserver_port=46467 --tserver_master_addrs=127.4.212.254:39447 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.4.212.193 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:31.597383 5691 leader_election.cc:296] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [CANDIDATE]: Term 2 election: Requested vote from peers I0405 05:43:31.694176 5694 raft_consensus.cc:667] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [term 2 LEADER]: Becoming Leader. State: Replica: 3c97231598334592ab82ec88e885726d, State: Running, Role: LEADER I0405 05:43:31.694844 5694 consensus_queue.cc:206] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } I0405 05:43:31.696445 5692 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 119516us I0405 05:43:31.696949 5692 fs_manager.cc:263] Metadata directory not provided I0405 05:43:31.697082 5692 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:31.700229 5695 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3c97231598334592ab82ec88e885726d. Latest consensus state: current_term: 2 leader_uuid: "3c97231598334592ab82ec88e885726d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } } I0405 05:43:31.700831 5695 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: This master's current role is: LEADER I0405 05:43:31.702375 5691 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "3c97231598334592ab82ec88e885726d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } } I0405 05:43:31.702934 5691 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: This master's current role is: LEADER I0405 05:43:31.704807 5692 fs_manager.cc:399] Time spent opening directory manager: real 0.006s user 0.004s sys 0.001s I0405 05:43:31.705572 5692 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:31.705741 5691 sys_catalog.cc:424] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: configured and running, proceeding with master startup. I0405 05:43:31.706225 5692 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:31.707080 5700 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "3c97231598334592ab82ec88e885726d" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3c97231598334592ab82ec88e885726d" member_type: VOTER } } I0405 05:43:31.707610 5704 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:43:31.707743 5700 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d [sys.catalog]: This master's current role is: LEADER I0405 05:43:31.716466 5692 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:43:31.717038 5704 catalog_manager.cc:354] Loaded metadata for table test [id=a5fd86641bfd49bb956371b449cc4999] I0405 05:43:31.716661 5692 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal uuid: "a9b170577d0e4912a7153f1c6ba7159e" format_stamp: "Formatted at 2019-04-05 05:43:25 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:31.718601 5692 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:31.724272 5704 catalog_manager.cc:408] Loaded metadata for tablet ed1b5efee9d944d9be9ba3f1f91153d0 (table test [id=a5fd86641bfd49bb956371b449cc4999]) I0405 05:43:31.724871 5704 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0405 05:43:31.738020 5704 catalog_manager.cc:1075] Loading token signing keys... I0405 05:43:31.740272 5704 catalog_manager.cc:4292] T 00000000000000000000000000000000 P 3c97231598334592ab82ec88e885726d: Loaded TSK: 0 I0405 05:43:32.273674 5692 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:32.277945 5692 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0405 05:43:32.285439 5692 ts_tablet_manager.cc:356] Loaded tablet metadata (1 total tablets, 1 live tablets) I0405 05:43:32.285660 5692 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0405 05:43:32.293177 5719 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Bootstrap starting. I0405 05:43:32.333907 5719 log.cc:525] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Log is configured to *not* fsync() on all Append() calls I0405 05:43:32.301919 5692 ts_tablet_manager.cc:376] Registered 1 tablets I0405 05:43:32.341567 5719 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0405 05:43:32.342455 5719 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Bootstrap complete. I0405 05:43:32.343809 5719 ts_tablet_manager.cc:1053] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Time spent bootstrapping tablet: real 0.051s user 0.036s sys 0.011s I0405 05:43:32.374814 5719 raft_consensus.cc:340] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 2 FOLLOWER]: Replica starting. Triggering 1 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:32.383147 5719 raft_consensus.cc:705] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9b170577d0e4912a7153f1c6ba7159e, State: Initialized, Role: FOLLOWER I0405 05:43:32.383965 5719 consensus_queue.cc:229] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:32.388089 5719 ts_tablet_manager.cc:1081] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Time spent starting tablet: real 0.044s user 0.040s sys 0.004s I0405 05:43:32.734227 5692 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.193:42999 I0405 05:43:32.738293 5692 webserver.cc:308] Webserver started at http://127.4.212.193:46467/ using document root and password file I0405 05:43:32.739187 5692 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:43:32.744232 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 5692 I0405 05:43:32.745139 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.4.212.194:39023 --local_ip_for_outbound_sockets=127.4.212.194 --webserver_port=43895 --webserver_interface=127.4.212.194 --tserver_master_addrs=127.4.212.254:39447 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} W0405 05:43:32.748142 5827 tablet.cc:1786] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:43:32.773540 5826 heartbeater.cc:345] Connected to a master server at 127.4.212.254:39447 I0405 05:43:32.773849 5826 heartbeater.cc:426] Registering TS with master... I0405 05:43:32.774394 5826 heartbeater.cc:475] Master 127.4.212.254:39447 requested a full tablet report, sending... I0405 05:43:32.776620 5658 ts_manager.cc:159] Registered new tserver with Master: a9b170577d0e4912a7153f1c6ba7159e (127.4.212.193:42999) I0405 05:43:32.779371 5658 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.4.212.193:57725 WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:32.935122 5829 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:32.935578 5829 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:32.944694 5829 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:32.945111 5829 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.212.194 I0405 05:43:32.966174 5829 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.4.212.194:39023 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb --webserver_interface=127.4.212.194 --webserver_port=43895 --tserver_master_addrs=127.4.212.254:39447 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.4.212.194 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:32.982461 5829 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 120016us I0405 05:43:32.983002 5829 fs_manager.cc:263] Metadata directory not provided I0405 05:43:32.983161 5829 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:32.995270 5829 fs_manager.cc:399] Time spent opening directory manager: real 0.010s user 0.003s sys 0.009s I0405 05:43:32.996001 5829 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:32.996590 5829 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:33.004072 5829 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:43:33.004293 5829 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal uuid: "f28b75d4df344cd19ab34804be9b9d63" format_stamp: "Formatted at 2019-04-05 05:43:26 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:33.005594 5829 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:43:33.543715 5829 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.506s user 0.000s sys 0.002s W0405 05:43:33.543901 5829 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.506s user 0.000s sys 0.002s I0405 05:43:33.587414 5829 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:33.591116 5829 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0405 05:43:33.596079 5829 ts_tablet_manager.cc:356] Loaded tablet metadata (1 total tablets, 1 live tablets) I0405 05:43:33.596237 5829 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0405 05:43:33.600965 5829 ts_tablet_manager.cc:376] Registered 1 tablets I0405 05:43:33.601634 5848 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Bootstrap starting. I0405 05:43:33.679280 5848 log.cc:525] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Log is configured to *not* fsync() on all Append() calls I0405 05:43:33.683622 5848 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0405 05:43:33.684351 5848 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Bootstrap complete. I0405 05:43:33.685403 5848 ts_tablet_manager.cc:1053] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Time spent bootstrapping tablet: real 0.084s user 0.036s sys 0.008s I0405 05:43:33.712941 5848 raft_consensus.cc:340] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:33.720737 5848 raft_consensus.cc:705] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f28b75d4df344cd19ab34804be9b9d63, State: Initialized, Role: FOLLOWER I0405 05:43:33.721451 5848 consensus_queue.cc:229] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:33.724565 5848 ts_tablet_manager.cc:1081] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Time spent starting tablet: real 0.039s user 0.030s sys 0.008s I0405 05:43:33.774994 5829 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.194:39023 I0405 05:43:33.777544 5829 webserver.cc:308] Webserver started at http://127.4.212.194:43895/ using document root and password file I0405 05:43:33.778419 5829 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb W0405 05:43:33.781677 5956 tablet.cc:1786] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:43:33.782271 5826 heartbeater.cc:467] Master 127.4.212.254:39447 was elected leader, sending a full tablet report... I0405 05:43:33.784584 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 5829 I0405 05:43:33.785495 4947 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.4.212.195:38171 --local_ip_for_outbound_sockets=127.4.212.195 --webserver_port=46465 --webserver_interface=127.4.212.195 --tserver_master_addrs=127.4.212.254:39447 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0405 05:43:33.796706 5960 raft_consensus.cc:472] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0405 05:43:33.797094 5960 raft_consensus.cc:494] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:33.798640 5960 leader_election.cc:296] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f680039782c94dec8973193a9551a58a (127.4.212.195:38171), f28b75d4df344cd19ab34804be9b9d63 (127.4.212.194:39023) W0405 05:43:33.804292 5714 leader_election.cc:341] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f680039782c94dec8973193a9551a58a (127.4.212.195:38171): Network error: Client connection negotiation failed: client connection to 127.4.212.195:38171: connect: Connection refused (error 111) I0405 05:43:33.805783 5955 heartbeater.cc:345] Connected to a master server at 127.4.212.254:39447 I0405 05:43:33.806222 5955 heartbeater.cc:426] Registering TS with master... I0405 05:43:33.806850 5955 heartbeater.cc:475] Master 127.4.212.254:39447 requested a full tablet report, sending... I0405 05:43:33.808836 5658 ts_manager.cc:159] Registered new tserver with Master: f28b75d4df344cd19ab34804be9b9d63 (127.4.212.194:39023) I0405 05:43:33.811149 5658 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.4.212.194:41129 I0405 05:43:33.815727 5912 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "a9b170577d0e4912a7153f1c6ba7159e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f28b75d4df344cd19ab34804be9b9d63" is_pre_election: true I0405 05:43:33.816314 5912 raft_consensus.cc:2346] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a9b170577d0e4912a7153f1c6ba7159e in term 2. I0405 05:43:33.817338 5711 leader_election.cc:310] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b170577d0e4912a7153f1c6ba7159e, f28b75d4df344cd19ab34804be9b9d63; no voters: f680039782c94dec8973193a9551a58a I0405 05:43:33.818045 5960 raft_consensus.cc:2640] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 2 FOLLOWER]: Leader pre-election won for term 3 I0405 05:43:33.818310 5960 raft_consensus.cc:472] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0405 05:43:33.818516 5960 raft_consensus.cc:2886] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 2 FOLLOWER]: Advancing to term 3 I0405 05:43:33.824113 5960 raft_consensus.cc:494] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:33.825490 5960 leader_election.cc:296] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 3 election: Requested vote from peers f680039782c94dec8973193a9551a58a (127.4.212.195:38171), f28b75d4df344cd19ab34804be9b9d63 (127.4.212.194:39023) W0405 05:43:33.826457 5714 leader_election.cc:341] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f680039782c94dec8973193a9551a58a (127.4.212.195:38171): Network error: Client connection negotiation failed: client connection to 127.4.212.195:38171: connect: Connection refused (error 111) I0405 05:43:33.826370 5912 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ed1b5efee9d944d9be9ba3f1f91153d0" candidate_uuid: "a9b170577d0e4912a7153f1c6ba7159e" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f28b75d4df344cd19ab34804be9b9d63" I0405 05:43:33.826846 5912 raft_consensus.cc:2886] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 2 FOLLOWER]: Advancing to term 3 I0405 05:43:33.832480 5912 raft_consensus.cc:2346] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a9b170577d0e4912a7153f1c6ba7159e in term 3. I0405 05:43:33.833252 5711 leader_election.cc:310] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a9b170577d0e4912a7153f1c6ba7159e, f28b75d4df344cd19ab34804be9b9d63; no voters: f680039782c94dec8973193a9551a58a I0405 05:43:33.833894 5960 raft_consensus.cc:2640] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 3 FOLLOWER]: Leader election won for term 3 I0405 05:43:33.835265 5960 raft_consensus.cc:667] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [term 3 LEADER]: Becoming Leader. State: Replica: a9b170577d0e4912a7153f1c6ba7159e, State: Running, Role: LEADER I0405 05:43:33.835687 5960 consensus_queue.cc:206] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:33.841857 5658 catalog_manager.cc:3977] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "a9b170577d0e4912a7153f1c6ba7159e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } health_report { overall_health: UNKNOWN } } } WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:33.947460 5959 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:33.947896 5959 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:33.957756 5959 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:33.958168 5959 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.212.195 I0405 05:43:33.973845 5959 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.4.212.195:38171 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb --webserver_interface=127.4.212.195 --webserver_port=46465 --tserver_master_addrs=127.4.212.254:39447 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.4.212.195 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:33.990376 5959 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 120516us I0405 05:43:33.990918 5959 fs_manager.cc:263] Metadata directory not provided I0405 05:43:33.991055 5959 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:33.997484 5959 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.004s sys 0.002s I0405 05:43:33.998185 5959 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:33.998709 5959 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:34.006791 5959 fs_manager.cc:419] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s I0405 05:43:34.006924 5959 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal uuid: "f680039782c94dec8973193a9551a58a" format_stamp: "Formatted at 2019-04-05 05:43:27 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:34.008342 5959 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:34.361342 5912 raft_consensus.cc:1181] T ed1b5efee9d944d9be9ba3f1f91153d0 P f28b75d4df344cd19ab34804be9b9d63 [term 3 FOLLOWER]: Refusing update from remote peer a9b170577d0e4912a7153f1c6ba7159e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 3 index: 2. (index mismatch) I0405 05:43:34.362700 5981 consensus_queue.cc:984] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e [LEADER]: Connected to new peer: Peer: permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s I0405 05:43:34.366426 5955 heartbeater.cc:467] Master 127.4.212.254:39447 was elected leader, sending a full tablet report... W0405 05:43:34.407758 5714 consensus_peers.cc:457] T ed1b5efee9d944d9be9ba3f1f91153d0 P a9b170577d0e4912a7153f1c6ba7159e -> Peer f680039782c94dec8973193a9551a58a (127.4.212.195:38171): Couldn't send request to peer f680039782c94dec8973193a9551a58a. Status: Network error: Client connection negotiation failed: client connection to 127.4.212.195:38171: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0405 05:43:34.533596 5959 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:34.537134 5959 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0405 05:43:34.542210 5959 ts_tablet_manager.cc:356] Loaded tablet metadata (1 total tablets, 1 live tablets) I0405 05:43:34.542348 5959 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0405 05:43:34.547091 5959 ts_tablet_manager.cc:376] Registered 1 tablets I0405 05:43:34.547860 5996 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Bootstrap starting. I0405 05:43:34.634312 5996 log.cc:525] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Log is configured to *not* fsync() on all Append() calls I0405 05:43:34.639991 5996 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates I0405 05:43:34.640687 5996 tablet_bootstrap.cc:439] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Bootstrap complete. I0405 05:43:34.641650 5996 ts_tablet_manager.cc:1053] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Time spent bootstrapping tablet: real 0.094s user 0.022s sys 0.024s I0405 05:43:34.665719 5996 raft_consensus.cc:340] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 2 FOLLOWER]: Replica starting. Triggering 1 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:34.672060 5996 raft_consensus.cc:705] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: f680039782c94dec8973193a9551a58a, State: Initialized, Role: FOLLOWER I0405 05:43:34.672776 5996 consensus_queue.cc:229] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f680039782c94dec8973193a9551a58a" member_type: VOTER last_known_addr { host: "127.4.212.195" port: 38171 } } peers { permanent_uuid: "a9b170577d0e4912a7153f1c6ba7159e" member_type: VOTER last_known_addr { host: "127.4.212.193" port: 42999 } } peers { permanent_uuid: "f28b75d4df344cd19ab34804be9b9d63" member_type: VOTER last_known_addr { host: "127.4.212.194" port: 39023 } } I0405 05:43:34.675757 5996 ts_tablet_manager.cc:1081] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Time spent starting tablet: real 0.034s user 0.025s sys 0.008s I0405 05:43:34.735224 5959 rpc_server.cc:205] RPC server started. Bound to: 127.4.212.195:38171 I0405 05:43:34.737763 5959 webserver.cc:308] Webserver started at http://127.4.212.195:46465/ using document root and password file I0405 05:43:34.738618 5959 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb W0405 05:43:34.741950 6104 tablet.cc:1786] T ed1b5efee9d944d9be9ba3f1f91153d0 P f680039782c94dec8973193a9551a58a: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:43:34.744025 4947 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 5959 I0405 05:43:34.752588 6103 heartbeater.cc:345] Connected to a master server at 127.4.212.254:39447 I0405 05:43:34.752852 6103 heartbeater.cc:426] Registering TS with master... I0405 05:43:34.753391 6103 heartbeater.cc:475] Master 127.4.212.254:39447 requested a full tablet report, sending... I0405 05:43:34.755645 5657 ts_manager.cc:159] Registered new tserver with Master: f680039782c94dec8973193a9551a58a (127.4.212.195:38171) I0405 05:43:34.757436 5657 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.4.212.195:40849 I0405 05:43:34.758445 4947 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0405 05:43:34.759130 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 5692 I0405 05:43:34.778203 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 5829 I0405 05:43:34.804791 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 5959 I0405 05:43:34.821665 4947 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 5630 [ OK ] SerializationModes/ControlShellToolTest.TestControlShell/0 (11548 ms) [----------] 1 test from SerializationModes/ControlShellToolTest (11548 ms total) [----------] 1 test from Is343ReplicaUtilTest [ RUN ] Is343ReplicaUtilTest.Is343Cluster/0 I0405 05:43:35.877682 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:34157 --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --raft_prepare_replacement_before_eviction=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:36.040925 6110 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:36.041368 6110 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:36.052714 6110 flags.cc:406] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false W0405 05:43:36.052929 6110 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0405 05:43:36.053058 6110 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:36.053176 6110 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0405 05:43:36.053329 6110 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0405 05:43:36.071467 6110 master_main.cc:73] Master server non-default flags: --raft_prepare_replacement_before_eviction=false --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.0.59.62:34157 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/data/info.pb --webserver_interface=127.0.59.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:36.086076 6110 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 122016us I0405 05:43:36.087052 6110 fs_manager.cc:263] Metadata directory not provided I0405 05:43:36.087203 6110 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:36.087488 6110 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:36.087602 6110 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:36.090688 6110 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/data/instance: uuid: "6433f155258f4fe8b83f61f9d6d9af8c" format_stamp: "Formatted at 2019-04-05 05:43:36 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:36.091459 6110 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/wal/instance: uuid: "6433f155258f4fe8b83f61f9d6d9af8c" format_stamp: "Formatted at 2019-04-05 05:43:36 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:36.101861 6110 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s I0405 05:43:36.103147 6110 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:36.103683 6110 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:36.110543 6110 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s I0405 05:43:36.110689 6110 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/wal uuid: "6433f155258f4fe8b83f61f9d6d9af8c" format_stamp: "Formatted at 2019-04-05 05:43:36 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:36.110908 6110 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:36.609351 6110 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:36.674630 6110 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.62:34157 I0405 05:43:36.677325 6110 webserver.cc:308] Webserver started at http://127.0.59.62:43533/ using document root and password file I0405 05:43:36.678337 6110 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/master-0/data/info.pb I0405 05:43:36.682361 6171 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:36.688568 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master as pid 6110 I0405 05:43:36.689898 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.0.59.1:0 --local_ip_for_outbound_sockets=127.0.59.1 --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:34157 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --raft_prepare_replacement_before_eviction=false with env {} I0405 05:43:36.715092 6171 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c: Bootstrap starting. I0405 05:43:36.722522 6171 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c: No blocks or log segments found. Creating new log. I0405 05:43:36.723965 6171 log.cc:525] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c: Log is configured to *not* fsync() on all Append() calls I0405 05:43:36.736047 6171 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c: No bootstrap required, opened a new log I0405 05:43:36.757088 6171 raft_consensus.cc:340] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" member_type: VOTER } I0405 05:43:36.757616 6171 raft_consensus.cc:366] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:36.757836 6171 raft_consensus.cc:705] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6433f155258f4fe8b83f61f9d6d9af8c, State: Initialized, Role: FOLLOWER I0405 05:43:36.758522 6171 consensus_queue.cc:229] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" member_type: VOTER } I0405 05:43:36.759052 6171 raft_consensus.cc:380] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0405 05:43:36.759284 6171 raft_consensus.cc:472] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0405 05:43:36.759557 6171 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:36.764132 6171 raft_consensus.cc:494] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" member_type: VOTER } I0405 05:43:36.764772 6171 leader_election.cc:310] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6433f155258f4fe8b83f61f9d6d9af8c; no voters: I0405 05:43:36.767087 6174 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:43:36.768402 6171 leader_election.cc:296] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [CANDIDATE]: Term 1 election: Requested vote from peers I0405 05:43:36.838439 6174 raft_consensus.cc:667] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [term 1 LEADER]: Becoming Leader. State: Replica: 6433f155258f4fe8b83f61f9d6d9af8c, State: Running, Role: LEADER I0405 05:43:36.839159 6174 consensus_queue.cc:206] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" member_type: VOTER } I0405 05:43:36.846489 6171 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" member_type: VOTER } } I0405 05:43:36.847163 6171 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [sys.catalog]: This master's current role is: LEADER I0405 05:43:36.846931 6176 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" member_type: VOTER } } I0405 05:43:36.846953 6175 sys_catalog.cc:337] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6433f155258f4fe8b83f61f9d6d9af8c. Latest consensus state: current_term: 1 leader_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6433f155258f4fe8b83f61f9d6d9af8c" member_type: VOTER } } I0405 05:43:36.847630 6175 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [sys.catalog]: This master's current role is: LEADER I0405 05:43:36.847676 6176 sys_catalog.cc:340] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [sys.catalog]: This master's current role is: LEADER I0405 05:43:36.851366 6171 sys_catalog.cc:424] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c [sys.catalog]: configured and running, proceeding with master startup. W0405 05:43:36.859483 6180 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0405 05:43:36.859678 6180 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0405 05:43:36.859944 6178 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0405 05:43:36.862293 6178 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0405 05:43:36.884474 6178 catalog_manager.cc:950] Generated new certificate authority record I0405 05:43:36.885985 6178 catalog_manager.cc:1075] Loading token signing keys... I0405 05:43:36.895759 6178 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 6433f155258f4fe8b83f61f9d6d9af8c: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:36.902711 6172 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:36.903445 6172 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:36.921018 6172 flags.cc:406] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false W0405 05:43:36.921314 6172 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:36.921860 6172 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.1 I0405 05:43:36.950218 6172 tablet_server_main.cc:78] Tablet server non-default flags: --raft_prepare_replacement_before_eviction=false --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb --webserver_interface=127.0.59.1 --webserver_port=0 --tserver_master_addrs=127.0.59.62:34157 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:36.966246 6172 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 122016us I0405 05:43:36.966742 6172 fs_manager.cc:263] Metadata directory not provided I0405 05:43:36.966881 6172 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:36.967181 6172 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:36.967383 6172 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:36.970525 6172 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/data/instance: uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" format_stamp: "Formatted at 2019-04-05 05:43:36 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:36.971269 6172 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/wal/instance: uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" format_stamp: "Formatted at 2019-04-05 05:43:36 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:36.991294 6172 fs_manager.cc:503] Time spent creating directory manager: real 0.020s user 0.008s sys 0.012s I0405 05:43:36.992604 6172 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:36.993192 6172 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:37.000418 6172 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:43:37.000556 6172 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/wal uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" format_stamp: "Formatted at 2019-04-05 05:43:36 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:37.000788 6172 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:43:37.593246 6172 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.563s user 0.134s sys 0.425s W0405 05:43:37.593509 6172 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.563s user 0.134s sys 0.425s I0405 05:43:37.680440 6172 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:37.685205 6172 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:43:37.685353 6172 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:43:37.850551 6172 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.1:34351 I0405 05:43:37.854457 6172 webserver.cc:308] Webserver started at http://127.0.59.1:46405/ using document root and password file I0405 05:43:37.855643 6172 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-0/data/info.pb I0405 05:43:37.864027 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 6172 I0405 05:43:37.865382 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.0.59.2:0 --local_ip_for_outbound_sockets=127.0.59.2 --webserver_interface=127.0.59.2 --webserver_port=0 --tserver_master_addrs=127.0.59.62:34157 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --raft_prepare_replacement_before_eviction=false with env {} I0405 05:43:37.907114 6303 heartbeater.cc:345] Connected to a master server at 127.0.59.62:34157 I0405 05:43:37.907594 6303 heartbeater.cc:426] Registering TS with master... I0405 05:43:37.908217 6303 heartbeater.cc:475] Master 127.0.59.62:34157 requested a full tablet report, sending... I0405 05:43:37.910384 6138 ts_manager.cc:159] Registered new tserver with Master: f456ef0f7f2040fdaa50c9f66f62a9f3 (127.0.59.1:34351) I0405 05:43:37.913023 6138 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.1:41125 WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:38.023488 6307 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:38.023947 6307 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:38.033401 6307 flags.cc:406] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false W0405 05:43:38.033613 6307 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:38.034029 6307 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.2 I0405 05:43:38.056335 6307 tablet_server_main.cc:78] Tablet server non-default flags: --raft_prepare_replacement_before_eviction=false --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.2:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb --webserver_interface=127.0.59.2 --webserver_port=0 --tserver_master_addrs=127.0.59.62:34157 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.2 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:38.072746 6307 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 123016us I0405 05:43:38.073278 6307 fs_manager.cc:263] Metadata directory not provided I0405 05:43:38.073420 6307 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:38.073709 6307 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:38.073856 6307 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:38.077234 6307 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/data/instance: uuid: "4099cfa2b0a1437ca9b705157731ba47" format_stamp: "Formatted at 2019-04-05 05:43:38 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:38.078001 6307 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/wal/instance: uuid: "4099cfa2b0a1437ca9b705157731ba47" format_stamp: "Formatted at 2019-04-05 05:43:38 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:38.099395 6307 fs_manager.cc:503] Time spent creating directory manager: real 0.021s user 0.010s sys 0.010s I0405 05:43:38.100888 6307 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:38.101438 6307 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:38.111030 6307 fs_manager.cc:419] Time spent opening block manager: real 0.005s user 0.001s sys 0.004s I0405 05:43:38.111169 6307 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/wal uuid: "4099cfa2b0a1437ca9b705157731ba47" format_stamp: "Formatted at 2019-04-05 05:43:38 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:38.111443 6307 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0405 05:43:38.655715 6307 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:38.659209 6307 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:43:38.659343 6307 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:43:38.782701 6307 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.2:43663 I0405 05:43:38.784998 6307 webserver.cc:308] Webserver started at http://127.0.59.2:42231/ using document root and password file I0405 05:43:38.785866 6307 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-1/data/info.pb I0405 05:43:38.796365 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 6307 I0405 05:43:38.797444 236 external_mini_cluster.cc:933] Running /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.0.59.3:0 --local_ip_for_outbound_sockets=127.0.59.3 --webserver_interface=127.0.59.3 --webserver_port=0 --tserver_master_addrs=127.0.59.62:34157 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --raft_prepare_replacement_before_eviction=false with env {} I0405 05:43:38.806664 6428 heartbeater.cc:345] Connected to a master server at 127.0.59.62:34157 I0405 05:43:38.806946 6428 heartbeater.cc:426] Registering TS with master... I0405 05:43:38.807418 6428 heartbeater.cc:475] Master 127.0.59.62:34157 requested a full tablet report, sending... I0405 05:43:38.808912 6138 ts_manager.cc:159] Registered new tserver with Master: 4099cfa2b0a1437ca9b705157731ba47 (127.0.59.2:43663) I0405 05:43:38.810493 6138 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.2:55781 I0405 05:43:38.916501 6303 heartbeater.cc:467] Master 127.0.59.62:34157 was elected leader, sending a full tablet report... WARNING: Logging before InitGoogleLogging() is written to STDERR W0405 05:43:38.936060 6432 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0405 05:43:38.936517 6432 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0405 05:43:38.946069 6432 flags.cc:406] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false W0405 05:43:38.946281 6432 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0405 05:43:38.946621 6432 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.0.59.3 I0405 05:43:38.960937 6432 tablet_server_main.cc:78] Tablet server non-default flags: --raft_prepare_replacement_before_eviction=false --fs_data_dirs=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.0.59.3:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb --webserver_interface=127.0.59.3 --webserver_port=0 --tserver_master_addrs=127.0.59.62:34157 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.0.59.3 --log_dir=/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 7a1df1a09f5ce1f3a0bcbb40f71d73b44044f2bc build type FASTDEBUG built by jenkins at 04 Apr 2019 22:07:29 PST on quasar-byykkt-1.vpc.cloudera.com build id 304242 TSAN enabled I0405 05:43:38.978521 6432 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 123016us I0405 05:43:38.979048 6432 fs_manager.cc:263] Metadata directory not provided I0405 05:43:38.979166 6432 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0405 05:43:38.979403 6432 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0405 05:43:38.979512 6432 server_base.cc:434] Attempting to create new FS layout instead I0405 05:43:38.982626 6432 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/data/instance: uuid: "8f12c612e2df47adb1290b03b8ef052d" format_stamp: "Formatted at 2019-04-05 05:43:38 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:38.983371 6432 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/wal/instance: uuid: "8f12c612e2df47adb1290b03b8ef052d" format_stamp: "Formatted at 2019-04-05 05:43:38 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:38.993829 6432 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.010s sys 0.001s I0405 05:43:38.995093 6432 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0405 05:43:38.995652 6432 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0405 05:43:39.002728 6432 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0405 05:43:39.002851 6432 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/data,/tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/wal uuid: "8f12c612e2df47adb1290b03b8ef052d" format_stamp: "Formatted at 2019-04-05 05:43:38 on dist-test-slave-dist-test-slave-bl6s" I0405 05:43:39.003060 6432 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) W0405 05:43:39.543828 6432 thread.cc:599] rpc reactor (reactor) Time spent creating pthread: real 0.518s user 0.104s sys 0.411s W0405 05:43:39.544028 6432 thread.cc:566] rpc reactor (reactor) Time spent starting thread: real 0.518s user 0.104s sys 0.411s I0405 05:43:39.570163 6432 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0405 05:43:39.573647 6432 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0405 05:43:39.573801 6432 ts_tablet_manager.cc:376] Registered 0 tablets I0405 05:43:39.721901 6432 rpc_server.cc:205] RPC server started. Bound to: 127.0.59.3:43599 I0405 05:43:39.724239 6432 webserver.cc:308] Webserver started at http://127.0.59.3:36783/ using document root and password file I0405 05:43:39.725049 6432 server_base.cc:608] Dumped server information to /tmp/dist-test-taskvH0aH1/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554442812470121-236/minicluster-data/ts-2/data/info.pb I0405 05:43:39.730250 236 external_mini_cluster.cc:995] Started /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver as pid 6432 I0405 05:43:39.751287 6553 heartbeater.cc:345] Connected to a master server at 127.0.59.62:34157 I0405 05:43:39.751602 6553 heartbeater.cc:426] Registering TS with master... I0405 05:43:39.752171 6553 heartbeater.cc:475] Master 127.0.59.62:34157 requested a full tablet report, sending... I0405 05:43:39.753439 6138 ts_manager.cc:159] Registered new tserver with Master: 8f12c612e2df47adb1290b03b8ef052d (127.0.59.3:43599) I0405 05:43:39.754849 6138 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.59.3:34979 I0405 05:43:39.754961 236 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0405 05:43:39.795296 236 test_util.cc:212] Using random seed: -133907647 I0405 05:43:39.812851 6428 heartbeater.cc:467] Master 127.0.59.62:34157 was elected leader, sending a full tablet report... I0405 05:43:39.809434 6138 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37374: name: "is_343_test_table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0405 05:43:39.859336 6365 tablet_service.cc:1006] Processing CreateTablet for tablet 0362355168ce4923a6a0466b4b7444e5 (table=is_343_test_table [id=97f8ebd618fd4ea29ec8bbc314e09f0b]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:43:39.860461 6365 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0362355168ce4923a6a0466b4b7444e5. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:39.862808 6240 tablet_service.cc:1006] Processing CreateTablet for tablet 0362355168ce4923a6a0466b4b7444e5 (table=is_343_test_table [id=97f8ebd618fd4ea29ec8bbc314e09f0b]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:43:39.863304 6490 tablet_service.cc:1006] Processing CreateTablet for tablet 0362355168ce4923a6a0466b4b7444e5 (table=is_343_test_table [id=97f8ebd618fd4ea29ec8bbc314e09f0b]), partition=RANGE (key) PARTITION UNBOUNDED I0405 05:43:39.863930 6240 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0362355168ce4923a6a0466b4b7444e5. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:39.864240 6490 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0362355168ce4923a6a0466b4b7444e5. 1 dirs total, 0 dirs full, 0 dirs failed I0405 05:43:39.878063 6584 tablet_bootstrap.cc:439] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47: Bootstrap starting. I0405 05:43:39.880738 6584 tablet_bootstrap.cc:590] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47: No blocks or log segments found. Creating new log. I0405 05:43:39.882174 6584 log.cc:525] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47: Log is configured to *not* fsync() on all Append() calls I0405 05:43:39.884811 6586 tablet_bootstrap.cc:439] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d: Bootstrap starting. I0405 05:43:39.886695 6587 tablet_bootstrap.cc:439] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3: Bootstrap starting. I0405 05:43:39.891922 6586 tablet_bootstrap.cc:590] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d: No blocks or log segments found. Creating new log. I0405 05:43:39.893378 6586 log.cc:525] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d: Log is configured to *not* fsync() on all Append() calls I0405 05:43:39.893985 6587 tablet_bootstrap.cc:590] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3: No blocks or log segments found. Creating new log. I0405 05:43:39.895390 6584 tablet_bootstrap.cc:439] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47: No bootstrap required, opened a new log I0405 05:43:39.895470 6587 log.cc:525] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3: Log is configured to *not* fsync() on all Append() calls I0405 05:43:39.895846 6584 ts_tablet_manager.cc:1053] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.000s I0405 05:43:39.898762 6587 tablet_bootstrap.cc:439] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3: No bootstrap required, opened a new log I0405 05:43:39.899173 6587 ts_tablet_manager.cc:1053] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3: Time spent bootstrapping tablet: real 0.013s user 0.006s sys 0.000s I0405 05:43:39.899425 6586 tablet_bootstrap.cc:439] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d: No bootstrap required, opened a new log I0405 05:43:39.899778 6586 ts_tablet_manager.cc:1053] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.007s I0405 05:43:39.911872 6586 raft_consensus.cc:340] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:39.912747 6586 raft_consensus.cc:366] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:39.912952 6586 raft_consensus.cc:705] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f12c612e2df47adb1290b03b8ef052d, State: Initialized, Role: FOLLOWER I0405 05:43:39.913158 6584 raft_consensus.cc:340] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:39.914016 6584 raft_consensus.cc:366] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:39.913691 6586 consensus_queue.cc:229] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:39.914243 6584 raft_consensus.cc:705] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4099cfa2b0a1437ca9b705157731ba47, State: Initialized, Role: FOLLOWER I0405 05:43:39.914853 6584 consensus_queue.cc:229] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:39.916210 6553 heartbeater.cc:467] Master 127.0.59.62:34157 was elected leader, sending a full tablet report... I0405 05:43:39.917783 6586 ts_tablet_manager.cc:1081] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d: Time spent starting tablet: real 0.018s user 0.010s sys 0.007s I0405 05:43:39.919759 6584 ts_tablet_manager.cc:1081] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47: Time spent starting tablet: real 0.024s user 0.023s sys 0.000s I0405 05:43:39.919811 6587 raft_consensus.cc:340] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:39.920665 6587 raft_consensus.cc:366] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0405 05:43:39.921145 6587 raft_consensus.cc:705] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f456ef0f7f2040fdaa50c9f66f62a9f3, State: Initialized, Role: FOLLOWER I0405 05:43:39.921931 6587 consensus_queue.cc:229] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:39.924799 6587 ts_tablet_manager.cc:1081] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3: Time spent starting tablet: real 0.025s user 0.018s sys 0.008s I0405 05:43:39.973429 6590 raft_consensus.cc:472] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0405 05:43:40.051496 6590 raft_consensus.cc:494] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:40.053205 6590 leader_election.cc:296] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4099cfa2b0a1437ca9b705157731ba47 (127.0.59.2:43663), f456ef0f7f2040fdaa50c9f66f62a9f3 (127.0.59.1:34351) W0405 05:43:39.978168 6554 tablet.cc:1786] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:43:40.087338 6260 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0362355168ce4923a6a0466b4b7444e5" candidate_uuid: "8f12c612e2df47adb1290b03b8ef052d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" is_pre_election: true I0405 05:43:40.087339 6385 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0362355168ce4923a6a0466b4b7444e5" candidate_uuid: "8f12c612e2df47adb1290b03b8ef052d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4099cfa2b0a1437ca9b705157731ba47" is_pre_election: true I0405 05:43:40.088109 6260 raft_consensus.cc:2346] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f12c612e2df47adb1290b03b8ef052d in term 0. I0405 05:43:40.088109 6385 raft_consensus.cc:2346] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f12c612e2df47adb1290b03b8ef052d in term 0. I0405 05:43:40.089267 6441 leader_election.cc:310] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4099cfa2b0a1437ca9b705157731ba47, 8f12c612e2df47adb1290b03b8ef052d; no voters: I0405 05:43:40.089993 6590 raft_consensus.cc:2640] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 0 FOLLOWER]: Leader pre-election won for term 1 I0405 05:43:40.090220 6590 raft_consensus.cc:472] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0405 05:43:40.090453 6590 raft_consensus.cc:2886] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:40.094123 6590 raft_consensus.cc:494] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:40.095216 6590 leader_election.cc:296] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [CANDIDATE]: Term 1 election: Requested vote from peers 4099cfa2b0a1437ca9b705157731ba47 (127.0.59.2:43663), f456ef0f7f2040fdaa50c9f66f62a9f3 (127.0.59.1:34351) I0405 05:43:40.096320 6260 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0362355168ce4923a6a0466b4b7444e5" candidate_uuid: "8f12c612e2df47adb1290b03b8ef052d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" I0405 05:43:40.096434 6385 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "0362355168ce4923a6a0466b4b7444e5" candidate_uuid: "8f12c612e2df47adb1290b03b8ef052d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4099cfa2b0a1437ca9b705157731ba47" I0405 05:43:40.096724 6260 raft_consensus.cc:2886] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:40.096932 6385 raft_consensus.cc:2886] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47 [term 0 FOLLOWER]: Advancing to term 1 I0405 05:43:40.100219 6260 raft_consensus.cc:2346] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f12c612e2df47adb1290b03b8ef052d in term 1. I0405 05:43:40.100978 6441 leader_election.cc:310] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8f12c612e2df47adb1290b03b8ef052d, f456ef0f7f2040fdaa50c9f66f62a9f3; no voters: I0405 05:43:40.101572 6590 raft_consensus.cc:2640] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 1 FOLLOWER]: Leader election won for term 1 I0405 05:43:40.101702 6385 raft_consensus.cc:2346] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f12c612e2df47adb1290b03b8ef052d in term 1. I0405 05:43:40.103452 6590 raft_consensus.cc:667] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [term 1 LEADER]: Becoming Leader. State: Replica: 8f12c612e2df47adb1290b03b8ef052d, State: Running, Role: LEADER I0405 05:43:40.103900 6590 consensus_queue.cc:206] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } I0405 05:43:40.110956 6136 catalog_manager.cc:3977] T 0362355168ce4923a6a0466b4b7444e5 P 8f12c612e2df47adb1290b03b8ef052d reported cstate change: term changed from 0 to 1, leader changed from to 8f12c612e2df47adb1290b03b8ef052d (127.0.59.3). New cstate: current_term: 1 leader_uuid: "8f12c612e2df47adb1290b03b8ef052d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4099cfa2b0a1437ca9b705157731ba47" member_type: VOTER last_known_addr { host: "127.0.59.2" port: 43663 } } peers { permanent_uuid: "f456ef0f7f2040fdaa50c9f66f62a9f3" member_type: VOTER last_known_addr { host: "127.0.59.1" port: 34351 } } peers { permanent_uuid: "8f12c612e2df47adb1290b03b8ef052d" member_type: VOTER last_known_addr { host: "127.0.59.3" port: 43599 } } } W0405 05:43:40.040412 6429 tablet.cc:1786] T 0362355168ce4923a6a0466b4b7444e5 P 4099cfa2b0a1437ca9b705157731ba47: Can't schedule compaction. Clean time has not been advanced past its initial value. W0405 05:43:40.125902 6304 tablet.cc:1786] T 0362355168ce4923a6a0466b4b7444e5 P f456ef0f7f2040fdaa50c9f66f62a9f3: Can't schedule compaction. Clean time has not been advanced past its initial value. I0405 05:43:40.222801 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 6172 I0405 05:43:40.239898 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 6307 I0405 05:43:40.257215 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-tserver with pid 6432 I0405 05:43:40.278055 236 external_mini_cluster.cc:1131] Killing /tmp/dist-test-taskvH0aH1/build/tsan/bin/kudu-master with pid 6110 [ OK ] Is343ReplicaUtilTest.Is343Cluster/0 (4441 ms) [----------] 1 test from Is343ReplicaUtilTest (4441 ms total) [----------] Global test environment tear-down [==========] 18 tests from 5 test cases ran. (207806 ms total) [ PASSED ] 17 tests. [ FAILED ] 1 test, listed below: [ FAILED ] ToolTest.TestLoadgenAutoFlushBackgroundRandom 1 FAILED TEST