Note: This is test shard 1 of 4. [==========] Running 18 tests from 5 test cases. [----------] Global test environment set-up. [----------] 13 tests from ToolTest [ RUN ] ToolTest.TestHelpXML [ OK ] ToolTest.TestHelpXML (361 ms) [ RUN ] ToolTest.TestActionMissingRequiredArg [ OK ] ToolTest.TestActionMissingRequiredArg (810 ms) [ RUN ] ToolTest.TestFsFormatWithUuid WARNING: Logging before InitGoogleLogging() is written to STDERR I0403 04:30:00.941494 3617 fs_manager.cc:263] Metadata directory not provided I0403 04:30:00.941715 3617 fs_manager.cc:266] Using existing metadata directory in first data directory I0403 04:30:00.949439 3617 fs_manager.cc:399] Time spent opening directory manager: real 0.006s user 0.005s sys 0.000s I0403 04:30:00.950420 3617 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:00.951150 3617 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:00.954218 3617 fs_report.cc:352] FS layout report -------------------- wal directory: metadata directory: 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestFsFormatWithUuid.1554265799459872-3617/test/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:00.954483 3617 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:00.954576 3617 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestFsFormatWithUuid.1554265799459872-3617/test uuid: "f3ebdc6ea80846bcb3454d3104569aa4" format_stamp: "Formatted at 2019-04-03 04:30:00 on dist-test-slave-dist-test-slave-1l7r" [ OK ] ToolTest.TestFsFormatWithUuid (316 ms) [ RUN ] ToolTest.TestFsDumpBlock I0403 04:30:00.961354 3617 fs_manager.cc:263] Metadata directory not provided I0403 04:30:00.961427 3617 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:00.962759 3617 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpBlock.1554265799459872-3617/test/instance: uuid: "287f9011208d4846b98423543a55c838" format_stamp: "Formatted at 2019-04-03 04:30:00 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:00.965991 3617 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s I0403 04:30:00.966950 3617 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:00.968286 3617 fs_report.cc:352] FS layout report -------------------- wal directory: metadata directory: 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpBlock.1554265799459872-3617/test/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:00.968417 3617 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0403 04:30:00.968470 3617 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpBlock.1554265799459872-3617/test uuid: "287f9011208d4846b98423543a55c838" format_stamp: "Formatted at 2019-04-03 04:30:00 on dist-test-slave-dist-test-slave-1l7r" [ OK ] ToolTest.TestFsDumpBlock (295 ms) [ RUN ] ToolTest.TestFsDumpTree I0403 04:30:01.257758 3617 fs_manager.cc:263] Metadata directory not provided I0403 04:30:01.257886 3617 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:01.258546 3617 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpTree.1554265799459872-3617/test/instance: uuid: "7edc633f32b34a579eaa9565e64a6628" format_stamp: "Formatted at 2019-04-03 04:30:01 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:01.262178 3617 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.001s sys 0.003s I0403 04:30:01.263928 3617 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:01.265528 3617 fs_report.cc:352] FS layout report -------------------- wal directory: metadata directory: 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpTree.1554265799459872-3617/test/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:01.265693 3617 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0403 04:30:01.265774 3617 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestFsDumpTree.1554265799459872-3617/test uuid: "7edc633f32b34a579eaa9565e64a6628" format_stamp: "Formatted at 2019-04-03 04:30:01 on dist-test-slave-dist-test-slave-1l7r" [ OK ] ToolTest.TestFsDumpTree (286 ms) [ RUN ] ToolTest.TestLoadgenAutoFlushBackgroundRandom I0403 04:30:01.551295 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:46585 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:01.731334 3672 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:01.731581 3672 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:01.734019 3672 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:30:01.734076 3672 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:01.734127 3672 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:30:01.734184 3672 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:30:01.738657 3672 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:46585 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:01.744865 3672 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 202635us I0403 04:30:01.746052 3672 fs_manager.cc:263] Metadata directory not provided I0403 04:30:01.746140 3672 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:01.746446 3672 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:01.746541 3672 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:01.748982 3672 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "3bb04b3d882240c5ad137df86ccf6c7e" format_stamp: "Formatted at 2019-04-03 04:30:01 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:01.749583 3672 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "3bb04b3d882240c5ad137df86ccf6c7e" format_stamp: "Formatted at 2019-04-03 04:30:01 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:01.756094 3672 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s I0403 04:30:01.757369 3672 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:01.757958 3672 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:01.761126 3672 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:01.761206 3672 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/wal uuid: "3bb04b3d882240c5ad137df86ccf6c7e" format_stamp: "Formatted at 2019-04-03 04:30:01 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:01.761389 3672 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:01.825736 3672 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:01.842456 3672 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:46585 I0403 04:30:01.843535 3672 webserver.cc:308] Webserver started at http://127.3.136.126:39105/ using document root and password file I0403 04:30:01.844143 3672 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:30:01.847193 3731 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:01.851902 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 3672 I0403 04:30:01.852843 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.3.136.65:0 --local_ip_for_outbound_sockets=127.3.136.65 --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:01.859609 3731 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e: Bootstrap starting. I0403 04:30:01.862816 3731 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e: No blocks or log segments found. Creating new log. I0403 04:30:01.863998 3731 log.cc:525] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e: Log is configured to *not* fsync() on all Append() calls I0403 04:30:01.865710 3731 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e: No bootstrap required, opened a new log I0403 04:30:01.876031 3731 raft_consensus.cc:340] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" member_type: VOTER } I0403 04:30:01.876308 3731 raft_consensus.cc:366] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:01.876399 3731 raft_consensus.cc:705] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bb04b3d882240c5ad137df86ccf6c7e, State: Initialized, Role: FOLLOWER I0403 04:30:01.877048 3731 consensus_queue.cc:229] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" member_type: VOTER } I0403 04:30:01.877283 3731 raft_consensus.cc:380] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:01.877398 3731 raft_consensus.cc:472] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:01.877537 3731 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:01.879915 3731 raft_consensus.cc:494] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" member_type: VOTER } I0403 04:30:01.880386 3731 leader_election.cc:310] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3bb04b3d882240c5ad137df86ccf6c7e; no voters: I0403 04:30:01.881235 3734 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:01.881660 3731 leader_election.cc:296] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:01.882566 3734 raft_consensus.cc:667] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [term 1 LEADER]: Becoming Leader. State: Replica: 3bb04b3d882240c5ad137df86ccf6c7e, State: Running, Role: LEADER I0403 04:30:01.883018 3734 consensus_queue.cc:206] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" member_type: VOTER } I0403 04:30:01.887305 3736 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3bb04b3d882240c5ad137df86ccf6c7e. Latest consensus state: current_term: 1 leader_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" member_type: VOTER } } I0403 04:30:01.887807 3736 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [sys.catalog]: This master's current role is: LEADER I0403 04:30:01.887886 3731 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" member_type: VOTER } } I0403 04:30:01.888170 3731 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [sys.catalog]: This master's current role is: LEADER I0403 04:30:01.889858 3731 sys_catalog.cc:424] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:01.890267 3735 sys_catalog.cc:337] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3bb04b3d882240c5ad137df86ccf6c7e" member_type: VOTER } } I0403 04:30:01.890652 3735 sys_catalog.cc:340] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e [sys.catalog]: This master's current role is: LEADER W0403 04:30:01.894948 3741 catalog_manager.cc:1113] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e: acquiring CA information for follower catalog manager: Not found: root CA entry not found W0403 04:30:01.895050 3741 catalog_manager.cc:594] Not found: root CA entry not found: failed to prepare follower catalog manager, will retry I0403 04:30:01.895149 3740 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:01.897534 3740 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:01.959270 3740 catalog_manager.cc:950] Generated new certificate authority record I0403 04:30:01.961131 3740 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:01.977766 3740 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 3bb04b3d882240c5ad137df86ccf6c7e: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:02.017891 3732 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:02.018127 3732 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:02.020181 3732 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:02.020303 3732 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.65 I0403 04:30:02.023865 3732 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.65:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.65 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:02.030568 3732 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 203135us I0403 04:30:02.031147 3732 fs_manager.cc:263] Metadata directory not provided I0403 04:30:02.031239 3732 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:02.031524 3732 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:02.031607 3732 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:02.033998 3732 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "11450928935045a4ba6b3fe1f6abdc74" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.034576 3732 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "11450928935045a4ba6b3fe1f6abdc74" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.051947 3732 fs_manager.cc:503] Time spent creating directory manager: real 0.017s user 0.009s sys 0.008s I0403 04:30:02.053125 3732 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:02.053709 3732 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:02.063177 3732 fs_manager.cc:419] Time spent opening block manager: real 0.008s user 0.000s sys 0.008s I0403 04:30:02.063252 3732 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "11450928935045a4ba6b3fe1f6abdc74" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.063408 3732 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:02.134814 3732 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:02.136533 3732 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:02.136596 3732 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:02.227831 3732 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:40453 I0403 04:30:02.228927 3732 webserver.cc:308] Webserver started at http://127.3.136.65:41343/ using document root and password file I0403 04:30:02.229547 3732 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:30:02.234967 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 3732 I0403 04:30:02.235697 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.3.136.66:0 --local_ip_for_outbound_sockets=127.3.136.66 --webserver_interface=127.3.136.66 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:02.255250 3862 heartbeater.cc:345] Connected to a master server at 127.3.136.126:46585 I0403 04:30:02.255441 3862 heartbeater.cc:426] Registering TS with master... I0403 04:30:02.255921 3862 heartbeater.cc:475] Master 127.3.136.126:46585 requested a full tablet report, sending... I0403 04:30:02.257294 3698 ts_manager.cc:159] Registered new tserver with Master: 11450928935045a4ba6b3fe1f6abdc74 (127.3.136.65:40453) I0403 04:30:02.258841 3698 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.65:54977 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:02.391506 3866 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:02.391741 3866 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:02.394039 3866 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:02.394165 3866 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.66 I0403 04:30:02.398198 3866 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.66:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --webserver_interface=127.3.136.66 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.66 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:02.405248 3866 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 203135us I0403 04:30:02.406028 3866 fs_manager.cc:263] Metadata directory not provided I0403 04:30:02.406128 3866 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:02.406428 3866 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:02.406513 3866 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:02.408922 3866 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/data/instance: uuid: "ecedc3ab196045ee8930bad21a3ee783" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.409497 3866 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/wal/instance: uuid: "ecedc3ab196045ee8930bad21a3ee783" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.415452 3866 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s I0403 04:30:02.416656 3866 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:02.417273 3866 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:02.420121 3866 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:02.420197 3866 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/wal uuid: "ecedc3ab196045ee8930bad21a3ee783" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.420367 3866 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:02.462582 3866 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:02.464354 3866 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:02.464421 3866 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:02.491322 3866 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.66:38357 I0403 04:30:02.492252 3866 webserver.cc:308] Webserver started at http://127.3.136.66:39243/ using document root and password file I0403 04:30:02.492832 3866 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-1/data/info.pb I0403 04:30:02.498131 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 3866 I0403 04:30:02.498739 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.3.136.67:0 --local_ip_for_outbound_sockets=127.3.136.67 --webserver_interface=127.3.136.67 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:02.506374 3985 heartbeater.cc:345] Connected to a master server at 127.3.136.126:46585 I0403 04:30:02.506574 3985 heartbeater.cc:426] Registering TS with master... I0403 04:30:02.507025 3985 heartbeater.cc:475] Master 127.3.136.126:46585 requested a full tablet report, sending... I0403 04:30:02.508121 3698 ts_manager.cc:159] Registered new tserver with Master: ecedc3ab196045ee8930bad21a3ee783 (127.3.136.66:38357) I0403 04:30:02.509075 3698 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.66:59995 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:02.638025 3988 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:02.638267 3988 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:02.640331 3988 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:02.640466 3988 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.67 I0403 04:30:02.643987 3988 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.67:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --webserver_interface=127.3.136.67 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.67 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:02.650420 3988 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 203135us I0403 04:30:02.651021 3988 fs_manager.cc:263] Metadata directory not provided I0403 04:30:02.651113 3988 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:02.651377 3988 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:02.651464 3988 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:02.653614 3988 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/data/instance: uuid: "483a2fe0451049d7aa9c1ecf522b5f34" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.654172 3988 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/wal/instance: uuid: "483a2fe0451049d7aa9c1ecf522b5f34" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.659993 3988 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s I0403 04:30:02.661067 3988 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:02.661586 3988 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:02.664191 3988 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0403 04:30:02.664264 3988 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/wal uuid: "483a2fe0451049d7aa9c1ecf522b5f34" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.664436 3988 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:02.714437 3988 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:02.715976 3988 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:02.716032 3988 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:02.741817 3988 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.67:42747 I0403 04:30:02.742919 3988 webserver.cc:308] Webserver started at http://127.3.136.67:37863/ using document root and password file I0403 04:30:02.743505 3988 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-2/data/info.pb I0403 04:30:02.748180 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 3988 I0403 04:30:02.748760 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/data --block_manager=log --rpc_bind_addresses=127.3.136.68:0 --local_ip_for_outbound_sockets=127.3.136.68 --webserver_interface=127.3.136.68 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:02.756388 4107 heartbeater.cc:345] Connected to a master server at 127.3.136.126:46585 I0403 04:30:02.756600 4107 heartbeater.cc:426] Registering TS with master... I0403 04:30:02.757172 4107 heartbeater.cc:475] Master 127.3.136.126:46585 requested a full tablet report, sending... I0403 04:30:02.758229 3698 ts_manager.cc:159] Registered new tserver with Master: 483a2fe0451049d7aa9c1ecf522b5f34 (127.3.136.67:42747) I0403 04:30:02.759133 3698 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.67:56985 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:02.893419 4110 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:02.893666 4110 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:02.895973 4110 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:02.896121 4110 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.68 I0403 04:30:02.899973 4110 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.68:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/data/info.pb --webserver_interface=127.3.136.68 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.68 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:02.907135 4110 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 203135us I0403 04:30:02.907778 4110 fs_manager.cc:263] Metadata directory not provided I0403 04:30:02.907907 4110 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:02.908222 4110 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:02.908320 4110 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:02.910624 4110 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/data/instance: uuid: "044ea632909f48798d31d12121175e22" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.911348 4110 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/wal/instance: uuid: "044ea632909f48798d31d12121175e22" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.917367 4110 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s I0403 04:30:02.918596 4110 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:02.919162 4110 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:02.921800 4110 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0403 04:30:02.921902 4110 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/wal uuid: "044ea632909f48798d31d12121175e22" format_stamp: "Formatted at 2019-04-03 04:30:02 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:02.922070 4110 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:02.955701 4110 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:02.957239 4110 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:02.957300 4110 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:02.982578 4110 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.68:33265 I0403 04:30:02.983513 4110 webserver.cc:308] Webserver started at http://127.3.136.68:40035/ using document root and password file I0403 04:30:02.984067 4110 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-3/data/info.pb I0403 04:30:02.989050 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 4110 I0403 04:30:02.989742 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/data --block_manager=log --rpc_bind_addresses=127.3.136.69:0 --local_ip_for_outbound_sockets=127.3.136.69 --webserver_interface=127.3.136.69 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:02.997603 4229 heartbeater.cc:345] Connected to a master server at 127.3.136.126:46585 I0403 04:30:02.997771 4229 heartbeater.cc:426] Registering TS with master... I0403 04:30:02.998235 4229 heartbeater.cc:475] Master 127.3.136.126:46585 requested a full tablet report, sending... I0403 04:30:02.999182 3698 ts_manager.cc:159] Registered new tserver with Master: 044ea632909f48798d31d12121175e22 (127.3.136.68:33265) I0403 04:30:03.000083 3698 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.68:50673 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:03.134611 4232 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:03.134825 4232 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:03.137753 4232 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:03.137900 4232 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.69 I0403 04:30:03.141630 4232 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.69:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/data/info.pb --webserver_interface=127.3.136.69 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46585 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.69 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:03.148378 4232 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 203635us I0403 04:30:03.148936 4232 fs_manager.cc:263] Metadata directory not provided I0403 04:30:03.149024 4232 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:03.149274 4232 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:03.149376 4232 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:03.151585 4232 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/data/instance: uuid: "4113b93e9c344be3b7525177662acbec" format_stamp: "Formatted at 2019-04-03 04:30:03 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:03.152117 4232 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/wal/instance: uuid: "4113b93e9c344be3b7525177662acbec" format_stamp: "Formatted at 2019-04-03 04:30:03 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:03.158946 4232 fs_manager.cc:503] Time spent creating directory manager: real 0.007s user 0.003s sys 0.005s I0403 04:30:03.160110 4232 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:03.160634 4232 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:03.163161 4232 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.001s I0403 04:30:03.163231 4232 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/wal uuid: "4113b93e9c344be3b7525177662acbec" format_stamp: "Formatted at 2019-04-03 04:30:03 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:03.163422 4232 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:03.197708 4232 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:03.199348 4232 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:03.199440 4232 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:03.230479 4232 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.69:45129 I0403 04:30:03.231370 4232 webserver.cc:308] Webserver started at http://127.3.136.69:33495/ using document root and password file I0403 04:30:03.231954 4232 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenAutoFlushBackgroundRandom.1554265799459872-3617/minicluster-data/ts-4/data/info.pb I0403 04:30:03.240571 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 4232 I0403 04:30:03.251197 4351 heartbeater.cc:345] Connected to a master server at 127.3.136.126:46585 I0403 04:30:03.251379 4351 heartbeater.cc:426] Registering TS with master... I0403 04:30:03.251824 4351 heartbeater.cc:475] Master 127.3.136.126:46585 requested a full tablet report, sending... I0403 04:30:03.252880 3698 ts_manager.cc:159] Registered new tserver with Master: 4113b93e9c344be3b7525177662acbec (127.3.136.69:45129) I0403 04:30:03.254377 3698 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.69:33683 I0403 04:30:03.260928 3862 heartbeater.cc:467] Master 127.3.136.126:46585 was elected leader, sending a full tablet report... I0403 04:30:03.263748 3617 external_mini_cluster.cc:623] 5 TS(s) registered with all masters I0403 04:30:03.281627 3698 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53470: name: "bench_auto_flush_background_random" schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "bool_val" type: BOOL is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int8_val" type: INT8 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int16_val" type: INT16 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int32_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int64_val" type: INT64 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "float_val" type: FLOAT is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "double_val" type: DOUBLE is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "decimal32_val" type: DECIMAL32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 9 scale: 9 } } columns { name: "decimal64_val" type: DECIMAL64 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 18 scale: 2 } } columns { name: "decimal128_val" type: DECIMAL128 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 type_attributes { precision: 38 scale: 0 } } columns { name: "unixtime_micros_val" type: UNIXTIME_MICROS is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "binary_val" type: BINARY is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 5 split_rows_range_bounds { } partition_schema { hash_bucket_schemas { columns { name: "key" } num_buckets: 2 seed: 0 } } W0403 04:30:03.287793 3698 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table bench_auto_flush_background_random in case of a server failure: 6 tablet servers would be needed, 5 are available. Consider bringing up more tablet servers. I0403 04:30:03.315788 3921 tablet_service.cc:1006] Processing CreateTablet for tablet ecb404942614408494c7d83555d13b9c (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.315791 3922 tablet_service.cc:1006] Processing CreateTablet for tablet de3b0c305fac4d36b985d1fb4d9aaec7 (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.317330 3921 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ecb404942614408494c7d83555d13b9c. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.318018 3922 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet de3b0c305fac4d36b985d1fb4d9aaec7. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.327868 3799 tablet_service.cc:1006] Processing CreateTablet for tablet de3b0c305fac4d36b985d1fb4d9aaec7 (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.327955 4166 tablet_service.cc:1006] Processing CreateTablet for tablet de3b0c305fac4d36b985d1fb4d9aaec7 (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.328709 3799 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet de3b0c305fac4d36b985d1fb4d9aaec7. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.328817 4166 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet de3b0c305fac4d36b985d1fb4d9aaec7. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.334826 4165 tablet_service.cc:1006] Processing CreateTablet for tablet ecb404942614408494c7d83555d13b9c (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.335274 4165 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ecb404942614408494c7d83555d13b9c. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.338815 3798 tablet_service.cc:1006] Processing CreateTablet for tablet ecb404942614408494c7d83555d13b9c (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.339221 3798 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ecb404942614408494c7d83555d13b9c. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.348522 4288 tablet_service.cc:1006] Processing CreateTablet for tablet de3b0c305fac4d36b985d1fb4d9aaec7 (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.349404 4288 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet de3b0c305fac4d36b985d1fb4d9aaec7. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.358698 4287 tablet_service.cc:1006] Processing CreateTablet for tablet ecb404942614408494c7d83555d13b9c (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.359063 4287 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ecb404942614408494c7d83555d13b9c. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.360700 4044 tablet_service.cc:1006] Processing CreateTablet for tablet de3b0c305fac4d36b985d1fb4d9aaec7 (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.361523 4044 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet de3b0c305fac4d36b985d1fb4d9aaec7. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.370626 4376 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec: Bootstrap starting. I0403 04:30:03.372304 4043 tablet_service.cc:1006] Processing CreateTablet for tablet ecb404942614408494c7d83555d13b9c (table=bench_auto_flush_background_random [id=2d4d2cde65f84acea127b23a7bd6e7a8]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0403 04:30:03.372714 4043 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ecb404942614408494c7d83555d13b9c. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:03.381238 4377 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34: Bootstrap starting. I0403 04:30:03.382411 4375 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22: Bootstrap starting. I0403 04:30:03.384968 4375 tablet_bootstrap.cc:590] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22: No blocks or log segments found. Creating new log. I0403 04:30:03.385939 4374 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74: Bootstrap starting. I0403 04:30:03.388278 4374 tablet_bootstrap.cc:590] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74: No blocks or log segments found. Creating new log. I0403 04:30:03.389266 4374 log.cc:525] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74: Log is configured to *not* fsync() on all Append() calls I0403 04:30:03.391597 4373 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783: Bootstrap starting. I0403 04:30:03.393610 4373 tablet_bootstrap.cc:590] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783: No blocks or log segments found. Creating new log. I0403 04:30:03.395278 4377 tablet_bootstrap.cc:590] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34: No blocks or log segments found. Creating new log. I0403 04:30:03.396045 4377 log.cc:525] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34: Log is configured to *not* fsync() on all Append() calls I0403 04:30:03.397604 4376 tablet_bootstrap.cc:590] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec: No blocks or log segments found. Creating new log. I0403 04:30:03.398409 4376 log.cc:525] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec: Log is configured to *not* fsync() on all Append() calls I0403 04:30:03.399861 4376 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec: No bootstrap required, opened a new log I0403 04:30:03.400131 4376 ts_tablet_manager.cc:1053] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec: Time spent bootstrapping tablet: real 0.030s user 0.002s sys 0.002s I0403 04:30:03.403229 4375 log.cc:525] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22: Log is configured to *not* fsync() on all Append() calls I0403 04:30:03.403610 4374 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74: No bootstrap required, opened a new log I0403 04:30:03.403901 4374 ts_tablet_manager.cc:1053] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74: Time spent bootstrapping tablet: real 0.046s user 0.005s sys 0.000s I0403 04:30:03.404528 4373 log.cc:525] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783: Log is configured to *not* fsync() on all Append() calls I0403 04:30:03.403385 4377 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34: No bootstrap required, opened a new log I0403 04:30:03.404898 4377 ts_tablet_manager.cc:1053] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34: Time spent bootstrapping tablet: real 0.024s user 0.004s sys 0.000s I0403 04:30:03.407202 4375 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22: No bootstrap required, opened a new log I0403 04:30:03.408172 4375 ts_tablet_manager.cc:1053] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22: Time spent bootstrapping tablet: real 0.025s user 0.000s sys 0.005s I0403 04:30:03.411129 4373 tablet_bootstrap.cc:439] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783: No bootstrap required, opened a new log I0403 04:30:03.411376 4373 ts_tablet_manager.cc:1053] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783: Time spent bootstrapping tablet: real 0.020s user 0.003s sys 0.006s I0403 04:30:03.412744 4376 raft_consensus.cc:340] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.413259 4376 raft_consensus.cc:366] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.413345 4376 raft_consensus.cc:705] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4113b93e9c344be3b7525177662acbec, State: Initialized, Role: FOLLOWER I0403 04:30:03.413858 4374 raft_consensus.cc:340] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.414400 4374 raft_consensus.cc:366] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.414502 4374 raft_consensus.cc:705] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11450928935045a4ba6b3fe1f6abdc74, State: Initialized, Role: FOLLOWER I0403 04:30:03.415128 4374 consensus_queue.cc:229] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.416183 4377 raft_consensus.cc:340] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.416657 4377 raft_consensus.cc:366] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.416728 4377 raft_consensus.cc:705] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483a2fe0451049d7aa9c1ecf522b5f34, State: Initialized, Role: FOLLOWER I0403 04:30:03.417218 4377 consensus_queue.cc:229] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.418475 4107 heartbeater.cc:467] Master 127.3.136.126:46585 was elected leader, sending a full tablet report... I0403 04:30:03.418678 4376 consensus_queue.cc:229] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.419620 4351 heartbeater.cc:467] Master 127.3.136.126:46585 was elected leader, sending a full tablet report... I0403 04:30:03.420789 4377 ts_tablet_manager.cc:1081] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34: Time spent starting tablet: real 0.016s user 0.009s sys 0.004s I0403 04:30:03.421082 4377 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34: Bootstrap starting. I0403 04:30:03.421370 4373 raft_consensus.cc:340] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.421856 4373 raft_consensus.cc:366] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.421933 4373 raft_consensus.cc:705] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecedc3ab196045ee8930bad21a3ee783, State: Initialized, Role: FOLLOWER I0403 04:30:03.422469 4373 consensus_queue.cc:229] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.422792 4376 ts_tablet_manager.cc:1081] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec: Time spent starting tablet: real 0.023s user 0.009s sys 0.002s I0403 04:30:03.423121 4376 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec: Bootstrap starting. I0403 04:30:03.423154 4377 tablet_bootstrap.cc:590] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34: No blocks or log segments found. Creating new log. I0403 04:30:03.424590 4376 tablet_bootstrap.cc:590] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec: No blocks or log segments found. Creating new log. I0403 04:30:03.425786 3985 heartbeater.cc:467] Master 127.3.136.126:46585 was elected leader, sending a full tablet report... I0403 04:30:03.425583 4375 raft_consensus.cc:340] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.426164 4375 raft_consensus.cc:366] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.426226 4375 raft_consensus.cc:705] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044ea632909f48798d31d12121175e22, State: Initialized, Role: FOLLOWER I0403 04:30:03.427973 4376 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec: No bootstrap required, opened a new log I0403 04:30:03.427984 4374 ts_tablet_manager.cc:1081] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74: Time spent starting tablet: real 0.024s user 0.005s sys 0.008s I0403 04:30:03.428107 4376 ts_tablet_manager.cc:1053] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec: Time spent bootstrapping tablet: real 0.005s user 0.002s sys 0.001s I0403 04:30:03.428925 4376 raft_consensus.cc:340] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.429239 4376 raft_consensus.cc:366] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.429306 4376 raft_consensus.cc:705] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4113b93e9c344be3b7525177662acbec, State: Initialized, Role: FOLLOWER I0403 04:30:03.429543 4377 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34: No bootstrap required, opened a new log I0403 04:30:03.429674 4377 ts_tablet_manager.cc:1053] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34: Time spent bootstrapping tablet: real 0.009s user 0.002s sys 0.000s I0403 04:30:03.429571 4376 consensus_queue.cc:229] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.430037 4374 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74: Bootstrap starting. I0403 04:30:03.430462 4373 ts_tablet_manager.cc:1081] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783: Time spent starting tablet: real 0.019s user 0.005s sys 0.010s I0403 04:30:03.430794 4373 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783: Bootstrap starting. I0403 04:30:03.430624 4377 raft_consensus.cc:340] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.430866 4377 raft_consensus.cc:366] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.430943 4377 raft_consensus.cc:705] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 483a2fe0451049d7aa9c1ecf522b5f34, State: Initialized, Role: FOLLOWER I0403 04:30:03.431205 4377 consensus_queue.cc:229] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.432039 4374 tablet_bootstrap.cc:590] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74: No blocks or log segments found. Creating new log. I0403 04:30:03.432257 4373 tablet_bootstrap.cc:590] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783: No blocks or log segments found. Creating new log. I0403 04:30:03.433104 4377 ts_tablet_manager.cc:1081] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s I0403 04:30:03.426738 4375 consensus_queue.cc:229] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.434446 4373 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783: No bootstrap required, opened a new log I0403 04:30:03.434824 4229 heartbeater.cc:467] Master 127.3.136.126:46585 was elected leader, sending a full tablet report... I0403 04:30:03.434834 4376 ts_tablet_manager.cc:1081] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec: Time spent starting tablet: real 0.007s user 0.000s sys 0.002s I0403 04:30:03.434983 4373 ts_tablet_manager.cc:1053] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0403 04:30:03.435680 4373 raft_consensus.cc:340] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.435868 4373 raft_consensus.cc:366] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.435925 4375 ts_tablet_manager.cc:1081] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22: Time spent starting tablet: real 0.028s user 0.011s sys 0.002s I0403 04:30:03.435932 4373 raft_consensus.cc:705] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ecedc3ab196045ee8930bad21a3ee783, State: Initialized, Role: FOLLOWER I0403 04:30:03.436250 4375 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22: Bootstrap starting. I0403 04:30:03.436170 4373 consensus_queue.cc:229] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.438277 4375 tablet_bootstrap.cc:590] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22: No blocks or log segments found. Creating new log. I0403 04:30:03.438289 4374 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74: No bootstrap required, opened a new log I0403 04:30:03.438503 4374 ts_tablet_manager.cc:1053] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.000s I0403 04:30:03.438851 4373 ts_tablet_manager.cc:1081] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783: Time spent starting tablet: real 0.004s user 0.001s sys 0.001s I0403 04:30:03.439393 4374 raft_consensus.cc:340] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.439647 4374 raft_consensus.cc:366] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.439723 4374 raft_consensus.cc:705] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 11450928935045a4ba6b3fe1f6abdc74, State: Initialized, Role: FOLLOWER I0403 04:30:03.439963 4374 consensus_queue.cc:229] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.440337 4375 tablet_bootstrap.cc:439] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22: No bootstrap required, opened a new log I0403 04:30:03.440479 4375 ts_tablet_manager.cc:1053] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0403 04:30:03.440665 4374 ts_tablet_manager.cc:1081] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0403 04:30:03.441241 4375 raft_consensus.cc:340] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.441519 4375 raft_consensus.cc:366] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:03.441603 4375 raft_consensus.cc:705] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 044ea632909f48798d31d12121175e22, State: Initialized, Role: FOLLOWER I0403 04:30:03.441900 4375 consensus_queue.cc:229] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.442620 4375 ts_tablet_manager.cc:1081] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0403 04:30:03.473134 4383 raft_consensus.cc:472] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0403 04:30:03.473328 4383 raft_consensus.cc:494] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.474869 4383 leader_election.cc:296] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecedc3ab196045ee8930bad21a3ee783 (127.3.136.66:38357), 044ea632909f48798d31d12121175e22 (127.3.136.68:33265), 483a2fe0451049d7aa9c1ecf522b5f34 (127.3.136.67:42747), 4113b93e9c344be3b7525177662acbec (127.3.136.69:45129) W0403 04:30:03.482149 3863 tablet.cc:1786] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:30:03.482728 4384 raft_consensus.cc:472] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0403 04:30:03.482949 4384 raft_consensus.cc:494] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } W0403 04:30:03.483481 4352 tablet.cc:1786] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:30:03.485303 4230 tablet.cc:1786] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:30:03.484623 4384 leader_election.cc:296] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ecedc3ab196045ee8930bad21a3ee783 (127.3.136.66:38357), 044ea632909f48798d31d12121175e22 (127.3.136.68:33265), 11450928935045a4ba6b3fe1f6abdc74 (127.3.136.65:40453), 4113b93e9c344be3b7525177662acbec (127.3.136.69:45129) I0403 04:30:03.491164 4385 raft_consensus.cc:472] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0403 04:30:03.491359 4385 raft_consensus.cc:494] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.492898 4385 leader_election.cc:296] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 11450928935045a4ba6b3fe1f6abdc74 (127.3.136.65:40453), 044ea632909f48798d31d12121175e22 (127.3.136.68:33265), ecedc3ab196045ee8930bad21a3ee783 (127.3.136.66:38357), 483a2fe0451049d7aa9c1ecf522b5f34 (127.3.136.67:42747) W0403 04:30:03.495211 3986 tablet.cc:1786] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:30:03.495524 4108 tablet.cc:1786] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:30:03.512915 4186 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044ea632909f48798d31d12121175e22" is_pre_election: true I0403 04:30:03.513363 4186 raft_consensus.cc:2346] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in term 0. I0403 04:30:03.514235 3942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecedc3ab196045ee8930bad21a3ee783" is_pre_election: true I0403 04:30:03.514653 3942 raft_consensus.cc:2346] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in term 0. I0403 04:30:03.515208 3997 leader_election.cc:310] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 044ea632909f48798d31d12121175e22, 483a2fe0451049d7aa9c1ecf522b5f34, ecedc3ab196045ee8930bad21a3ee783; no voters: I0403 04:30:03.515542 4383 raft_consensus.cc:472] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0403 04:30:03.515735 4384 raft_consensus.cc:2640] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0403 04:30:03.515832 4384 raft_consensus.cc:472] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0403 04:30:03.515708 4383 raft_consensus.cc:494] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.515985 4384 raft_consensus.cc:2886] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.516957 4383 leader_election.cc:296] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 044ea632909f48798d31d12121175e22 (127.3.136.68:33265), ecedc3ab196045ee8930bad21a3ee783 (127.3.136.66:38357), 4113b93e9c344be3b7525177662acbec (127.3.136.69:45129), 483a2fe0451049d7aa9c1ecf522b5f34 (127.3.136.67:42747) I0403 04:30:03.517184 4308 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4113b93e9c344be3b7525177662acbec" is_pre_election: true I0403 04:30:03.517566 4308 raft_consensus.cc:2346] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in term 0. I0403 04:30:03.520159 4384 raft_consensus.cc:494] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.521710 4384 leader_election.cc:296] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [CANDIDATE]: Term 1 election: Requested vote from peers ecedc3ab196045ee8930bad21a3ee783 (127.3.136.66:38357), 044ea632909f48798d31d12121175e22 (127.3.136.68:33265), 11450928935045a4ba6b3fe1f6abdc74 (127.3.136.65:40453), 4113b93e9c344be3b7525177662acbec (127.3.136.69:45129) I0403 04:30:03.522356 4186 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044ea632909f48798d31d12121175e22" I0403 04:30:03.522557 4186 raft_consensus.cc:2886] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.523929 3819 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11450928935045a4ba6b3fe1f6abdc74" is_pre_election: true I0403 04:30:03.524327 3818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11450928935045a4ba6b3fe1f6abdc74" I0403 04:30:03.524368 3819 raft_consensus.cc:2346] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in term 0. I0403 04:30:03.525066 3818 raft_consensus.cc:2321] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Leader election vote request: Denying vote to candidate 483a2fe0451049d7aa9c1ecf522b5f34 for term 1 because replica is already servicing an update from a current leader or another vote. I0403 04:30:03.525306 4186 raft_consensus.cc:2346] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in term 1. I0403 04:30:03.525959 3942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecedc3ab196045ee8930bad21a3ee783" is_pre_election: true I0403 04:30:03.526171 3942 raft_consensus.cc:2346] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 0. I0403 04:30:03.526335 4308 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4113b93e9c344be3b7525177662acbec" I0403 04:30:03.526512 4308 raft_consensus.cc:2886] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.526827 3942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecedc3ab196045ee8930bad21a3ee783" is_pre_election: true I0403 04:30:03.526983 3942 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 0. I0403 04:30:03.528720 3942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecedc3ab196045ee8930bad21a3ee783" I0403 04:30:03.528865 3942 raft_consensus.cc:2886] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.530665 4186 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044ea632909f48798d31d12121175e22" is_pre_election: true I0403 04:30:03.530798 4185 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044ea632909f48798d31d12121175e22" is_pre_election: true I0403 04:30:03.531062 4185 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 0. I0403 04:30:03.531292 4186 raft_consensus.cc:2276] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11450928935045a4ba6b3fe1f6abdc74 in current term 1: Already voted for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in this term. I0403 04:30:03.531395 3942 raft_consensus.cc:2346] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in term 1. I0403 04:30:03.531798 3997 leader_election.cc:310] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 5 voters: 3 yes votes; 1 no votes. yes voters: 044ea632909f48798d31d12121175e22, 483a2fe0451049d7aa9c1ecf522b5f34, ecedc3ab196045ee8930bad21a3ee783; no voters: 11450928935045a4ba6b3fe1f6abdc74 I0403 04:30:03.531709 3753 leader_election.cc:310] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 044ea632909f48798d31d12121175e22, 11450928935045a4ba6b3fe1f6abdc74, ecedc3ab196045ee8930bad21a3ee783; no voters: I0403 04:30:03.532155 4384 raft_consensus.cc:2640] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:03.532251 4383 raft_consensus.cc:2640] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0403 04:30:03.532343 4383 raft_consensus.cc:472] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0403 04:30:03.532426 4383 raft_consensus.cc:2886] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.533073 4384 raft_consensus.cc:667] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 1 LEADER]: Becoming Leader. State: Replica: 483a2fe0451049d7aa9c1ecf522b5f34, State: Running, Role: LEADER I0403 04:30:03.533512 4384 consensus_queue.cc:206] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } I0403 04:30:03.535171 4308 raft_consensus.cc:2346] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in term 1. I0403 04:30:03.535967 4186 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "4113b93e9c344be3b7525177662acbec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044ea632909f48798d31d12121175e22" is_pre_election: true I0403 04:30:03.536164 4186 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4113b93e9c344be3b7525177662acbec in term 0. I0403 04:30:03.536123 4383 raft_consensus.cc:494] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.537221 4383 leader_election.cc:296] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [CANDIDATE]: Term 1 election: Requested vote from peers 044ea632909f48798d31d12121175e22 (127.3.136.68:33265), ecedc3ab196045ee8930bad21a3ee783 (127.3.136.66:38357), 4113b93e9c344be3b7525177662acbec (127.3.136.69:45129), 483a2fe0451049d7aa9c1ecf522b5f34 (127.3.136.67:42747) I0403 04:30:03.537245 4186 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "044ea632909f48798d31d12121175e22" I0403 04:30:03.537405 4186 raft_consensus.cc:2886] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.538008 3942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecedc3ab196045ee8930bad21a3ee783" I0403 04:30:03.538235 3942 raft_consensus.cc:2886] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.539743 4186 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 1. I0403 04:30:03.540591 3942 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 1. I0403 04:30:03.542001 4064 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" is_pre_election: true I0403 04:30:03.543056 4063 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" is_pre_election: true I0403 04:30:03.543161 3752 leader_election.cc:310] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 5 voters: 3 yes votes; 0 no votes. yes voters: 044ea632909f48798d31d12121175e22, 11450928935045a4ba6b3fe1f6abdc74, ecedc3ab196045ee8930bad21a3ee783; no voters: I0403 04:30:03.543360 4063 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 0. I0403 04:30:03.543663 4383 raft_consensus.cc:2640] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:03.543889 4062 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" I0403 04:30:03.544118 4062 raft_consensus.cc:2886] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.544281 3818 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "4113b93e9c344be3b7525177662acbec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "11450928935045a4ba6b3fe1f6abdc74" is_pre_election: true I0403 04:30:03.544546 4383 raft_consensus.cc:667] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 1 LEADER]: Becoming Leader. State: Replica: 11450928935045a4ba6b3fe1f6abdc74, State: Running, Role: LEADER I0403 04:30:03.544920 4308 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "ecb404942614408494c7d83555d13b9c" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4113b93e9c344be3b7525177662acbec" is_pre_election: true I0403 04:30:03.545145 4308 raft_consensus.cc:2276] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 11450928935045a4ba6b3fe1f6abdc74 in current term 1: Already voted for candidate 483a2fe0451049d7aa9c1ecf522b5f34 in this term. I0403 04:30:03.544962 4383 consensus_queue.cc:206] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } } I0403 04:30:03.546022 4308 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4113b93e9c344be3b7525177662acbec" is_pre_election: true I0403 04:30:03.546227 4308 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 0. I0403 04:30:03.547019 4308 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "11450928935045a4ba6b3fe1f6abdc74" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4113b93e9c344be3b7525177662acbec" I0403 04:30:03.547202 4308 raft_consensus.cc:2886] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.547510 4062 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 1. I0403 04:30:03.549356 3818 raft_consensus.cc:2307] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 4113b93e9c344be3b7525177662acbec for term 1 because replica is either leader or believes a valid leader to be alive. I0403 04:30:03.549685 4308 raft_consensus.cc:2346] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 11450928935045a4ba6b3fe1f6abdc74 in term 1. I0403 04:30:03.550237 4064 raft_consensus.cc:2307] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [term 1 LEADER]: Leader pre-election vote request: Denying vote to candidate 11450928935045a4ba6b3fe1f6abdc74 for term 1 because replica is either leader or believes a valid leader to be alive. I0403 04:30:03.551192 3753 leader_election.cc:310] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 11450928935045a4ba6b3fe1f6abdc74, ecedc3ab196045ee8930bad21a3ee783; no voters: 044ea632909f48798d31d12121175e22, 4113b93e9c344be3b7525177662acbec, 483a2fe0451049d7aa9c1ecf522b5f34 I0403 04:30:03.551625 4383 raft_consensus.cc:2886] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:03.551072 3696 catalog_manager.cc:3977] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 reported cstate change: term changed from 0 to 1, leader changed from to 11450928935045a4ba6b3fe1f6abdc74 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "11450928935045a4ba6b3fe1f6abdc74" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } health_report { overall_health: UNKNOWN } } } I0403 04:30:03.552950 3697 catalog_manager.cc:3977] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 reported cstate change: term changed from 0 to 1, leader changed from to 483a2fe0451049d7aa9c1ecf522b5f34 (127.3.136.67). New cstate: current_term: 1 leader_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 } health_report { overall_health: UNKNOWN } } } I0403 04:30:03.553936 4383 raft_consensus.cc:2588] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority I0403 04:30:03.556416 3942 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "4113b93e9c344be3b7525177662acbec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ecedc3ab196045ee8930bad21a3ee783" is_pre_election: true I0403 04:30:03.556614 3942 raft_consensus.cc:2276] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4113b93e9c344be3b7525177662acbec in current term 1: Already voted for candidate 11450928935045a4ba6b3fe1f6abdc74 in this term. I0403 04:30:03.559082 4064 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "de3b0c305fac4d36b985d1fb4d9aaec7" candidate_uuid: "4113b93e9c344be3b7525177662acbec" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" is_pre_election: true I0403 04:30:03.559257 4064 raft_consensus.cc:2276] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4113b93e9c344be3b7525177662acbec in current term 1: Already voted for candidate 11450928935045a4ba6b3fe1f6abdc74 in this term. I0403 04:30:03.559656 4242 leader_election.cc:310] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 5 responses out of 5 voters: 2 yes votes; 3 no votes. yes voters: 044ea632909f48798d31d12121175e22, 4113b93e9c344be3b7525177662acbec; no voters: 11450928935045a4ba6b3fe1f6abdc74, 483a2fe0451049d7aa9c1ecf522b5f34, ecedc3ab196045ee8930bad21a3ee783 I0403 04:30:03.560014 4385 raft_consensus.cc:2588] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority W0403 04:30:03.837361 4411 flags.cc:406] Enabled unsafe flag: --never_fsync=true Using table 'bench_auto_flush_background_random' I0403 04:30:03.905268 3818 raft_consensus.cc:1181] T ecb404942614408494c7d83555d13b9c P 11450928935045a4ba6b3fe1f6abdc74 [term 1 FOLLOWER]: Refusing update from remote peer 483a2fe0451049d7aa9c1ecf522b5f34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0403 04:30:03.905395 4308 raft_consensus.cc:1181] T ecb404942614408494c7d83555d13b9c P 4113b93e9c344be3b7525177662acbec [term 1 FOLLOWER]: Refusing update from remote peer 483a2fe0451049d7aa9c1ecf522b5f34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0403 04:30:03.906050 4064 raft_consensus.cc:1181] T de3b0c305fac4d36b985d1fb4d9aaec7 P 483a2fe0451049d7aa9c1ecf522b5f34 [term 1 FOLLOWER]: Refusing update from remote peer 11450928935045a4ba6b3fe1f6abdc74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0403 04:30:03.906172 3942 raft_consensus.cc:1181] T de3b0c305fac4d36b985d1fb4d9aaec7 P ecedc3ab196045ee8930bad21a3ee783 [term 1 FOLLOWER]: Refusing update from remote peer 11450928935045a4ba6b3fe1f6abdc74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0403 04:30:03.906396 4384 consensus_queue.cc:984] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "11450928935045a4ba6b3fe1f6abdc74" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 40453 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0403 04:30:03.907080 4308 raft_consensus.cc:1181] T de3b0c305fac4d36b985d1fb4d9aaec7 P 4113b93e9c344be3b7525177662acbec [term 1 FOLLOWER]: Refusing update from remote peer 11450928935045a4ba6b3fe1f6abdc74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0403 04:30:03.907027 4384 consensus_queue.cc:984] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0403 04:30:03.906976 4409 consensus_queue.cc:984] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "483a2fe0451049d7aa9c1ecf522b5f34" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 42747 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0403 04:30:03.907682 4409 consensus_queue.cc:984] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0403 04:30:03.907794 4186 raft_consensus.cc:1181] T de3b0c305fac4d36b985d1fb4d9aaec7 P 044ea632909f48798d31d12121175e22 [term 1 FOLLOWER]: Refusing update from remote peer 11450928935045a4ba6b3fe1f6abdc74: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0403 04:30:03.907999 4409 consensus_queue.cc:984] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4113b93e9c344be3b7525177662acbec" member_type: VOTER last_known_addr { host: "127.3.136.69" port: 45129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0403 04:30:03.908674 4428 consensus_queue.cc:984] T de3b0c305fac4d36b985d1fb4d9aaec7 P 11450928935045a4ba6b3fe1f6abdc74 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0403 04:30:03.909818 3942 raft_consensus.cc:1181] T ecb404942614408494c7d83555d13b9c P ecedc3ab196045ee8930bad21a3ee783 [term 1 FOLLOWER]: Refusing update from remote peer 483a2fe0451049d7aa9c1ecf522b5f34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0403 04:30:03.911046 4407 consensus_queue.cc:984] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ecedc3ab196045ee8930bad21a3ee783" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 38357 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0403 04:30:03.912302 4186 raft_consensus.cc:1181] T ecb404942614408494c7d83555d13b9c P 044ea632909f48798d31d12121175e22 [term 1 FOLLOWER]: Refusing update from remote peer 483a2fe0451049d7aa9c1ecf522b5f34: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch) I0403 04:30:03.916237 4427 consensus_queue.cc:984] T ecb404942614408494c7d83555d13b9c P 483a2fe0451049d7aa9c1ecf522b5f34 [LEADER]: Connected to new peer: Peer: permanent_uuid: "044ea632909f48798d31d12121175e22" member_type: VOTER last_known_addr { host: "127.3.136.68" port: 33265 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s I0403 04:30:03.942888 4426 mvcc.cc:203] Tried to move safe_time back from 6366272732791357440 to 6366272731326304256. Current Snapshot: MvccSnapshot[committed={T|T < 6366272732791357440}] I0403 04:30:03.943078 4436 mvcc.cc:203] Tried to move safe_time back from 6366272732791357440 to 6366272731326304256. Current Snapshot: MvccSnapshot[committed={T|T < 6366272732791357440}] I0403 04:30:03.947284 4431 mvcc.cc:203] Tried to move safe_time back from 6366272732791357440 to 6366272731326304256. Current Snapshot: MvccSnapshot[committed={T|T < 6366272732791357440}] I0403 04:30:03.958731 4434 mvcc.cc:203] Tried to move safe_time back from 6366272732787621888 to 6366272731279302656. Current Snapshot: MvccSnapshot[committed={T|T < 6366272732787621888}] I0403 04:30:03.977046 4448 mvcc.cc:203] Tried to move safe_time back from 6366272732791357440 to 6366272731326304256. Current Snapshot: MvccSnapshot[committed={T|T < 6366272732791357440}] Generator report time total : 105.63 ms time per row: 6.60189 ms Scanner report expected rows: 16 actual rows : 16 I0403 04:30:04.144680 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 3732 I0403 04:30:04.159507 3859 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:04.221020 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 3732 I0403 04:30:04.232538 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 3866 I0403 04:30:04.237645 3982 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:04.309010 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 3866 I0403 04:30:04.319723 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 3988 I0403 04:30:04.325137 4104 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:04.376929 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 3988 I0403 04:30:04.385793 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 4110 I0403 04:30:04.391438 4226 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:04.441771 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 4110 I0403 04:30:04.450090 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 4232 I0403 04:30:04.456182 4348 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:04.505049 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 4232 I0403 04:30:04.513758 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 3672 I0403 04:30:04.514847 3728 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:04.581138 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 3672 [ OK ] ToolTest.TestLoadgenAutoFlushBackgroundRandom (3062 ms) [ RUN ] ToolTest.TestLoadgenHmsEnabled 2019-04-03 04:30:05: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/derby.log log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-tasks9LKQH/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-tasks9LKQH/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Starting hive metastore on port 0 2738 T1 odu.Log4JLogger.info Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2752 T1 odu.Log4JLogger.info Property datanucleus.cache.level2 unknown - will be ignored I0403 04:30:15.207703 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:46817 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:15.381475 4589 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:15.381687 4589 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:15.384126 4589 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:30:15.384171 4589 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:15.384229 4589 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:30:15.384282 4589 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:30:15.388504 4589 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:46817 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:15.394429 4589 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 209635us I0403 04:30:15.395550 4589 fs_manager.cc:263] Metadata directory not provided I0403 04:30:15.395630 4589 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:15.395933 4589 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:15.396013 4589 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:15.398877 4589 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "77c8a5045689493587ca6e1a94ec8142" format_stamp: "Formatted at 2019-04-03 04:30:15 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:15.399456 4589 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "77c8a5045689493587ca6e1a94ec8142" format_stamp: "Formatted at 2019-04-03 04:30:15 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:15.405577 4589 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s I0403 04:30:15.406709 4589 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:15.407245 4589 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:15.410084 4589 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:15.410140 4589 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/wal uuid: "77c8a5045689493587ca6e1a94ec8142" format_stamp: "Formatted at 2019-04-03 04:30:15 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:15.410284 4589 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:15.458637 4589 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:15.472103 4589 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:46817 I0403 04:30:15.473044 4589 webserver.cc:308] Webserver started at http://127.3.136.126:37507/ using document root and password file I0403 04:30:15.473630 4589 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:30:15.476514 4648 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:15.477241 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 4589 I0403 04:30:15.478135 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.3.136.65:0 --local_ip_for_outbound_sockets=127.3.136.65 --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46817 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:15.487488 4648 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Bootstrap starting. I0403 04:30:15.497938 4648 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: No blocks or log segments found. Creating new log. I0403 04:30:15.498838 4648 log.cc:525] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Log is configured to *not* fsync() on all Append() calls I0403 04:30:15.507097 4648 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: No bootstrap required, opened a new log I0403 04:30:15.517338 4648 raft_consensus.cc:340] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c8a5045689493587ca6e1a94ec8142" member_type: VOTER } I0403 04:30:15.517673 4648 raft_consensus.cc:366] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:15.517755 4648 raft_consensus.cc:705] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77c8a5045689493587ca6e1a94ec8142, State: Initialized, Role: FOLLOWER I0403 04:30:15.518405 4648 consensus_queue.cc:229] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c8a5045689493587ca6e1a94ec8142" member_type: VOTER } I0403 04:30:15.518631 4648 raft_consensus.cc:380] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:15.518731 4648 raft_consensus.cc:472] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:15.518854 4648 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:15.521201 4648 raft_consensus.cc:494] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c8a5045689493587ca6e1a94ec8142" member_type: VOTER } I0403 04:30:15.521677 4648 leader_election.cc:310] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 77c8a5045689493587ca6e1a94ec8142; no voters: I0403 04:30:15.522554 4651 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:15.522928 4648 leader_election.cc:296] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:15.523803 4651 raft_consensus.cc:667] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [term 1 LEADER]: Becoming Leader. State: Replica: 77c8a5045689493587ca6e1a94ec8142, State: Running, Role: LEADER I0403 04:30:15.524216 4651 consensus_queue.cc:206] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c8a5045689493587ca6e1a94ec8142" member_type: VOTER } I0403 04:30:15.527736 4653 sys_catalog.cc:337] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 77c8a5045689493587ca6e1a94ec8142. Latest consensus state: current_term: 1 leader_uuid: "77c8a5045689493587ca6e1a94ec8142" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c8a5045689493587ca6e1a94ec8142" member_type: VOTER } } I0403 04:30:15.528750 4653 sys_catalog.cc:340] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [sys.catalog]: This master's current role is: LEADER I0403 04:30:15.528802 4648 sys_catalog.cc:337] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "77c8a5045689493587ca6e1a94ec8142" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c8a5045689493587ca6e1a94ec8142" member_type: VOTER } } I0403 04:30:15.528501 4652 sys_catalog.cc:337] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "77c8a5045689493587ca6e1a94ec8142" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "77c8a5045689493587ca6e1a94ec8142" member_type: VOTER } } I0403 04:30:15.529063 4648 sys_catalog.cc:340] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [sys.catalog]: This master's current role is: LEADER I0403 04:30:15.530736 4648 sys_catalog.cc:424] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:15.529165 4652 sys_catalog.cc:340] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142 [sys.catalog]: This master's current role is: LEADER I0403 04:30:15.531590 4657 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:15.533398 4658 catalog_manager.cc:536] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting I0403 04:30:15.536245 4657 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:15.591898 4657 catalog_manager.cc:950] Generated new certificate authority record I0403 04:30:15.593216 4657 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:15.602238 4657 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:15.680457 4649 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:15.680733 4649 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:15.684159 4649 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:15.684324 4649 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.65 I0403 04:30:15.690618 4649 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.65:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:46817 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.65 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:15.700532 4649 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 209635us I0403 04:30:15.701290 4649 fs_manager.cc:263] Metadata directory not provided I0403 04:30:15.701409 4649 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:15.701746 4649 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:15.701875 4649 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:15.705111 4649 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "6d6620f761814204a26502e29a199ab7" format_stamp: "Formatted at 2019-04-03 04:30:15 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:15.705974 4649 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "6d6620f761814204a26502e29a199ab7" format_stamp: "Formatted at 2019-04-03 04:30:15 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:15.719534 4649 fs_manager.cc:503] Time spent creating directory manager: real 0.013s user 0.008s sys 0.004s I0403 04:30:15.721024 4649 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:15.721700 4649 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:15.727452 4649 fs_manager.cc:419] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s I0403 04:30:15.727528 4649 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "6d6620f761814204a26502e29a199ab7" format_stamp: "Formatted at 2019-04-03 04:30:15 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:15.727731 4649 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:15.798355 4649 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:15.800498 4649 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:15.800565 4649 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:15.829599 4649 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:39877 I0403 04:30:15.830976 4649 webserver.cc:308] Webserver started at http://127.3.136.65:41521/ using document root and password file I0403 04:30:15.831768 4649 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:30:15.836722 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 4649 I0403 04:30:15.852998 4779 heartbeater.cc:345] Connected to a master server at 127.3.136.126:46817 I0403 04:30:15.853219 4779 heartbeater.cc:426] Registering TS with master... I0403 04:30:15.853752 4779 heartbeater.cc:475] Master 127.3.136.126:46817 requested a full tablet report, sending... I0403 04:30:15.855537 4615 ts_manager.cc:159] Registered new tserver with Master: 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) I0403 04:30:15.857568 4615 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.65:56089 I0403 04:30:15.857650 3617 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0403 04:30:16.112743 4615 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36614: name: "default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60" schema { columns { name: "key" type: INT64 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { hash_bucket_schemas { columns { name: "key" } num_buckets: 8 seed: 0 } } I0403 04:30:16.142957 4711 tablet_service.cc:1006] Processing CreateTablet for tablet 4ba297fa8e1e475d87d6cd01c57615d2 (table=default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]), partition=HASH (key) PARTITION 5, RANGE (key) PARTITION UNBOUNDED I0403 04:30:16.142781 4709 tablet_service.cc:1006] Processing CreateTablet for tablet b68ca8195f294cb29beac1261fc88ee7 (table=default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]), partition=HASH (key) PARTITION 7, RANGE (key) PARTITION UNBOUNDED I0403 04:30:16.143033 4713 tablet_service.cc:1006] Processing CreateTablet for tablet bebe1f9ee5644cc5a6a3f9a21b1fc8aa (table=default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]), partition=HASH (key) PARTITION 3, RANGE (key) PARTITION UNBOUNDED I0403 04:30:16.143477 4715 tablet_service.cc:1006] Processing CreateTablet for tablet 0e9d1943a8a24c80893fa2b98d1aa24e (table=default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]), partition=HASH (key) PARTITION 1, RANGE (key) PARTITION UNBOUNDED I0403 04:30:16.143545 4710 tablet_service.cc:1006] Processing CreateTablet for tablet f159e2b79e934aeab5a4a0ad5ac877ee (table=default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]), partition=HASH (key) PARTITION 6, RANGE (key) PARTITION UNBOUNDED I0403 04:30:16.143100 4714 tablet_service.cc:1006] Processing CreateTablet for tablet dc1fbe5fca484c9d897dd97bbd009f71 (table=default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]), partition=HASH (key) PARTITION 2, RANGE (key) PARTITION UNBOUNDED I0403 04:30:16.144158 4711 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 4ba297fa8e1e475d87d6cd01c57615d2. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:16.143903 4712 tablet_service.cc:1006] Processing CreateTablet for tablet c75e1d213af7404eb9b378aa601d88e1 (table=default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]), partition=HASH (key) PARTITION 4, RANGE (key) PARTITION UNBOUNDED I0403 04:30:16.143483 4716 tablet_service.cc:1006] Processing CreateTablet for tablet 9396bf196c824a0baaf1ed6843c5f6aa (table=default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]), partition=HASH (key) PARTITION 0, RANGE (key) PARTITION UNBOUNDED I0403 04:30:16.144985 4713 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet bebe1f9ee5644cc5a6a3f9a21b1fc8aa. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:16.145284 4714 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet dc1fbe5fca484c9d897dd97bbd009f71. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:16.145958 4710 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f159e2b79e934aeab5a4a0ad5ac877ee. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:16.146674 4715 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0e9d1943a8a24c80893fa2b98d1aa24e. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:16.147127 4709 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet b68ca8195f294cb29beac1261fc88ee7. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:16.147506 4716 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 9396bf196c824a0baaf1ed6843c5f6aa. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:16.148027 4712 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c75e1d213af7404eb9b378aa601d88e1. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:16.183431 4800 tablet_bootstrap.cc:439] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: Bootstrap starting. I0403 04:30:16.185575 4800 tablet_bootstrap.cc:590] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: No blocks or log segments found. Creating new log. I0403 04:30:16.186751 4800 log.cc:525] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: Log is configured to *not* fsync() on all Append() calls I0403 04:30:16.187980 4800 tablet_bootstrap.cc:439] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: No bootstrap required, opened a new log I0403 04:30:16.188218 4800 ts_tablet_manager.cc:1053] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s I0403 04:30:16.194047 4800 raft_consensus.cc:340] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.194392 4800 raft_consensus.cc:366] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:16.194448 4800 raft_consensus.cc:705] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Initialized, Role: FOLLOWER I0403 04:30:16.194789 4800 consensus_queue.cc:229] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.194980 4800 raft_consensus.cc:380] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:16.195053 4800 raft_consensus.cc:472] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:16.195152 4800 raft_consensus.cc:2886] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:16.196720 4800 raft_consensus.cc:494] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.197022 4800 leader_election.cc:310] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6620f761814204a26502e29a199ab7; no voters: I0403 04:30:16.197574 4802 raft_consensus.cc:2640] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:16.197942 4800 leader_election.cc:296] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:16.198628 4779 heartbeater.cc:467] Master 127.3.136.126:46817 was elected leader, sending a full tablet report... I0403 04:30:16.198618 4802 raft_consensus.cc:667] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Running, Role: LEADER I0403 04:30:16.198976 4802 consensus_queue.cc:206] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.200536 4800 ts_tablet_manager.cc:1081] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: Time spent starting tablet: real 0.012s user 0.011s sys 0.000s I0403 04:30:16.200834 4800 tablet_bootstrap.cc:439] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: Bootstrap starting. I0403 04:30:16.202469 4800 tablet_bootstrap.cc:590] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: No blocks or log segments found. Creating new log. I0403 04:30:16.202776 4615 catalog_manager.cc:3977] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 reported cstate change: term changed from 0 to 1, leader changed from to 6d6620f761814204a26502e29a199ab7 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "6d6620f761814204a26502e29a199ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } health_report { overall_health: HEALTHY } } } I0403 04:30:16.204244 4800 tablet_bootstrap.cc:439] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: No bootstrap required, opened a new log I0403 04:30:16.204377 4800 ts_tablet_manager.cc:1053] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: Time spent bootstrapping tablet: real 0.004s user 0.000s sys 0.003s I0403 04:30:16.205096 4800 raft_consensus.cc:340] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.205205 4800 raft_consensus.cc:366] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:16.205277 4800 raft_consensus.cc:705] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Initialized, Role: FOLLOWER I0403 04:30:16.205814 4800 consensus_queue.cc:229] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.205989 4800 raft_consensus.cc:380] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:16.206054 4800 raft_consensus.cc:472] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:16.206146 4800 raft_consensus.cc:2886] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:16.207909 4800 raft_consensus.cc:494] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.208112 4800 leader_election.cc:310] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6620f761814204a26502e29a199ab7; no voters: I0403 04:30:16.208348 4800 leader_election.cc:296] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:16.208420 4802 raft_consensus.cc:2640] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:16.208583 4802 raft_consensus.cc:667] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Running, Role: LEADER I0403 04:30:16.208902 4800 ts_tablet_manager.cc:1081] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: Time spent starting tablet: real 0.004s user 0.003s sys 0.002s I0403 04:30:16.208765 4802 consensus_queue.cc:206] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.209165 4800 tablet_bootstrap.cc:439] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: Bootstrap starting. I0403 04:30:16.210919 4800 tablet_bootstrap.cc:590] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: No blocks or log segments found. Creating new log. I0403 04:30:16.211194 4615 catalog_manager.cc:3977] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 reported cstate change: term changed from 0 to 1, leader changed from to 6d6620f761814204a26502e29a199ab7 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "6d6620f761814204a26502e29a199ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } health_report { overall_health: HEALTHY } } } I0403 04:30:16.212404 4800 tablet_bootstrap.cc:439] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: No bootstrap required, opened a new log I0403 04:30:16.212533 4800 ts_tablet_manager.cc:1053] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s I0403 04:30:16.213122 4800 raft_consensus.cc:340] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.213274 4800 raft_consensus.cc:366] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:16.213361 4800 raft_consensus.cc:705] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Initialized, Role: FOLLOWER I0403 04:30:16.213523 4800 consensus_queue.cc:229] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.213634 4800 raft_consensus.cc:380] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:16.213711 4800 raft_consensus.cc:472] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:16.213791 4800 raft_consensus.cc:2886] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:16.215150 4800 raft_consensus.cc:494] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.215370 4800 leader_election.cc:310] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6620f761814204a26502e29a199ab7; no voters: I0403 04:30:16.215570 4800 leader_election.cc:296] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:16.215692 4802 raft_consensus.cc:2640] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:16.215898 4802 raft_consensus.cc:667] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Running, Role: LEADER I0403 04:30:16.215920 4800 ts_tablet_manager.cc:1081] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s I0403 04:30:16.216174 4800 tablet_bootstrap.cc:439] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: Bootstrap starting. I0403 04:30:16.216161 4802 consensus_queue.cc:206] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.217589 4800 tablet_bootstrap.cc:590] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: No blocks or log segments found. Creating new log. I0403 04:30:16.217802 4615 catalog_manager.cc:3977] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 reported cstate change: term changed from 0 to 1, leader changed from to 6d6620f761814204a26502e29a199ab7 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "6d6620f761814204a26502e29a199ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } health_report { overall_health: HEALTHY } } } I0403 04:30:16.219764 4800 tablet_bootstrap.cc:439] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: No bootstrap required, opened a new log I0403 04:30:16.219879 4800 ts_tablet_manager.cc:1053] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0403 04:30:16.220466 4800 raft_consensus.cc:340] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.220600 4800 raft_consensus.cc:366] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:16.220670 4800 raft_consensus.cc:705] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Initialized, Role: FOLLOWER I0403 04:30:16.220832 4800 consensus_queue.cc:229] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.220965 4800 raft_consensus.cc:380] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:16.221031 4800 raft_consensus.cc:472] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:16.221124 4800 raft_consensus.cc:2886] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:16.222911 4800 raft_consensus.cc:494] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.223089 4800 leader_election.cc:310] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6620f761814204a26502e29a199ab7; no voters: I0403 04:30:16.223248 4800 leader_election.cc:296] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:16.223322 4802 raft_consensus.cc:2640] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:16.223498 4802 raft_consensus.cc:667] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Running, Role: LEADER I0403 04:30:16.223661 4802 consensus_queue.cc:206] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.223773 4800 ts_tablet_manager.cc:1081] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:16.223940 4800 tablet_bootstrap.cc:439] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: Bootstrap starting. I0403 04:30:16.225373 4800 tablet_bootstrap.cc:590] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: No blocks or log segments found. Creating new log. I0403 04:30:16.225373 4615 catalog_manager.cc:3977] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 reported cstate change: term changed from 0 to 1, leader changed from to 6d6620f761814204a26502e29a199ab7 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "6d6620f761814204a26502e29a199ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } health_report { overall_health: HEALTHY } } } I0403 04:30:16.226790 4800 tablet_bootstrap.cc:439] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: No bootstrap required, opened a new log I0403 04:30:16.226936 4800 ts_tablet_manager.cc:1053] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.002s I0403 04:30:16.227520 4800 raft_consensus.cc:340] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.227632 4800 raft_consensus.cc:366] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:16.227689 4800 raft_consensus.cc:705] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Initialized, Role: FOLLOWER I0403 04:30:16.227843 4800 consensus_queue.cc:229] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.227962 4800 raft_consensus.cc:380] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:16.228041 4800 raft_consensus.cc:472] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:16.228134 4800 raft_consensus.cc:2886] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:16.229903 4800 raft_consensus.cc:494] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.230058 4800 leader_election.cc:310] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6620f761814204a26502e29a199ab7; no voters: I0403 04:30:16.230217 4800 leader_election.cc:296] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:16.230298 4802 raft_consensus.cc:2640] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:16.230479 4802 raft_consensus.cc:667] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Running, Role: LEADER I0403 04:30:16.230572 4800 ts_tablet_manager.cc:1081] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: Time spent starting tablet: real 0.004s user 0.002s sys 0.001s I0403 04:30:16.230659 4802 consensus_queue.cc:206] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.230813 4800 tablet_bootstrap.cc:439] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: Bootstrap starting. I0403 04:30:16.231925 4800 tablet_bootstrap.cc:590] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: No blocks or log segments found. Creating new log. I0403 04:30:16.233569 4800 tablet_bootstrap.cc:439] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: No bootstrap required, opened a new log I0403 04:30:16.233693 4800 ts_tablet_manager.cc:1053] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.001s I0403 04:30:16.234030 4615 catalog_manager.cc:3977] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 reported cstate change: term changed from 0 to 1, leader changed from to 6d6620f761814204a26502e29a199ab7 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "6d6620f761814204a26502e29a199ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } health_report { overall_health: HEALTHY } } } I0403 04:30:16.234439 4800 raft_consensus.cc:340] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.234594 4800 raft_consensus.cc:366] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:16.234675 4800 raft_consensus.cc:705] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Initialized, Role: FOLLOWER I0403 04:30:16.234849 4800 consensus_queue.cc:229] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.234988 4800 raft_consensus.cc:380] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:16.235033 4800 raft_consensus.cc:472] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:16.235095 4800 raft_consensus.cc:2886] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:16.236918 4800 raft_consensus.cc:494] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.237087 4800 leader_election.cc:310] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6620f761814204a26502e29a199ab7; no voters: I0403 04:30:16.237236 4800 leader_election.cc:296] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:16.237468 4803 raft_consensus.cc:2640] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:16.237632 4803 raft_consensus.cc:667] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Running, Role: LEADER I0403 04:30:16.237907 4803 consensus_queue.cc:206] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.239259 4800 ts_tablet_manager.cc:1081] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s I0403 04:30:16.239557 4800 tablet_bootstrap.cc:439] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: Bootstrap starting. I0403 04:30:16.239763 4615 catalog_manager.cc:3977] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 reported cstate change: term changed from 0 to 1, leader changed from to 6d6620f761814204a26502e29a199ab7 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "6d6620f761814204a26502e29a199ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } health_report { overall_health: HEALTHY } } } I0403 04:30:16.240566 4800 tablet_bootstrap.cc:590] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: No blocks or log segments found. Creating new log. I0403 04:30:16.242266 4800 tablet_bootstrap.cc:439] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: No bootstrap required, opened a new log I0403 04:30:16.242409 4800 ts_tablet_manager.cc:1053] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s I0403 04:30:16.243134 4800 raft_consensus.cc:340] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.243288 4800 raft_consensus.cc:366] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:16.243376 4800 raft_consensus.cc:705] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Initialized, Role: FOLLOWER I0403 04:30:16.243569 4800 consensus_queue.cc:229] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.243705 4800 raft_consensus.cc:380] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:16.243777 4800 raft_consensus.cc:472] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:16.243849 4800 raft_consensus.cc:2886] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:16.245362 4800 raft_consensus.cc:494] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.245512 4800 leader_election.cc:310] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6620f761814204a26502e29a199ab7; no voters: I0403 04:30:16.245707 4800 leader_election.cc:296] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:16.245765 4802 raft_consensus.cc:2640] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:16.246040 4802 raft_consensus.cc:667] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Running, Role: LEADER I0403 04:30:16.246109 4800 ts_tablet_manager.cc:1081] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:16.246256 4802 consensus_queue.cc:206] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.246381 4800 tablet_bootstrap.cc:439] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: Bootstrap starting. I0403 04:30:16.247823 4800 tablet_bootstrap.cc:590] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: No blocks or log segments found. Creating new log. I0403 04:30:16.248066 4615 catalog_manager.cc:3977] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 reported cstate change: term changed from 0 to 1, leader changed from to 6d6620f761814204a26502e29a199ab7 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "6d6620f761814204a26502e29a199ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } health_report { overall_health: HEALTHY } } } I0403 04:30:16.249722 4800 tablet_bootstrap.cc:439] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: No bootstrap required, opened a new log I0403 04:30:16.249884 4800 ts_tablet_manager.cc:1053] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.001s I0403 04:30:16.250586 4800 raft_consensus.cc:340] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.250699 4800 raft_consensus.cc:366] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:16.250773 4800 raft_consensus.cc:705] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Initialized, Role: FOLLOWER I0403 04:30:16.250952 4800 consensus_queue.cc:229] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.251101 4800 raft_consensus.cc:380] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:16.251161 4800 raft_consensus.cc:472] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:16.251245 4800 raft_consensus.cc:2886] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:16.252725 4800 raft_consensus.cc:494] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.252910 4800 leader_election.cc:310] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d6620f761814204a26502e29a199ab7; no voters: I0403 04:30:16.253087 4800 leader_election.cc:296] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:16.253185 4802 raft_consensus.cc:2640] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:16.253372 4802 raft_consensus.cc:667] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Becoming Leader. State: Replica: 6d6620f761814204a26502e29a199ab7, State: Running, Role: LEADER I0403 04:30:16.253522 4800 ts_tablet_manager.cc:1081] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: Time spent starting tablet: real 0.004s user 0.000s sys 0.000s I0403 04:30:16.253552 4802 consensus_queue.cc:206] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } } I0403 04:30:16.254995 4615 catalog_manager.cc:3977] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 reported cstate change: term changed from 0 to 1, leader changed from to 6d6620f761814204a26502e29a199ab7 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "6d6620f761814204a26502e29a199ab7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d6620f761814204a26502e29a199ab7" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 39877 } health_report { overall_health: HEALTHY } } } I0403 04:30:16.527770 4612 catalog_manager.cc:1890] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:36614: table { table_name: "default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60" } modify_external_catalogs: true I0403 04:30:16.531780 4612 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Sending DeleteTablet for 1 replicas of tablet 9396bf196c824a0baaf1ed6843c5f6aa I0403 04:30:16.532011 4612 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 9396bf196c824a0baaf1ed6843c5f6aa on 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) (Table deleted at 2019-04-03 04:30:16 UTC) I0403 04:30:16.532253 4612 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Sending DeleteTablet for 1 replicas of tablet 0e9d1943a8a24c80893fa2b98d1aa24e I0403 04:30:16.532394 4612 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 0e9d1943a8a24c80893fa2b98d1aa24e on 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) (Table deleted at 2019-04-03 04:30:16 UTC) I0403 04:30:16.532527 4612 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Sending DeleteTablet for 1 replicas of tablet dc1fbe5fca484c9d897dd97bbd009f71 I0403 04:30:16.532687 4612 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet dc1fbe5fca484c9d897dd97bbd009f71 on 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) (Table deleted at 2019-04-03 04:30:16 UTC) I0403 04:30:16.532830 4612 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Sending DeleteTablet for 1 replicas of tablet bebe1f9ee5644cc5a6a3f9a21b1fc8aa I0403 04:30:16.532814 4709 tablet_service.cc:1047] Processing DeleteTablet for tablet 9396bf196c824a0baaf1ed6843c5f6aa with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-03 04:30:16 UTC) from {username='slave'} at 127.0.0.1:34818 I0403 04:30:16.532923 4715 tablet_service.cc:1047] Processing DeleteTablet for tablet 0e9d1943a8a24c80893fa2b98d1aa24e with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-03 04:30:16 UTC) from {username='slave'} at 127.0.0.1:34818 I0403 04:30:16.532966 4612 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet bebe1f9ee5644cc5a6a3f9a21b1fc8aa on 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) (Table deleted at 2019-04-03 04:30:16 UTC) I0403 04:30:16.533088 4612 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Sending DeleteTablet for 1 replicas of tablet c75e1d213af7404eb9b378aa601d88e1 I0403 04:30:16.533221 4612 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet c75e1d213af7404eb9b378aa601d88e1 on 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) (Table deleted at 2019-04-03 04:30:16 UTC) I0403 04:30:16.533380 4612 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Sending DeleteTablet for 1 replicas of tablet 4ba297fa8e1e475d87d6cd01c57615d2 I0403 04:30:16.533498 4612 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet 4ba297fa8e1e475d87d6cd01c57615d2 on 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) (Table deleted at 2019-04-03 04:30:16 UTC) I0403 04:30:16.533669 4714 tablet_service.cc:1047] Processing DeleteTablet for tablet bebe1f9ee5644cc5a6a3f9a21b1fc8aa with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-03 04:30:16 UTC) from {username='slave'} at 127.0.0.1:34818 I0403 04:30:16.533754 4612 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Sending DeleteTablet for 1 replicas of tablet f159e2b79e934aeab5a4a0ad5ac877ee I0403 04:30:16.533852 4715 tablet_service.cc:1047] Processing DeleteTablet for tablet dc1fbe5fca484c9d897dd97bbd009f71 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-03 04:30:16 UTC) from {username='slave'} at 127.0.0.1:34818 I0403 04:30:16.533901 4612 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet f159e2b79e934aeab5a4a0ad5ac877ee on 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) (Table deleted at 2019-04-03 04:30:16 UTC) I0403 04:30:16.534183 4715 tablet_service.cc:1047] Processing DeleteTablet for tablet 4ba297fa8e1e475d87d6cd01c57615d2 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-03 04:30:16 UTC) from {username='slave'} at 127.0.0.1:34818 I0403 04:30:16.534190 4714 tablet_service.cc:1047] Processing DeleteTablet for tablet c75e1d213af7404eb9b378aa601d88e1 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-03 04:30:16 UTC) from {username='slave'} at 127.0.0.1:34818 I0403 04:30:16.534443 4710 tablet_service.cc:1047] Processing DeleteTablet for tablet f159e2b79e934aeab5a4a0ad5ac877ee with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-03 04:30:16 UTC) from {username='slave'} at 127.0.0.1:34818 I0403 04:30:16.534566 4612 catalog_manager.cc:4216] T 00000000000000000000000000000000 P 77c8a5045689493587ca6e1a94ec8142: Sending DeleteTablet for 1 replicas of tablet b68ca8195f294cb29beac1261fc88ee7 I0403 04:30:16.534679 4612 catalog_manager.cc:3379] Sending DeleteTablet(TABLET_DATA_DELETED) for tablet b68ca8195f294cb29beac1261fc88ee7 on 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877) (Table deleted at 2019-04-03 04:30:16 UTC) I0403 04:30:16.535384 4710 tablet_service.cc:1047] Processing DeleteTablet for tablet b68ca8195f294cb29beac1261fc88ee7 with delete_type TABLET_DATA_DELETED (Table deleted at 2019-04-03 04:30:16 UTC) from {username='slave'} at 127.0.0.1:34818 I0403 04:30:16.535670 4835 tablet_replica.cc:264] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: stopping tablet replica I0403 04:30:16.535982 4835 raft_consensus.cc:2143] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:16.536221 4835 raft_consensus.cc:2170] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:16.538491 4835 ts_tablet_manager.cc:1377] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: Deleting tablet data with delete state TABLET_DATA_DELETED I0403 04:30:16.543743 4835 ts_tablet_manager.cc:1390] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0403 04:30:16.543834 4835 log.cc:990] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/wals/9396bf196c824a0baaf1ed6843c5f6aa I0403 04:30:16.544248 4835 ts_tablet_manager.cc:1411] T 9396bf196c824a0baaf1ed6843c5f6aa P 6d6620f761814204a26502e29a199ab7: Deleting consensus metadata I0403 04:30:16.545557 4835 tablet_replica.cc:264] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: stopping tablet replica I0403 04:30:16.545673 4597 catalog_manager.cc:3357] TS 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877): tablet 9396bf196c824a0baaf1ed6843c5f6aa (table default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]) successfully deleted I0403 04:30:16.545708 4835 raft_consensus.cc:2143] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:16.545819 4835 raft_consensus.cc:2170] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:16.546627 4835 ts_tablet_manager.cc:1377] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: Deleting tablet data with delete state TABLET_DATA_DELETED I0403 04:30:16.549463 4835 ts_tablet_manager.cc:1390] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0403 04:30:16.549552 4835 log.cc:990] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/wals/0e9d1943a8a24c80893fa2b98d1aa24e I0403 04:30:16.549899 4835 ts_tablet_manager.cc:1411] T 0e9d1943a8a24c80893fa2b98d1aa24e P 6d6620f761814204a26502e29a199ab7: Deleting consensus metadata I0403 04:30:16.550556 4835 tablet_replica.cc:264] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: stopping tablet replica I0403 04:30:16.550662 4597 catalog_manager.cc:3357] TS 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877): tablet 0e9d1943a8a24c80893fa2b98d1aa24e (table default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]) successfully deleted I0403 04:30:16.550684 4835 raft_consensus.cc:2143] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:16.550812 4835 raft_consensus.cc:2170] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:16.551582 4835 ts_tablet_manager.cc:1377] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: Deleting tablet data with delete state TABLET_DATA_DELETED I0403 04:30:16.554494 4835 ts_tablet_manager.cc:1390] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0403 04:30:16.554567 4835 log.cc:990] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/wals/bebe1f9ee5644cc5a6a3f9a21b1fc8aa I0403 04:30:16.554888 4835 ts_tablet_manager.cc:1411] T bebe1f9ee5644cc5a6a3f9a21b1fc8aa P 6d6620f761814204a26502e29a199ab7: Deleting consensus metadata I0403 04:30:16.555501 4835 tablet_replica.cc:264] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: stopping tablet replica I0403 04:30:16.555608 4597 catalog_manager.cc:3357] TS 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877): tablet bebe1f9ee5644cc5a6a3f9a21b1fc8aa (table default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]) successfully deleted I0403 04:30:16.555640 4835 raft_consensus.cc:2143] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:16.555747 4835 raft_consensus.cc:2170] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:16.556505 4835 ts_tablet_manager.cc:1377] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: Deleting tablet data with delete state TABLET_DATA_DELETED I0403 04:30:16.559355 4835 ts_tablet_manager.cc:1390] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0403 04:30:16.559444 4835 log.cc:990] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/wals/dc1fbe5fca484c9d897dd97bbd009f71 I0403 04:30:16.559746 4835 ts_tablet_manager.cc:1411] T dc1fbe5fca484c9d897dd97bbd009f71 P 6d6620f761814204a26502e29a199ab7: Deleting consensus metadata I0403 04:30:16.560379 4835 tablet_replica.cc:264] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: stopping tablet replica I0403 04:30:16.560480 4597 catalog_manager.cc:3357] TS 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877): tablet dc1fbe5fca484c9d897dd97bbd009f71 (table default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]) successfully deleted I0403 04:30:16.560501 4835 raft_consensus.cc:2143] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:16.560621 4835 raft_consensus.cc:2170] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:16.561399 4835 ts_tablet_manager.cc:1377] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: Deleting tablet data with delete state TABLET_DATA_DELETED I0403 04:30:16.564322 4835 ts_tablet_manager.cc:1390] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0403 04:30:16.564407 4835 log.cc:990] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/wals/4ba297fa8e1e475d87d6cd01c57615d2 I0403 04:30:16.564708 4835 ts_tablet_manager.cc:1411] T 4ba297fa8e1e475d87d6cd01c57615d2 P 6d6620f761814204a26502e29a199ab7: Deleting consensus metadata I0403 04:30:16.565310 4835 tablet_replica.cc:264] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: stopping tablet replica I0403 04:30:16.565434 4597 catalog_manager.cc:3357] TS 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877): tablet 4ba297fa8e1e475d87d6cd01c57615d2 (table default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]) successfully deleted I0403 04:30:16.565456 4835 raft_consensus.cc:2143] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:16.565567 4835 raft_consensus.cc:2170] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:16.566377 4835 ts_tablet_manager.cc:1377] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: Deleting tablet data with delete state TABLET_DATA_DELETED I0403 04:30:16.569190 4835 ts_tablet_manager.cc:1390] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0403 04:30:16.569278 4835 log.cc:990] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/wals/c75e1d213af7404eb9b378aa601d88e1 I0403 04:30:16.569579 4835 ts_tablet_manager.cc:1411] T c75e1d213af7404eb9b378aa601d88e1 P 6d6620f761814204a26502e29a199ab7: Deleting consensus metadata I0403 04:30:16.570243 4835 tablet_replica.cc:264] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: stopping tablet replica I0403 04:30:16.570379 4835 raft_consensus.cc:2143] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:16.570367 4597 catalog_manager.cc:3357] TS 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877): tablet c75e1d213af7404eb9b378aa601d88e1 (table default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]) successfully deleted I0403 04:30:16.570509 4835 raft_consensus.cc:2170] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:16.571255 4835 ts_tablet_manager.cc:1377] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: Deleting tablet data with delete state TABLET_DATA_DELETED I0403 04:30:16.574168 4835 ts_tablet_manager.cc:1390] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0403 04:30:16.574244 4835 log.cc:990] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/wals/f159e2b79e934aeab5a4a0ad5ac877ee I0403 04:30:16.574563 4835 ts_tablet_manager.cc:1411] T f159e2b79e934aeab5a4a0ad5ac877ee P 6d6620f761814204a26502e29a199ab7: Deleting consensus metadata I0403 04:30:16.575183 4835 tablet_replica.cc:264] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: stopping tablet replica I0403 04:30:16.575330 4835 raft_consensus.cc:2143] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:16.575294 4597 catalog_manager.cc:3357] TS 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877): tablet f159e2b79e934aeab5a4a0ad5ac877ee (table default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]) successfully deleted I0403 04:30:16.575448 4835 raft_consensus.cc:2170] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:16.576205 4835 ts_tablet_manager.cc:1377] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: Deleting tablet data with delete state TABLET_DATA_DELETED I0403 04:30:16.579077 4835 ts_tablet_manager.cc:1390] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.3 I0403 04:30:16.579164 4835 log.cc:990] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLoadgenHmsEnabled.1554265799459872-3617/minicluster-data/ts-0/wal/wals/b68ca8195f294cb29beac1261fc88ee7 I0403 04:30:16.579474 4835 ts_tablet_manager.cc:1411] T b68ca8195f294cb29beac1261fc88ee7 P 6d6620f761814204a26502e29a199ab7: Deleting consensus metadata I0403 04:30:16.580193 4597 catalog_manager.cc:3357] TS 6d6620f761814204a26502e29a199ab7 (127.3.136.65:39877): tablet b68ca8195f294cb29beac1261fc88ee7 (table default.loadgen_auto_fa94f2d102984805bcd5fa0412c2cf60 [id=06bb83fade4645b3a47ce3e1c98c8f88]) successfully deleted I0403 04:30:16.588742 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 4649 I0403 04:30:16.593972 4776 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:16.653221 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 4649 I0403 04:30:16.662883 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 4589 I0403 04:30:16.663694 4645 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:16.729090 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 4589 Shutting down hive metastore. [ OK ] ToolTest.TestLoadgenHmsEnabled (12644 ms) [ RUN ] ToolTest.TestRemoteReplicaCopy I0403 04:30:17.249140 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=0.0.0.0:42049 --webserver_interface=0.0.0.0 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --catalog_manager_wait_for_new_tablets_to_elect_leader=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:17.420990 4844 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:17.421192 4844 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:17.423645 4844 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:30:17.423691 4844 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:17.423740 4844 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:30:17.423780 4844 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:30:17.427978 4844 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/wal --catalog_manager_wait_for_new_tablets_to_elect_leader=false --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=0.0.0.0:42049 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:17.433931 4844 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 210635us I0403 04:30:17.435019 4844 fs_manager.cc:263] Metadata directory not provided I0403 04:30:17.435097 4844 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:17.435359 4844 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:17.435436 4844 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:17.437757 4844 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "8c269f7599f44b898b14d4fc9509ff33" format_stamp: "Formatted at 2019-04-03 04:30:17 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:17.438310 4844 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "8c269f7599f44b898b14d4fc9509ff33" format_stamp: "Formatted at 2019-04-03 04:30:17 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:17.444387 4844 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s I0403 04:30:17.445508 4844 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:17.446113 4844 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:17.448989 4844 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:17.449048 4844 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/wal uuid: "8c269f7599f44b898b14d4fc9509ff33" format_stamp: "Formatted at 2019-04-03 04:30:17 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:17.449169 4844 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:17.482230 4844 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:17.496569 4844 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:42049 I0403 04:30:17.497516 4844 webserver.cc:308] Webserver started at http://0.0.0.0:39947/ using document root and password file I0403 04:30:17.498287 4844 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:30:17.501291 4903 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:17.508622 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 4844 I0403 04:30:17.509286 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=0.0.0.0:0 --local_ip_for_outbound_sockets=0.0.0.0 --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-1l7r:42049 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --enable_leader_failure_detection=false with env {} I0403 04:30:17.512866 4903 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33: Bootstrap starting. I0403 04:30:17.515544 4903 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33: No blocks or log segments found. Creating new log. I0403 04:30:17.516521 4903 log.cc:525] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33: Log is configured to *not* fsync() on all Append() calls I0403 04:30:17.518214 4903 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33: No bootstrap required, opened a new log I0403 04:30:17.525182 4903 raft_consensus.cc:340] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c269f7599f44b898b14d4fc9509ff33" member_type: VOTER } I0403 04:30:17.525420 4903 raft_consensus.cc:366] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:17.525501 4903 raft_consensus.cc:705] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c269f7599f44b898b14d4fc9509ff33, State: Initialized, Role: FOLLOWER I0403 04:30:17.526021 4903 consensus_queue.cc:229] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c269f7599f44b898b14d4fc9509ff33" member_type: VOTER } I0403 04:30:17.526206 4903 raft_consensus.cc:380] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:17.526355 4903 raft_consensus.cc:472] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:17.526473 4903 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:17.528069 4903 raft_consensus.cc:494] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c269f7599f44b898b14d4fc9509ff33" member_type: VOTER } I0403 04:30:17.528458 4903 leader_election.cc:310] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8c269f7599f44b898b14d4fc9509ff33; no voters: I0403 04:30:17.529145 4906 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:17.529520 4903 leader_election.cc:296] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:17.529744 4906 raft_consensus.cc:667] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [term 1 LEADER]: Becoming Leader. State: Replica: 8c269f7599f44b898b14d4fc9509ff33, State: Running, Role: LEADER I0403 04:30:17.530356 4906 consensus_queue.cc:206] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c269f7599f44b898b14d4fc9509ff33" member_type: VOTER } I0403 04:30:17.534237 4907 sys_catalog.cc:337] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8c269f7599f44b898b14d4fc9509ff33. Latest consensus state: current_term: 1 leader_uuid: "8c269f7599f44b898b14d4fc9509ff33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c269f7599f44b898b14d4fc9509ff33" member_type: VOTER } } I0403 04:30:17.534512 4907 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [sys.catalog]: This master's current role is: LEADER I0403 04:30:17.535109 4903 sys_catalog.cc:337] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "8c269f7599f44b898b14d4fc9509ff33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c269f7599f44b898b14d4fc9509ff33" member_type: VOTER } } I0403 04:30:17.535106 4908 sys_catalog.cc:337] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8c269f7599f44b898b14d4fc9509ff33" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8c269f7599f44b898b14d4fc9509ff33" member_type: VOTER } } I0403 04:30:17.535337 4903 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [sys.catalog]: This master's current role is: LEADER I0403 04:30:17.535449 4908 sys_catalog.cc:340] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [sys.catalog]: This master's current role is: LEADER I0403 04:30:17.536659 4903 sys_catalog.cc:424] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:17.536844 4912 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:17.537271 4913 catalog_manager.cc:536] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting I0403 04:30:17.543856 4912 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:17.590095 4912 catalog_manager.cc:950] Generated new certificate authority record I0403 04:30:17.591383 4912 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:17.599895 4912 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 8c269f7599f44b898b14d4fc9509ff33: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:17.705052 4904 flags.cc:406] Enabled unsafe flag: --enable_leader_failure_detection=false W0403 04:30:17.705396 4904 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:17.705515 4904 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:17.708999 4904 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:17.709178 4904 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=0.0.0.0 I0403 04:30:17.714973 4904 tablet_server_main.cc:78] Tablet server non-default flags: --enable_leader_failure_detection=false --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=0.0.0.0:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-1l7r:42049 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=0.0.0.0 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:17.725503 4904 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 210635us I0403 04:30:17.726372 4904 fs_manager.cc:263] Metadata directory not provided I0403 04:30:17.726464 4904 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:17.726821 4904 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:17.726914 4904 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:17.730180 4904 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "e94ae8064c284fceb0d8ce973d21b48e" format_stamp: "Formatted at 2019-04-03 04:30:17 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:17.730971 4904 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "e94ae8064c284fceb0d8ce973d21b48e" format_stamp: "Formatted at 2019-04-03 04:30:17 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:17.740170 4904 fs_manager.cc:503] Time spent creating directory manager: real 0.009s user 0.005s sys 0.004s I0403 04:30:17.741715 4904 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:17.742507 4904 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:17.751459 4904 fs_manager.cc:419] Time spent opening block manager: real 0.007s user 0.000s sys 0.006s I0403 04:30:17.751549 4904 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "e94ae8064c284fceb0d8ce973d21b48e" format_stamp: "Formatted at 2019-04-03 04:30:17 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:17.751724 4904 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:17.786840 4904 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:17.788653 4904 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:17.788718 4904 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:17.863510 4904 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:34339 I0403 04:30:17.864976 4904 webserver.cc:308] Webserver started at http://0.0.0.0:44861/ using document root and password file I0403 04:30:17.866065 4904 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:30:17.870925 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 4904 I0403 04:30:17.871618 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=0.0.0.0:0 --local_ip_for_outbound_sockets=0.0.0.0 --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-1l7r:42049 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --enable_leader_failure_detection=false with env {} I0403 04:30:17.886587 5034 heartbeater.cc:345] Connected to a master server at dist-test-slave-dist-test-slave-1l7r:42049 I0403 04:30:17.886765 5034 heartbeater.cc:426] Registering TS with master... I0403 04:30:17.887392 5034 heartbeater.cc:475] Master dist-test-slave-dist-test-slave-1l7r:42049 requested a full tablet report, sending... I0403 04:30:17.888972 4870 ts_manager.cc:159] Registered new tserver with Master: e94ae8064c284fceb0d8ce973d21b48e (dist-test-slave-dist-test-slave-1l7r:34339) I0403 04:30:17.890703 4870 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 172.17.0.2:42211 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:18.057082 5038 flags.cc:406] Enabled unsafe flag: --enable_leader_failure_detection=false W0403 04:30:18.057296 5038 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:18.057394 5038 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:18.059515 5038 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:18.059628 5038 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=0.0.0.0 I0403 04:30:18.063400 5038 tablet_server_main.cc:78] Tablet server non-default flags: --enable_leader_failure_detection=false --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=0.0.0.0:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-1l7r:42049 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=0.0.0.0 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:18.070600 5038 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 211135us I0403 04:30:18.071156 5038 fs_manager.cc:263] Metadata directory not provided I0403 04:30:18.071223 5038 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:18.071502 5038 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:18.071566 5038 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:18.073900 5038 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/instance: uuid: "71eb4565f22f4adfb6690d16bf8df52e" format_stamp: "Formatted at 2019-04-03 04:30:18 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:18.074453 5038 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal/instance: uuid: "71eb4565f22f4adfb6690d16bf8df52e" format_stamp: "Formatted at 2019-04-03 04:30:18 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:18.080229 5038 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s I0403 04:30:18.081364 5038 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:18.081931 5038 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:18.084733 5038 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:18.084806 5038 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal uuid: "71eb4565f22f4adfb6690d16bf8df52e" format_stamp: "Formatted at 2019-04-03 04:30:18 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:18.084957 5038 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:18.107553 5038 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:18.109134 5038 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:18.109206 5038 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:18.135448 5038 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:33395 I0403 04:30:18.136425 5038 webserver.cc:308] Webserver started at http://0.0.0.0:39269/ using document root and password file I0403 04:30:18.137112 5038 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/info.pb I0403 04:30:18.145160 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 5038 I0403 04:30:18.145802 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=0.0.0.0:0 --local_ip_for_outbound_sockets=0.0.0.0 --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-1l7r:42049 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --enable_leader_failure_detection=false with env {} I0403 04:30:18.150028 5157 heartbeater.cc:345] Connected to a master server at dist-test-slave-dist-test-slave-1l7r:42049 I0403 04:30:18.150214 5157 heartbeater.cc:426] Registering TS with master... I0403 04:30:18.150882 5157 heartbeater.cc:475] Master dist-test-slave-dist-test-slave-1l7r:42049 requested a full tablet report, sending... I0403 04:30:18.151907 4870 ts_manager.cc:159] Registered new tserver with Master: 71eb4565f22f4adfb6690d16bf8df52e (dist-test-slave-dist-test-slave-1l7r:33395) I0403 04:30:18.152779 4870 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 172.17.0.2:33859 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:18.289274 5160 flags.cc:406] Enabled unsafe flag: --enable_leader_failure_detection=false W0403 04:30:18.289520 5160 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:18.289633 5160 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:18.291950 5160 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:18.292104 5160 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=0.0.0.0 I0403 04:30:18.296010 5160 tablet_server_main.cc:78] Tablet server non-default flags: --enable_leader_failure_detection=false --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=0.0.0.0:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=0 --tserver_master_addrs=dist-test-slave-dist-test-slave-1l7r:42049 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=0.0.0.0 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:18.303565 5160 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 211135us I0403 04:30:18.304188 5160 fs_manager.cc:263] Metadata directory not provided I0403 04:30:18.304252 5160 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:18.304554 5160 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:18.304618 5160 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:18.307178 5160 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/data/instance: uuid: "c5eb563f0f254100b5e86c37ec5229bb" format_stamp: "Formatted at 2019-04-03 04:30:18 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:18.307721 5160 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/wal/instance: uuid: "c5eb563f0f254100b5e86c37ec5229bb" format_stamp: "Formatted at 2019-04-03 04:30:18 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:18.314033 5160 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s I0403 04:30:18.315227 5160 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:18.315774 5160 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:18.318472 5160 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:18.318543 5160 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/wal uuid: "c5eb563f0f254100b5e86c37ec5229bb" format_stamp: "Formatted at 2019-04-03 04:30:18 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:18.318665 5160 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:18.378898 5160 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:18.380807 5160 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:18.380872 5160 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:18.409188 5160 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:41331 I0403 04:30:18.410295 5160 webserver.cc:308] Webserver started at http://0.0.0.0:38989/ using document root and password file I0403 04:30:18.411120 5160 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-2/data/info.pb I0403 04:30:18.417270 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 5160 I0403 04:30:18.425776 5279 heartbeater.cc:345] Connected to a master server at dist-test-slave-dist-test-slave-1l7r:42049 I0403 04:30:18.426004 5279 heartbeater.cc:426] Registering TS with master... I0403 04:30:18.426648 5279 heartbeater.cc:475] Master dist-test-slave-dist-test-slave-1l7r:42049 requested a full tablet report, sending... I0403 04:30:18.427850 4870 ts_manager.cc:159] Registered new tserver with Master: c5eb563f0f254100b5e86c37ec5229bb (dist-test-slave-dist-test-slave-1l7r:41331) I0403 04:30:18.428972 3617 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0403 04:30:18.429149 4870 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 172.17.0.2:42005 I0403 04:30:18.431063 3617 test_util.cc:212] Using random seed: -1241612748 I0403 04:30:18.442350 4870 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 172.17.0.2:54864: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { rows: "\004\001\000\252\252\252*\004\001\000TUUU" } partition_schema { range_schema { columns { name: "key" } } } W0403 04:30:18.447877 4870 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0403 04:30:18.474443 4970 tablet_service.cc:1006] Processing CreateTablet for tablet c2d1395ec3654af19c5e2d22f35c7852 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764 I0403 04:30:18.474645 5216 tablet_service.cc:1006] Processing CreateTablet for tablet 42a8d1f034a14a309ea38db4ae424e03 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION VALUES < 715827882 I0403 04:30:18.474395 5092 tablet_service.cc:1006] Processing CreateTablet for tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION VALUES >= 1431655764 I0403 04:30:18.475878 5092 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.475893 4970 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c2d1395ec3654af19c5e2d22f35c7852. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.475893 5216 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 42a8d1f034a14a309ea38db4ae424e03. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.478020 5094 tablet_service.cc:1006] Processing CreateTablet for tablet 42a8d1f034a14a309ea38db4ae424e03 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION VALUES < 715827882 I0403 04:30:18.478212 4969 tablet_service.cc:1006] Processing CreateTablet for tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION VALUES >= 1431655764 I0403 04:30:18.478442 5094 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 42a8d1f034a14a309ea38db4ae424e03. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.478647 4969 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.478556 5215 tablet_service.cc:1006] Processing CreateTablet for tablet c2d1395ec3654af19c5e2d22f35c7852 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764 I0403 04:30:18.478658 5214 tablet_service.cc:1006] Processing CreateTablet for tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION VALUES >= 1431655764 I0403 04:30:18.479152 5215 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c2d1395ec3654af19c5e2d22f35c7852. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.479060 4971 tablet_service.cc:1006] Processing CreateTablet for tablet 42a8d1f034a14a309ea38db4ae424e03 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION VALUES < 715827882 I0403 04:30:18.479074 5093 tablet_service.cc:1006] Processing CreateTablet for tablet c2d1395ec3654af19c5e2d22f35c7852 (table=test-workload [id=f4fdd3d4e3b648efa653aa009a31d7f8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 1431655764 I0403 04:30:18.479362 5214 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.479460 4971 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 42a8d1f034a14a309ea38db4ae424e03. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.479651 5093 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c2d1395ec3654af19c5e2d22f35c7852. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:18.503185 5298 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e: Bootstrap starting. I0403 04:30:18.505776 5298 tablet_bootstrap.cc:590] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e: No blocks or log segments found. Creating new log. I0403 04:30:18.509253 5300 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap starting. I0403 04:30:18.512450 5300 tablet_bootstrap.cc:590] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: No blocks or log segments found. Creating new log. I0403 04:30:18.513619 5298 log.cc:525] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e: Log is configured to *not* fsync() on all Append() calls I0403 04:30:18.514995 5299 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb: Bootstrap starting. I0403 04:30:18.515794 5300 log.cc:525] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Log is configured to *not* fsync() on all Append() calls I0403 04:30:18.515964 5298 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e: No bootstrap required, opened a new log I0403 04:30:18.516209 5298 ts_tablet_manager.cc:1053] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.000s I0403 04:30:18.518950 5300 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: No bootstrap required, opened a new log I0403 04:30:18.519168 5300 ts_tablet_manager.cc:1053] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent bootstrapping tablet: real 0.010s user 0.000s sys 0.007s I0403 04:30:18.520279 5299 tablet_bootstrap.cc:590] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb: No blocks or log segments found. Creating new log. I0403 04:30:18.521446 5299 log.cc:525] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb: Log is configured to *not* fsync() on all Append() calls I0403 04:30:18.522955 5299 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb: No bootstrap required, opened a new log I0403 04:30:18.523201 5299 ts_tablet_manager.cc:1053] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s I0403 04:30:18.525447 5300 raft_consensus.cc:340] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.525480 5298 raft_consensus.cc:340] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.525878 5300 raft_consensus.cc:705] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71eb4565f22f4adfb6690d16bf8df52e, State: Initialized, Role: FOLLOWER I0403 04:30:18.525916 5298 raft_consensus.cc:705] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94ae8064c284fceb0d8ce973d21b48e, State: Initialized, Role: FOLLOWER I0403 04:30:18.526180 5300 consensus_queue.cc:229] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.526252 5298 consensus_queue.cc:229] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.527159 5034 heartbeater.cc:467] Master dist-test-slave-dist-test-slave-1l7r:42049 was elected leader, sending a full tablet report... I0403 04:30:18.528540 5298 ts_tablet_manager.cc:1081] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s I0403 04:30:18.528931 5298 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e: Bootstrap starting. I0403 04:30:18.530211 5157 heartbeater.cc:467] Master dist-test-slave-dist-test-slave-1l7r:42049 was elected leader, sending a full tablet report... I0403 04:30:18.530387 5298 tablet_bootstrap.cc:590] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e: No blocks or log segments found. Creating new log. I0403 04:30:18.532383 5298 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e: No bootstrap required, opened a new log I0403 04:30:18.532057 5299 raft_consensus.cc:340] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.532487 5299 raft_consensus.cc:705] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5eb563f0f254100b5e86c37ec5229bb, State: Initialized, Role: FOLLOWER I0403 04:30:18.532522 5298 ts_tablet_manager.cc:1053] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.000s I0403 04:30:18.532771 5299 consensus_queue.cc:229] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.533354 5300 ts_tablet_manager.cc:1081] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent starting tablet: real 0.014s user 0.000s sys 0.012s I0403 04:30:18.533349 5298 raft_consensus.cc:340] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.533632 5298 raft_consensus.cc:705] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94ae8064c284fceb0d8ce973d21b48e, State: Initialized, Role: FOLLOWER I0403 04:30:18.533685 5279 heartbeater.cc:467] Master dist-test-slave-dist-test-slave-1l7r:42049 was elected leader, sending a full tablet report... I0403 04:30:18.533712 5300 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap starting. I0403 04:30:18.533818 5298 consensus_queue.cc:229] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.534487 5298 ts_tablet_manager.cc:1081] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0403 04:30:18.534746 5298 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e: Bootstrap starting. I0403 04:30:18.535240 5300 tablet_bootstrap.cc:590] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: No blocks or log segments found. Creating new log. I0403 04:30:18.536069 5299 ts_tablet_manager.cc:1081] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P c5eb563f0f254100b5e86c37ec5229bb: Time spent starting tablet: real 0.013s user 0.007s sys 0.004s I0403 04:30:18.536336 5298 tablet_bootstrap.cc:590] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e: No blocks or log segments found. Creating new log. I0403 04:30:18.536468 5299 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb: Bootstrap starting. I0403 04:30:18.538167 5298 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e: No bootstrap required, opened a new log I0403 04:30:18.538244 5300 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: No bootstrap required, opened a new log I0403 04:30:18.538369 5298 ts_tablet_manager.cc:1053] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e: Time spent bootstrapping tablet: real 0.004s user 0.002s sys 0.000s I0403 04:30:18.538450 5300 ts_tablet_manager.cc:1053] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s I0403 04:30:18.539103 5298 raft_consensus.cc:340] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.539283 5300 raft_consensus.cc:340] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.539516 5298 raft_consensus.cc:705] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e94ae8064c284fceb0d8ce973d21b48e, State: Initialized, Role: FOLLOWER I0403 04:30:18.539687 5298 consensus_queue.cc:229] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.540658 5299 tablet_bootstrap.cc:590] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb: No blocks or log segments found. Creating new log. I0403 04:30:18.540694 5298 ts_tablet_manager.cc:1081] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e: Time spent starting tablet: real 0.002s user 0.000s sys 0.001s I0403 04:30:18.541398 5300 raft_consensus.cc:705] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71eb4565f22f4adfb6690d16bf8df52e, State: Initialized, Role: FOLLOWER I0403 04:30:18.541604 5300 consensus_queue.cc:229] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.542639 5300 ts_tablet_manager.cc:1081] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent starting tablet: real 0.004s user 0.000s sys 0.001s I0403 04:30:18.542919 5300 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap starting. I0403 04:30:18.544327 5300 tablet_bootstrap.cc:590] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: No blocks or log segments found. Creating new log. I0403 04:30:18.545712 5299 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb: No bootstrap required, opened a new log I0403 04:30:18.545922 5299 ts_tablet_manager.cc:1053] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb: Time spent bootstrapping tablet: real 0.009s user 0.000s sys 0.002s I0403 04:30:18.546169 5300 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: No bootstrap required, opened a new log I0403 04:30:18.546329 5300 ts_tablet_manager.cc:1053] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s I0403 04:30:18.546741 5299 raft_consensus.cc:340] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.546958 5299 raft_consensus.cc:705] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5eb563f0f254100b5e86c37ec5229bb, State: Initialized, Role: FOLLOWER I0403 04:30:18.546950 5300 raft_consensus.cc:340] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.547192 5300 raft_consensus.cc:705] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71eb4565f22f4adfb6690d16bf8df52e, State: Initialized, Role: FOLLOWER I0403 04:30:18.547088 5299 consensus_queue.cc:229] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.547338 5300 consensus_queue.cc:229] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.547922 5300 ts_tablet_manager.cc:1081] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s I0403 04:30:18.548735 5299 ts_tablet_manager.cc:1081] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb: Time spent starting tablet: real 0.003s user 0.001s sys 0.000s I0403 04:30:18.548954 5299 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P c5eb563f0f254100b5e86c37ec5229bb: Bootstrap starting. I0403 04:30:18.550393 5299 tablet_bootstrap.cc:590] T c2d1395ec3654af19c5e2d22f35c7852 P c5eb563f0f254100b5e86c37ec5229bb: No blocks or log segments found. Creating new log. I0403 04:30:18.551652 5299 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P c5eb563f0f254100b5e86c37ec5229bb: No bootstrap required, opened a new log I0403 04:30:18.551775 5299 ts_tablet_manager.cc:1053] T c2d1395ec3654af19c5e2d22f35c7852 P c5eb563f0f254100b5e86c37ec5229bb: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:18.552237 5299 raft_consensus.cc:340] T c2d1395ec3654af19c5e2d22f35c7852 P c5eb563f0f254100b5e86c37ec5229bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.552425 5299 raft_consensus.cc:705] T c2d1395ec3654af19c5e2d22f35c7852 P c5eb563f0f254100b5e86c37ec5229bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c5eb563f0f254100b5e86c37ec5229bb, State: Initialized, Role: FOLLOWER I0403 04:30:18.552546 5299 consensus_queue.cc:229] T c2d1395ec3654af19c5e2d22f35c7852 P c5eb563f0f254100b5e86c37ec5229bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:18.552928 5299 ts_tablet_manager.cc:1081] T c2d1395ec3654af19c5e2d22f35c7852 P c5eb563f0f254100b5e86c37ec5229bb: Time spent starting tablet: real 0.001s user 0.000s sys 0.000s W0403 04:30:18.626739 5035 tablet.cc:1786] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:30:18.638638 5158 tablet.cc:1786] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:30:18.662583 5280 tablet.cc:1786] T 42a8d1f034a14a309ea38db4ae424e03 P c5eb563f0f254100b5e86c37ec5229bb: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:30:18.848856 5333 ts_tablet_manager.cc:474] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Tablet Copy: Invalid argument: Leader has replica of tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3 with term -1, which is lower than last-logged term 0 on local replica. Rejecting tablet copy request I0403 04:30:19.169631 5333 tablet_replica.cc:264] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: stopping tablet replica I0403 04:30:19.169984 5333 raft_consensus.cc:2143] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Raft consensus shutting down. I0403 04:30:19.170264 5333 raft_consensus.cc:2170] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Raft consensus is shut down! I0403 04:30:19.171346 5333 ts_tablet_manager.cc:1377] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0403 04:30:19.174885 5333 ts_tablet_manager.cc:1390] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0 I0403 04:30:19.174998 5333 log.cc:990] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal/wals/60f7d94f6b1e4ed5b6f3d1527c8e07b3 I0403 04:30:19.175424 5333 ts_tablet_manager.cc:676] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Initiating tablet copy from peer e94ae8064c284fceb0d8ce973d21b48e (dist-test-slave-dist-test-slave-1l7r:34339) I0403 04:30:19.175771 5333 tablet_copy_client.cc:240] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Beginning tablet copy session from remote peer at address dist-test-slave-dist-test-slave-1l7r:34339 I0403 04:30:19.181224 5011 tablet_copy_service.cc:135] P e94ae8064c284fceb0d8ce973d21b48e: Received BeginTabletCopySession request for tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3 from peer 71eb4565f22f4adfb6690d16bf8df52e ({username='slave'} at 172.17.0.2:34839) I0403 04:30:19.181401 5011 tablet_copy_service.cc:156] P e94ae8064c284fceb0d8ce973d21b48e: Beginning new tablet copy session on tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3 from peer 71eb4565f22f4adfb6690d16bf8df52e at {username='slave'} at 172.17.0.2:34839: session id = 71eb4565f22f4adfb6690d16bf8df52e-60f7d94f6b1e4ed5b6f3d1527c8e07b3 I0403 04:30:19.184103 5011 tablet_copy_source_session.cc:202] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P e94ae8064c284fceb0d8ce973d21b48e: Tablet Copy: opened 0 blocks and 1 log segments I0403 04:30:19.185376 5333 ts_tablet_manager.cc:1377] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Deleting tablet data with delete state TABLET_DATA_COPYING I0403 04:30:19.188556 5333 ts_tablet_manager.cc:1390] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId 0.0 I0403 04:30:19.188750 5333 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:19.190642 5333 tablet_copy_client.cc:575] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Starting download of 0 data blocks... I0403 04:30:19.190783 5333 tablet_copy_client.cc:538] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Starting download of 1 WAL segments... I0403 04:30:19.192386 5333 tablet_copy_client.cc:414] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0403 04:30:19.194384 5333 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap starting. I0403 04:30:19.198493 5333 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:30:19.198863 5333 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap complete. I0403 04:30:19.199062 5333 ts_tablet_manager.cc:1053] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s I0403 04:30:19.199862 5333 raft_consensus.cc:340] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:19.200134 5333 raft_consensus.cc:705] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71eb4565f22f4adfb6690d16bf8df52e, State: Initialized, Role: FOLLOWER I0403 04:30:19.200302 5333 consensus_queue.cc:229] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:19.201229 5333 ts_tablet_manager.cc:1081] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s I0403 04:30:19.202093 5011 tablet_copy_service.cc:325] P e94ae8064c284fceb0d8ce973d21b48e: Request end of tablet copy session 71eb4565f22f4adfb6690d16bf8df52e-60f7d94f6b1e4ed5b6f3d1527c8e07b3 received from {username='slave'} at 172.17.0.2:34839 I0403 04:30:19.202235 5011 tablet_copy_service.cc:413] P e94ae8064c284fceb0d8ce973d21b48e: ending tablet copy session 71eb4565f22f4adfb6690d16bf8df52e-60f7d94f6b1e4ed5b6f3d1527c8e07b3 on tablet 60f7d94f6b1e4ed5b6f3d1527c8e07b3 with peer 71eb4565f22f4adfb6690d16bf8df52e I0403 04:30:19.242547 5092 tablet_service.cc:1047] Processing DeleteTablet for tablet 42a8d1f034a14a309ea38db4ae424e03 with delete_type TABLET_DATA_TOMBSTONED from {username='slave'} at 172.17.0.2:34478 I0403 04:30:19.246295 5359 tablet_replica.cc:264] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: stopping tablet replica I0403 04:30:19.246498 5359 raft_consensus.cc:2143] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Raft consensus shutting down. I0403 04:30:19.246691 5359 raft_consensus.cc:2170] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Raft consensus is shut down! I0403 04:30:19.247416 5359 ts_tablet_manager.cc:1377] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED I0403 04:30:19.250975 5359 ts_tablet_manager.cc:1390] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 0.0 I0403 04:30:19.251055 5359 log.cc:990] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Deleting WAL directory at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal/wals/42a8d1f034a14a309ea38db4ae424e03 I0403 04:30:19.251869 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 5038 I0403 04:30:19.252661 5154 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:19.307423 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 5038 I0403 04:30:19.606496 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=0.0.0.0:33395 --local_ip_for_outbound_sockets=0.0.0.0 --webserver_port=39269 --webserver_interface=0.0.0.0 --tserver_master_addrs=dist-test-slave-dist-test-slave-1l7r:42049 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --enable_leader_failure_detection=false with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:19.746788 5369 flags.cc:406] Enabled unsafe flag: --enable_leader_failure_detection=false W0403 04:30:19.747012 5369 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:19.747123 5369 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:19.749495 5369 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:19.749634 5369 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=0.0.0.0 I0403 04:30:19.753551 5369 tablet_server_main.cc:78] Tablet server non-default flags: --enable_leader_failure_detection=false --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=0.0.0.0:33395 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --webserver_interface=0.0.0.0 --webserver_port=39269 --tserver_master_addrs=dist-test-slave-dist-test-slave-1l7r:42049 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=0.0.0.0 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:19.761885 5369 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 211635us I0403 04:30:19.762502 5369 fs_manager.cc:263] Metadata directory not provided I0403 04:30:19.762573 5369 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:19.767637 5369 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.004s sys 0.001s I0403 04:30:19.768296 5369 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:19.768811 5369 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:19.771468 5369 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:19.771551 5369 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal uuid: "71eb4565f22f4adfb6690d16bf8df52e" format_stamp: "Formatted at 2019-04-03 04:30:18 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:19.772426 5369 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:19.796058 5369 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:19.797719 5369 ts_tablet_manager.cc:344] Loading tablet metadata (0/2 complete) I0403 04:30:19.804607 5369 ts_tablet_manager.cc:356] Loaded tablet metadata (2 total tablets, 1 live tablets) I0403 04:30:19.804661 5369 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0403 04:30:19.806494 5369 ts_tablet_manager.cc:376] Registered 1 tablets I0403 04:30:19.806949 5384 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap starting. I0403 04:30:19.820886 5384 log.cc:525] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Log is configured to *not* fsync() on all Append() calls I0403 04:30:19.823218 5384 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:30:19.823623 5384 tablet_bootstrap.cc:439] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap complete. I0403 04:30:19.824434 5384 ts_tablet_manager.cc:1053] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent bootstrapping tablet: real 0.018s user 0.005s sys 0.010s I0403 04:30:19.842087 5384 raft_consensus.cc:340] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:19.847543 5384 raft_consensus.cc:705] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71eb4565f22f4adfb6690d16bf8df52e, State: Initialized, Role: FOLLOWER I0403 04:30:19.847878 5369 rpc_server.cc:205] RPC server started. Bound to: 0.0.0.0:33395 I0403 04:30:19.847970 5384 consensus_queue.cc:229] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:19.849306 5369 webserver.cc:308] Webserver started at http://0.0.0.0:39269/ using document root and password file I0403 04:30:19.849663 5384 ts_tablet_manager.cc:1081] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent starting tablet: real 0.025s user 0.017s sys 0.008s I0403 04:30:19.850210 5369 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestRemoteReplicaCopy.1554265799459872-3617/minicluster-data/ts-1/data/info.pb W0403 04:30:19.851689 5492 tablet.cc:1786] T 60f7d94f6b1e4ed5b6f3d1527c8e07b3 P 71eb4565f22f4adfb6690d16bf8df52e: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:30:19.857054 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 5369 I0403 04:30:19.859789 5491 heartbeater.cc:345] Connected to a master server at dist-test-slave-dist-test-slave-1l7r:42049 I0403 04:30:19.859988 5491 heartbeater.cc:426] Registering TS with master... I0403 04:30:19.860677 5491 heartbeater.cc:475] Master dist-test-slave-dist-test-slave-1l7r:42049 requested a full tablet report, sending... I0403 04:30:19.862248 4870 ts_manager.cc:159] Re-registered known tserver with Master: 71eb4565f22f4adfb6690d16bf8df52e (dist-test-slave-dist-test-slave-1l7r:33395) I0403 04:30:19.863986 4870 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 172.17.0.2:56567 I0403 04:30:20.125746 5518 tablet_replica.cc:264] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: stopping tablet replica I0403 04:30:20.125919 5518 raft_consensus.cc:2143] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Raft consensus shutting down. I0403 04:30:20.126052 5518 raft_consensus.cc:2170] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Raft consensus is shut down! I0403 04:30:20.126266 5518 ts_tablet_manager.cc:676] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Initiating tablet copy from peer e94ae8064c284fceb0d8ce973d21b48e (dist-test-slave-dist-test-slave-1l7r:34339) I0403 04:30:20.126479 5518 tablet_copy_client.cc:203] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: overwriting existing tombstoned replica with an unknown last-logged opid I0403 04:30:20.126722 5518 tablet_copy_client.cc:240] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Beginning tablet copy session from remote peer at address dist-test-slave-dist-test-slave-1l7r:34339 I0403 04:30:20.131367 5011 tablet_copy_service.cc:135] P e94ae8064c284fceb0d8ce973d21b48e: Received BeginTabletCopySession request for tablet 42a8d1f034a14a309ea38db4ae424e03 from peer 71eb4565f22f4adfb6690d16bf8df52e ({username='slave'} at 172.17.0.2:50771) I0403 04:30:20.131494 5011 tablet_copy_service.cc:156] P e94ae8064c284fceb0d8ce973d21b48e: Beginning new tablet copy session on tablet 42a8d1f034a14a309ea38db4ae424e03 from peer 71eb4565f22f4adfb6690d16bf8df52e at {username='slave'} at 172.17.0.2:50771: session id = 71eb4565f22f4adfb6690d16bf8df52e-42a8d1f034a14a309ea38db4ae424e03 I0403 04:30:20.133399 5011 tablet_copy_source_session.cc:202] T 42a8d1f034a14a309ea38db4ae424e03 P e94ae8064c284fceb0d8ce973d21b48e: Tablet Copy: opened 0 blocks and 1 log segments I0403 04:30:20.134524 5518 ts_tablet_manager.cc:1377] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Deleting tablet data with delete state TABLET_DATA_COPYING I0403 04:30:20.141680 5518 ts_tablet_manager.cc:1390] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: tablet deleted with delete type TABLET_DATA_COPYING: last-logged OpId unknown I0403 04:30:20.141965 5518 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 42a8d1f034a14a309ea38db4ae424e03. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:20.143843 5518 tablet_copy_client.cc:575] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Starting download of 0 data blocks... I0403 04:30:20.144014 5518 tablet_copy_client.cc:538] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Starting download of 1 WAL segments... I0403 04:30:20.145455 5518 tablet_copy_client.cc:414] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0403 04:30:20.147397 5518 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap starting. I0403 04:30:20.154605 5518 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:30:20.154966 5518 tablet_bootstrap.cc:439] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap complete. I0403 04:30:20.155138 5518 ts_tablet_manager.cc:1053] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent bootstrapping tablet: real 0.008s user 0.008s sys 0.000s I0403 04:30:20.155903 5518 raft_consensus.cc:340] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:20.156110 5518 raft_consensus.cc:705] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71eb4565f22f4adfb6690d16bf8df52e, State: Initialized, Role: FOLLOWER I0403 04:30:20.156270 5518 consensus_queue.cc:229] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:20.156742 5491 heartbeater.cc:467] Master dist-test-slave-dist-test-slave-1l7r:42049 was elected leader, sending a full tablet report... I0403 04:30:20.156810 5518 ts_tablet_manager.cc:1081] T 42a8d1f034a14a309ea38db4ae424e03 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s I0403 04:30:20.157619 5011 tablet_copy_service.cc:325] P e94ae8064c284fceb0d8ce973d21b48e: Request end of tablet copy session 71eb4565f22f4adfb6690d16bf8df52e-42a8d1f034a14a309ea38db4ae424e03 received from {username='slave'} at 172.17.0.2:50771 I0403 04:30:20.157714 5011 tablet_copy_service.cc:413] P e94ae8064c284fceb0d8ce973d21b48e: ending tablet copy session 71eb4565f22f4adfb6690d16bf8df52e-42a8d1f034a14a309ea38db4ae424e03 on tablet 42a8d1f034a14a309ea38db4ae424e03 with peer 71eb4565f22f4adfb6690d16bf8df52e I0403 04:30:20.455324 5518 ts_tablet_manager.cc:676] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Initiating tablet copy from peer e94ae8064c284fceb0d8ce973d21b48e (dist-test-slave-dist-test-slave-1l7r:34339) I0403 04:30:20.455541 5518 tablet_copy_client.cc:240] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Beginning tablet copy session from remote peer at address dist-test-slave-dist-test-slave-1l7r:34339 I0403 04:30:20.456130 5011 tablet_copy_service.cc:135] P e94ae8064c284fceb0d8ce973d21b48e: Received BeginTabletCopySession request for tablet c2d1395ec3654af19c5e2d22f35c7852 from peer 71eb4565f22f4adfb6690d16bf8df52e ({username='slave'} at 172.17.0.2:50771) I0403 04:30:20.456251 5011 tablet_copy_service.cc:156] P e94ae8064c284fceb0d8ce973d21b48e: Beginning new tablet copy session on tablet c2d1395ec3654af19c5e2d22f35c7852 from peer 71eb4565f22f4adfb6690d16bf8df52e at {username='slave'} at 172.17.0.2:50771: session id = 71eb4565f22f4adfb6690d16bf8df52e-c2d1395ec3654af19c5e2d22f35c7852 I0403 04:30:20.458173 5011 tablet_copy_source_session.cc:202] T c2d1395ec3654af19c5e2d22f35c7852 P e94ae8064c284fceb0d8ce973d21b48e: Tablet Copy: opened 0 blocks and 1 log segments I0403 04:30:20.459278 5518 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c2d1395ec3654af19c5e2d22f35c7852. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:20.463217 5518 tablet_copy_client.cc:575] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Starting download of 0 data blocks... I0403 04:30:20.463484 5518 tablet_copy_client.cc:538] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Starting download of 1 WAL segments... I0403 04:30:20.464676 5518 tablet_copy_client.cc:414] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: tablet copy: Tablet Copy complete. Replacing tablet superblock. I0403 04:30:20.466517 5518 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap starting. I0403 04:30:20.469698 5518 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:30:20.470106 5518 tablet_bootstrap.cc:439] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Bootstrap complete. I0403 04:30:20.470460 5518 ts_tablet_manager.cc:1053] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent bootstrapping tablet: real 0.004s user 0.003s sys 0.001s I0403 04:30:20.471173 5518 raft_consensus.cc:340] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:20.471405 5518 raft_consensus.cc:705] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71eb4565f22f4adfb6690d16bf8df52e, State: Initialized, Role: FOLLOWER I0403 04:30:20.471560 5518 consensus_queue.cc:229] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e94ae8064c284fceb0d8ce973d21b48e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 34339 } } peers { permanent_uuid: "71eb4565f22f4adfb6690d16bf8df52e" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 33395 } } peers { permanent_uuid: "c5eb563f0f254100b5e86c37ec5229bb" member_type: VOTER last_known_addr { host: "dist-test-slave-dist-test-slave-1l7r" port: 41331 } } I0403 04:30:20.472172 5518 ts_tablet_manager.cc:1081] T c2d1395ec3654af19c5e2d22f35c7852 P 71eb4565f22f4adfb6690d16bf8df52e: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s I0403 04:30:20.473050 5011 tablet_copy_service.cc:325] P e94ae8064c284fceb0d8ce973d21b48e: Request end of tablet copy session 71eb4565f22f4adfb6690d16bf8df52e-c2d1395ec3654af19c5e2d22f35c7852 received from {username='slave'} at 172.17.0.2:50771 I0403 04:30:20.473163 5011 tablet_copy_service.cc:413] P e94ae8064c284fceb0d8ce973d21b48e: ending tablet copy session 71eb4565f22f4adfb6690d16bf8df52e-c2d1395ec3654af19c5e2d22f35c7852 on tablet c2d1395ec3654af19c5e2d22f35c7852 with peer 71eb4565f22f4adfb6690d16bf8df52e I0403 04:30:20.515457 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 4904 I0403 04:30:20.516603 5031 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:20.563961 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 4904 W0403 04:30:20.573101 4852 connection.cc:647] server connection from 172.17.0.2:42211 recv error: Network error: recv error from 0.0.0.0:0: Transport endpoint is not connected (error 107) I0403 04:30:20.573575 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 5369 I0403 04:30:20.574461 5487 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:20.621886 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 5369 I0403 04:30:20.630600 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 5160 I0403 04:30:20.635918 5276 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:20.680878 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 5160 I0403 04:30:20.689654 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 4844 I0403 04:30:20.690701 4900 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:20.756749 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 4844 [ OK ] ToolTest.TestRemoteReplicaCopy (3529 ms) [ RUN ] ToolTest.TestLocalReplicaCMetaOps I0403 04:30:20.776808 3617 internal_mini_cluster.cc:146] Creating distributed mini masters. Addrs: 127.3.136.126:32775 I0403 04:30:20.782770 3617 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 212135us I0403 04:30:20.783023 3617 fs_manager.cc:263] Metadata directory not provided I0403 04:30:20.783085 3617 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:20.783228 3617 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:20.783303 3617 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:20.783919 3617 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/master-0-root/instance: uuid: "df0cee1abdbc46799d5d6c4ac3334887" format_stamp: "Formatted at 2019-04-03 04:30:20 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:20.786916 3617 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.002s sys 0.003s I0403 04:30:20.787972 3617 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:20.789517 3617 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0403 04:30:20.789574 3617 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/master-0-root uuid: "df0cee1abdbc46799d5d6c4ac3334887" format_stamp: "Formatted at 2019-04-03 04:30:20 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:20.789677 3617 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/master-0-root metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/master-0-root 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/master-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:20.806509 3617 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:20.822460 3617 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:32775 I0403 04:30:20.823647 3617 webserver.cc:308] Webserver started at http://127.3.136.126:41515/ using document root and password file I0403 04:30:20.825806 5603 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:20.834960 5603 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887: Bootstrap starting. I0403 04:30:20.837366 5603 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887: No blocks or log segments found. Creating new log. I0403 04:30:20.838372 5603 log.cc:525] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887: Log is configured to *not* fsync() on all Append() calls I0403 04:30:20.839944 5603 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887: No bootstrap required, opened a new log I0403 04:30:20.846277 5603 raft_consensus.cc:340] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df0cee1abdbc46799d5d6c4ac3334887" member_type: VOTER } I0403 04:30:20.846544 5603 raft_consensus.cc:366] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:20.846637 5603 raft_consensus.cc:705] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df0cee1abdbc46799d5d6c4ac3334887, State: Initialized, Role: FOLLOWER I0403 04:30:20.847185 5603 consensus_queue.cc:229] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df0cee1abdbc46799d5d6c4ac3334887" member_type: VOTER } I0403 04:30:20.847369 5603 raft_consensus.cc:380] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:20.847470 5603 raft_consensus.cc:472] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:20.847594 5603 raft_consensus.cc:2886] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:20.849215 5603 raft_consensus.cc:494] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df0cee1abdbc46799d5d6c4ac3334887" member_type: VOTER } I0403 04:30:20.849656 5603 leader_election.cc:310] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: df0cee1abdbc46799d5d6c4ac3334887; no voters: I0403 04:30:20.850478 5605 raft_consensus.cc:2640] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:20.850809 5603 leader_election.cc:296] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:20.851603 5605 raft_consensus.cc:667] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 1 LEADER]: Becoming Leader. State: Replica: df0cee1abdbc46799d5d6c4ac3334887, State: Running, Role: LEADER I0403 04:30:20.851971 5605 consensus_queue.cc:206] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df0cee1abdbc46799d5d6c4ac3334887" member_type: VOTER } I0403 04:30:20.855157 5607 sys_catalog.cc:337] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [sys.catalog]: SysCatalogTable state changed. Reason: New leader df0cee1abdbc46799d5d6c4ac3334887. Latest consensus state: current_term: 1 leader_uuid: "df0cee1abdbc46799d5d6c4ac3334887" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df0cee1abdbc46799d5d6c4ac3334887" member_type: VOTER } } I0403 04:30:20.855762 5607 sys_catalog.cc:340] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [sys.catalog]: This master's current role is: LEADER I0403 04:30:20.855937 5603 sys_catalog.cc:337] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "df0cee1abdbc46799d5d6c4ac3334887" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df0cee1abdbc46799d5d6c4ac3334887" member_type: VOTER } } I0403 04:30:20.856166 5603 sys_catalog.cc:340] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [sys.catalog]: This master's current role is: LEADER I0403 04:30:20.856184 5606 sys_catalog.cc:337] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "df0cee1abdbc46799d5d6c4ac3334887" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "df0cee1abdbc46799d5d6c4ac3334887" member_type: VOTER } } I0403 04:30:20.856575 5606 sys_catalog.cc:340] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [sys.catalog]: This master's current role is: LEADER I0403 04:30:20.857393 5603 sys_catalog.cc:424] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:20.857565 5611 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:20.858073 3617 internal_mini_cluster.cc:166] Waiting to initialize catalog manager on master 0 I0403 04:30:20.867988 5611 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:20.940126 5611 catalog_manager.cc:950] Generated new certificate authority record I0403 04:30:20.942163 5611 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:20.953999 5611 catalog_manager.cc:4281] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887: Generated new TSK 0 I0403 04:30:20.990648 3617 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 212135us I0403 04:30:20.990885 3617 fs_manager.cc:263] Metadata directory not provided I0403 04:30:20.990957 3617 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:20.991114 3617 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:20.991173 3617 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:20.991896 3617 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/ts-0-root/instance: uuid: "29a6685089da43978e6e04963789cba9" format_stamp: "Formatted at 2019-04-03 04:30:20 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:21.006623 3617 fs_manager.cc:503] Time spent creating directory manager: real 0.014s user 0.004s sys 0.010s I0403 04:30:21.007928 3617 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:21.009918 3617 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0403 04:30:21.010008 3617 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/ts-0-root uuid: "29a6685089da43978e6e04963789cba9" format_stamp: "Formatted at 2019-04-03 04:30:20 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:21.010108 3617 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/ts-0-root metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/ts-0-root 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestLocalReplicaCMetaOps.1554265799459872-3617/minicluster-data/ts-0-root/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:21.054699 3617 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:21.054821 3617 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:21.095592 3617 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:34057 I0403 04:30:21.096693 3617 webserver.cc:308] Webserver started at http://127.3.136.65:33173/ using document root and password file I0403 04:30:21.111783 5679 heartbeater.cc:345] Connected to a master server at 127.3.136.126:32775 I0403 04:30:21.112043 5679 heartbeater.cc:426] Registering TS with master... I0403 04:30:21.112602 5679 heartbeater.cc:475] Master 127.3.136.126:32775 requested a full tablet report, sending... I0403 04:30:21.114444 5570 ts_manager.cc:159] Registered new tserver with Master: 29a6685089da43978e6e04963789cba9 (127.3.136.65:34057) I0403 04:30:21.114589 3617 internal_mini_cluster.cc:328] 1 TS(s) registered with all masters after 0.016786512s I0403 04:30:21.115967 3617 test_util.cc:212] Using random seed: -1238927863 I0403 04:30:21.117558 5570 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55288 I0403 04:30:21.129392 5570 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55290: name: "test-workload" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:21.154973 5646 tablet_service.cc:1006] Processing CreateTablet for tablet 070407c974924146994215e8b0ac2fdd (table=test-workload [id=87e838acff044d2c8d891b7c45bb9fed]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:21.155520 5646 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 070407c974924146994215e8b0ac2fdd. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:21.162227 5691 tablet_bootstrap.cc:439] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9: Bootstrap starting. I0403 04:30:21.163810 5691 tablet_bootstrap.cc:590] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9: No blocks or log segments found. Creating new log. I0403 04:30:21.166616 5691 tablet_bootstrap.cc:439] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9: No bootstrap required, opened a new log I0403 04:30:21.166780 5691 ts_tablet_manager.cc:1053] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9: Time spent bootstrapping tablet: real 0.005s user 0.000s sys 0.004s I0403 04:30:21.167713 5691 raft_consensus.cc:340] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a6685089da43978e6e04963789cba9" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 34057 } } I0403 04:30:21.167920 5691 raft_consensus.cc:366] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:21.167997 5691 raft_consensus.cc:705] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29a6685089da43978e6e04963789cba9, State: Initialized, Role: FOLLOWER I0403 04:30:21.168256 5691 consensus_queue.cc:229] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a6685089da43978e6e04963789cba9" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 34057 } } I0403 04:30:21.168437 5691 raft_consensus.cc:380] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:21.168517 5691 raft_consensus.cc:472] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:21.168612 5691 raft_consensus.cc:2886] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:21.170339 5691 raft_consensus.cc:494] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a6685089da43978e6e04963789cba9" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 34057 } } I0403 04:30:21.170581 5691 leader_election.cc:310] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29a6685089da43978e6e04963789cba9; no voters: I0403 04:30:21.174000 5691 leader_election.cc:296] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:21.174253 5693 raft_consensus.cc:2640] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:21.175658 5679 heartbeater.cc:467] Master 127.3.136.126:32775 was elected leader, sending a full tablet report... I0403 04:30:21.175662 5693 raft_consensus.cc:667] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 1 LEADER]: Becoming Leader. State: Replica: 29a6685089da43978e6e04963789cba9, State: Running, Role: LEADER I0403 04:30:21.175869 5691 ts_tablet_manager.cc:1081] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9: Time spent starting tablet: real 0.009s user 0.003s sys 0.006s I0403 04:30:21.176067 5693 consensus_queue.cc:206] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a6685089da43978e6e04963789cba9" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 34057 } } I0403 04:30:21.187361 5570 catalog_manager.cc:3977] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 reported cstate change: term changed from 0 to 1, leader changed from to 29a6685089da43978e6e04963789cba9 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "29a6685089da43978e6e04963789cba9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29a6685089da43978e6e04963789cba9" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 34057 } health_report { overall_health: HEALTHY } } } I0403 04:30:21.485211 3617 tablet_server.cc:165] TabletServer shutting down... I0403 04:30:21.498970 3617 ts_tablet_manager.cc:1126] Shutting down tablet manager... I0403 04:30:21.499286 3617 tablet_replica.cc:264] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9: stopping tablet replica I0403 04:30:21.499763 3617 raft_consensus.cc:2143] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:21.499996 3617 raft_consensus.cc:2170] T 070407c974924146994215e8b0ac2fdd P 29a6685089da43978e6e04963789cba9 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:21.517184 3617 tablet_server.cc:179] TabletServer shutdown complete. I0403 04:30:21.517261 3617 tablet_server.cc:165] TabletServer shutting down... I0403 04:30:21.517437 3617 tablet_server.cc:179] TabletServer shutdown complete. I0403 04:30:22.671882 3617 master.cc:270] Master@127.3.136.126:32775 shutting down... I0403 04:30:22.682358 3617 raft_consensus.cc:2143] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 1 LEADER]: Raft consensus shutting down. I0403 04:30:22.682561 3617 raft_consensus.cc:2170] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887 [term 1 FOLLOWER]: Raft consensus is shut down! I0403 04:30:22.682690 3617 tablet_replica.cc:264] T 00000000000000000000000000000000 P df0cee1abdbc46799d5d6c4ac3334887: stopping tablet replica I0403 04:30:22.696126 3617 master.cc:281] Master@127.3.136.126:32775 shutdown complete. [ OK ] ToolTest.TestLocalReplicaCMetaOps (1928 ms) [ RUN ] ToolTest.TestMasterList I0403 04:30:22.706447 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:36891 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:22.882454 5736 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:22.882692 5736 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:22.885222 5736 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:30:22.885279 5736 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:22.885362 5736 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:30:22.885422 5736 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:30:22.889748 5736 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:36891 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:22.895967 5736 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 213135us I0403 04:30:22.897076 5736 fs_manager.cc:263] Metadata directory not provided I0403 04:30:22.897156 5736 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:22.897481 5736 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:22.897563 5736 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:22.900013 5736 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "7cd094c954bc4c208073fd46a9b88c6b" format_stamp: "Formatted at 2019-04-03 04:30:22 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:22.900614 5736 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "7cd094c954bc4c208073fd46a9b88c6b" format_stamp: "Formatted at 2019-04-03 04:30:22 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:22.906702 5736 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s I0403 04:30:22.907805 5736 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:22.908700 5736 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:22.911521 5736 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:22.911581 5736 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/wal uuid: "7cd094c954bc4c208073fd46a9b88c6b" format_stamp: "Formatted at 2019-04-03 04:30:22 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:22.911749 5736 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:22.934777 5736 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:22.948272 5736 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:36891 I0403 04:30:22.949192 5736 webserver.cc:308] Webserver started at http://127.3.136.126:40499/ using document root and password file I0403 04:30:22.949795 5736 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestMasterList.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:30:22.952723 5795 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:22.959278 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 5736 I0403 04:30:22.965474 5795 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b: Bootstrap starting. I0403 04:30:22.968276 5795 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b: No blocks or log segments found. Creating new log. I0403 04:30:22.969434 5795 log.cc:525] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b: Log is configured to *not* fsync() on all Append() calls I0403 04:30:22.971092 5795 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b: No bootstrap required, opened a new log I0403 04:30:22.971940 3617 external_mini_cluster.cc:623] 0 TS(s) registered with all masters I0403 04:30:22.978909 5795 raft_consensus.cc:340] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd094c954bc4c208073fd46a9b88c6b" member_type: VOTER } I0403 04:30:22.979205 5795 raft_consensus.cc:366] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:22.979282 5795 raft_consensus.cc:705] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7cd094c954bc4c208073fd46a9b88c6b, State: Initialized, Role: FOLLOWER I0403 04:30:22.979796 5795 consensus_queue.cc:229] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd094c954bc4c208073fd46a9b88c6b" member_type: VOTER } I0403 04:30:22.980005 5795 raft_consensus.cc:380] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:22.980103 5795 raft_consensus.cc:472] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:22.980217 5795 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:22.985963 5795 raft_consensus.cc:494] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd094c954bc4c208073fd46a9b88c6b" member_type: VOTER } I0403 04:30:22.986354 5795 leader_election.cc:310] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7cd094c954bc4c208073fd46a9b88c6b; no voters: I0403 04:30:22.987100 5800 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:22.990016 5800 raft_consensus.cc:667] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [term 1 LEADER]: Becoming Leader. State: Replica: 7cd094c954bc4c208073fd46a9b88c6b, State: Running, Role: LEADER I0403 04:30:22.990355 5795 leader_election.cc:296] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:22.990515 5800 consensus_queue.cc:206] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd094c954bc4c208073fd46a9b88c6b" member_type: VOTER } I0403 04:30:22.994760 5801 sys_catalog.cc:337] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7cd094c954bc4c208073fd46a9b88c6b. Latest consensus state: current_term: 1 leader_uuid: "7cd094c954bc4c208073fd46a9b88c6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd094c954bc4c208073fd46a9b88c6b" member_type: VOTER } } I0403 04:30:22.995035 5802 sys_catalog.cc:337] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7cd094c954bc4c208073fd46a9b88c6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd094c954bc4c208073fd46a9b88c6b" member_type: VOTER } } I0403 04:30:22.995352 5795 sys_catalog.cc:337] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "7cd094c954bc4c208073fd46a9b88c6b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7cd094c954bc4c208073fd46a9b88c6b" member_type: VOTER } } I0403 04:30:22.995585 5802 sys_catalog.cc:340] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [sys.catalog]: This master's current role is: LEADER I0403 04:30:22.995656 5795 sys_catalog.cc:340] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [sys.catalog]: This master's current role is: LEADER I0403 04:30:22.995506 5801 sys_catalog.cc:340] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [sys.catalog]: This master's current role is: LEADER I0403 04:30:22.998329 5795 sys_catalog.cc:424] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:22.998929 5804 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:23.002940 5804 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:23.079694 5804 catalog_manager.cc:950] Generated new certificate authority record I0403 04:30:23.080935 5804 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:23.087721 5804 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 7cd094c954bc4c208073fd46a9b88c6b: Generated new TSK 0 I0403 04:30:23.425038 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 5736 I0403 04:30:23.426266 5792 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:23.500300 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 5736 [ OK ] ToolTest.TestMasterList (811 ms) [ RUN ] ToolTest.TestListTables I0403 04:30:23.516656 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:44085 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:23.696457 5821 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:23.696658 5821 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:23.699095 5821 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:30:23.699139 5821 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:23.699177 5821 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:30:23.699215 5821 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:30:23.703493 5821 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:44085 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:23.709331 5821 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 213635us I0403 04:30:23.710512 5821 fs_manager.cc:263] Metadata directory not provided I0403 04:30:23.710600 5821 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:23.710885 5821 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:23.711022 5821 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:23.713521 5821 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "34018d56fdec4f959d451136e67dde5c" format_stamp: "Formatted at 2019-04-03 04:30:23 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:23.714155 5821 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "34018d56fdec4f959d451136e67dde5c" format_stamp: "Formatted at 2019-04-03 04:30:23 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:23.720799 5821 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s I0403 04:30:23.721942 5821 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:23.722584 5821 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:23.725581 5821 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:23.725638 5821 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/wal uuid: "34018d56fdec4f959d451136e67dde5c" format_stamp: "Formatted at 2019-04-03 04:30:23 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:23.725800 5821 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:23.744367 5821 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:23.762796 5821 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:44085 I0403 04:30:23.763700 5821 webserver.cc:308] Webserver started at http://127.3.136.126:42637/ using document root and password file I0403 04:30:23.764235 5821 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:30:23.767117 5880 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:23.769032 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 5821 I0403 04:30:23.769662 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.3.136.65:0 --local_ip_for_outbound_sockets=127.3.136.65 --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:44085 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:23.782385 5880 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c: Bootstrap starting. I0403 04:30:23.784811 5880 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c: No blocks or log segments found. Creating new log. I0403 04:30:23.785708 5880 log.cc:525] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c: Log is configured to *not* fsync() on all Append() calls I0403 04:30:23.795172 5880 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c: No bootstrap required, opened a new log I0403 04:30:23.805514 5880 raft_consensus.cc:340] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34018d56fdec4f959d451136e67dde5c" member_type: VOTER } I0403 04:30:23.805797 5880 raft_consensus.cc:366] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:23.805896 5880 raft_consensus.cc:705] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 34018d56fdec4f959d451136e67dde5c, State: Initialized, Role: FOLLOWER I0403 04:30:23.806488 5880 consensus_queue.cc:229] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34018d56fdec4f959d451136e67dde5c" member_type: VOTER } I0403 04:30:23.806715 5880 raft_consensus.cc:380] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:23.806818 5880 raft_consensus.cc:472] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:23.806947 5880 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:23.809377 5880 raft_consensus.cc:494] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34018d56fdec4f959d451136e67dde5c" member_type: VOTER } I0403 04:30:23.809846 5880 leader_election.cc:310] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 34018d56fdec4f959d451136e67dde5c; no voters: I0403 04:30:23.814049 5880 leader_election.cc:296] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:23.814236 5883 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:23.818341 5883 raft_consensus.cc:667] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [term 1 LEADER]: Becoming Leader. State: Replica: 34018d56fdec4f959d451136e67dde5c, State: Running, Role: LEADER I0403 04:30:23.818699 5883 consensus_queue.cc:206] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34018d56fdec4f959d451136e67dde5c" member_type: VOTER } I0403 04:30:23.821549 5885 sys_catalog.cc:337] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 34018d56fdec4f959d451136e67dde5c. Latest consensus state: current_term: 1 leader_uuid: "34018d56fdec4f959d451136e67dde5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34018d56fdec4f959d451136e67dde5c" member_type: VOTER } } I0403 04:30:23.822330 5885 sys_catalog.cc:340] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [sys.catalog]: This master's current role is: LEADER I0403 04:30:23.822834 5880 sys_catalog.cc:337] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "34018d56fdec4f959d451136e67dde5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34018d56fdec4f959d451136e67dde5c" member_type: VOTER } } I0403 04:30:23.822806 5884 sys_catalog.cc:337] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "34018d56fdec4f959d451136e67dde5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "34018d56fdec4f959d451136e67dde5c" member_type: VOTER } } I0403 04:30:23.823305 5884 sys_catalog.cc:340] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [sys.catalog]: This master's current role is: LEADER I0403 04:30:23.823390 5880 sys_catalog.cc:340] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [sys.catalog]: This master's current role is: LEADER I0403 04:30:23.824628 5880 sys_catalog.cc:424] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:23.825022 5889 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:23.826895 5890 catalog_manager.cc:536] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting I0403 04:30:23.836344 5889 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:23.863692 5889 catalog_manager.cc:950] Generated new certificate authority record I0403 04:30:23.865061 5889 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:23.879509 5889 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 34018d56fdec4f959d451136e67dde5c: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:23.955340 5881 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:23.955605 5881 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:23.957806 5881 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:23.957988 5881 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.65 I0403 04:30:23.974005 5881 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.65:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:44085 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.65 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:23.980883 5881 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 213635us I0403 04:30:23.981472 5881 fs_manager.cc:263] Metadata directory not provided I0403 04:30:23.981564 5881 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:23.981858 5881 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:23.981948 5881 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:23.984192 5881 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "f063f40f9f714d2fb4cf81d9c55f7060" format_stamp: "Formatted at 2019-04-03 04:30:23 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:23.984732 5881 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "f063f40f9f714d2fb4cf81d9c55f7060" format_stamp: "Formatted at 2019-04-03 04:30:23 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:24.003360 5881 fs_manager.cc:503] Time spent creating directory manager: real 0.018s user 0.011s sys 0.009s I0403 04:30:24.004479 5881 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:24.005039 5881 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:24.007767 5881 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:24.007840 5881 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "f063f40f9f714d2fb4cf81d9c55f7060" format_stamp: "Formatted at 2019-04-03 04:30:23 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:24.007993 5881 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:24.078574 5881 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:24.090760 5881 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:24.090822 5881 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:24.211339 5881 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:45421 I0403 04:30:24.212400 5881 webserver.cc:308] Webserver started at http://127.3.136.65:33395/ using document root and password file I0403 04:30:24.213006 5881 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestListTables.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:30:24.222520 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 5881 I0403 04:30:24.229743 6011 heartbeater.cc:345] Connected to a master server at 127.3.136.126:44085 I0403 04:30:24.229992 6011 heartbeater.cc:426] Registering TS with master... I0403 04:30:24.230566 6011 heartbeater.cc:475] Master 127.3.136.126:44085 requested a full tablet report, sending... I0403 04:30:24.231916 5847 ts_manager.cc:159] Registered new tserver with Master: f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65:45421) I0403 04:30:24.233630 5847 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.65:37875 I0403 04:30:24.234421 3617 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0403 04:30:24.243221 3617 test_util.cc:212] Using random seed: -1235800570 I0403 04:30:24.252099 5847 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49140: name: "kudu.table_0" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.277566 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 59d5f17b79394a28a0e3bbd5c81bc86a (table=kudu.table_0 [id=d88d38556bcc474288f40b7d008e7a6d]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.278491 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 59d5f17b79394a28a0e3bbd5c81bc86a. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.289031 6029 tablet_bootstrap.cc:439] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.291200 6029 tablet_bootstrap.cc:590] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.292160 6029 log.cc:525] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060: Log is configured to *not* fsync() on all Append() calls I0403 04:30:24.294041 6029 tablet_bootstrap.cc:439] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.294417 6029 ts_tablet_manager.cc:1053] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s I0403 04:30:24.300536 6029 raft_consensus.cc:340] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.300820 6029 raft_consensus.cc:366] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.300899 6029 raft_consensus.cc:705] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.301355 6029 consensus_queue.cc:229] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.301517 6029 raft_consensus.cc:380] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.301610 6029 raft_consensus.cc:472] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.301710 6029 raft_consensus.cc:2886] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.303551 6029 raft_consensus.cc:494] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.303998 6029 leader_election.cc:310] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.304582 6031 raft_consensus.cc:2640] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.304922 6029 leader_election.cc:296] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.305794 6011 heartbeater.cc:467] Master 127.3.136.126:44085 was elected leader, sending a full tablet report... I0403 04:30:24.305800 6031 raft_consensus.cc:667] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.306299 6031 consensus_queue.cc:206] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.306594 6029 ts_tablet_manager.cc:1081] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.012s user 0.007s sys 0.004s I0403 04:30:24.309295 5847 catalog_manager.cc:3977] T 59d5f17b79394a28a0e3bbd5c81bc86a P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.315387 3617 test_util.cc:212] Using random seed: -1235728483 I0403 04:30:24.323810 5847 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49144: name: "kudu.table_1" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.329346 5948 tablet_service.cc:1006] Processing CreateTablet for tablet fa67e791d0214f13a60254b31cfc80e0 (table=kudu.table_1 [id=3117ff29abf442d89d2ac06c46587a61]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.329664 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet fa67e791d0214f13a60254b31cfc80e0. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.333513 6029 tablet_bootstrap.cc:439] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.334686 6029 tablet_bootstrap.cc:590] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.336087 6029 tablet_bootstrap.cc:439] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.336200 6029 ts_tablet_manager.cc:1053] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:24.336817 6029 raft_consensus.cc:340] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.336935 6029 raft_consensus.cc:366] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.337007 6029 raft_consensus.cc:705] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.337172 6029 consensus_queue.cc:229] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.337299 6029 raft_consensus.cc:380] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.337384 6029 raft_consensus.cc:472] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.337476 6029 raft_consensus.cc:2886] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.339051 6029 raft_consensus.cc:494] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.339224 6029 leader_election.cc:310] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.339414 6029 leader_election.cc:296] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.339490 6031 raft_consensus.cc:2640] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.339670 6031 raft_consensus.cc:667] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.339823 6029 ts_tablet_manager.cc:1081] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:24.339849 6031 consensus_queue.cc:206] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.341274 5847 catalog_manager.cc:3977] T fa67e791d0214f13a60254b31cfc80e0 P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.348048 3617 test_util.cc:212] Using random seed: -1235696007 I0403 04:30:24.356591 5847 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49146: name: "kudu.table_2" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.362192 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 5ff4883fc4c94ec3929261a60dfc7414 (table=kudu.table_2 [id=dcb84bdc3b25444496e45a3b2db6dc4d]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.362581 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 5ff4883fc4c94ec3929261a60dfc7414. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.365980 6029 tablet_bootstrap.cc:439] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.367054 6029 tablet_bootstrap.cc:590] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.368750 6029 tablet_bootstrap.cc:439] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.368875 6029 ts_tablet_manager.cc:1053] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:24.369396 6029 raft_consensus.cc:340] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.369531 6029 raft_consensus.cc:366] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.369596 6029 raft_consensus.cc:705] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.369766 6029 consensus_queue.cc:229] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.369920 6029 raft_consensus.cc:380] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.369997 6029 raft_consensus.cc:472] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.370070 6029 raft_consensus.cc:2886] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.371601 6029 raft_consensus.cc:494] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.371767 6029 leader_election.cc:310] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.371986 6029 leader_election.cc:296] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.372081 6031 raft_consensus.cc:2640] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.372246 6031 raft_consensus.cc:667] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.372506 6029 ts_tablet_manager.cc:1081] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:24.372452 6031 consensus_queue.cc:206] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.374050 5847 catalog_manager.cc:3977] T 5ff4883fc4c94ec3929261a60dfc7414 P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.381064 3617 test_util.cc:212] Using random seed: -1235663041 I0403 04:30:24.389304 5847 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49148: name: "kudu.table_3" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.394094 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 38c4d2907b9d4a1f928b27cf14c49f0c (table=kudu.table_3 [id=79d03c2a3e034ffcb6c0a2e9bd3a1a3d]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.394471 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 38c4d2907b9d4a1f928b27cf14c49f0c. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.397853 6029 tablet_bootstrap.cc:439] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.398838 6029 tablet_bootstrap.cc:590] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.400399 6029 tablet_bootstrap.cc:439] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.400519 6029 ts_tablet_manager.cc:1053] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.000s sys 0.002s I0403 04:30:24.401005 6029 raft_consensus.cc:340] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.401131 6029 raft_consensus.cc:366] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.401182 6029 raft_consensus.cc:705] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.401365 6029 consensus_queue.cc:229] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.401574 6029 raft_consensus.cc:380] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.401634 6029 raft_consensus.cc:472] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.401718 6029 raft_consensus.cc:2886] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.403112 6029 raft_consensus.cc:494] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.403362 6029 leader_election.cc:310] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.403518 6029 leader_election.cc:296] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.403736 6032 raft_consensus.cc:2640] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.403924 6029 ts_tablet_manager.cc:1081] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.003s user 0.002s sys 0.001s I0403 04:30:24.403925 6032 raft_consensus.cc:667] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.404188 6032 consensus_queue.cc:206] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.410817 5847 catalog_manager.cc:3977] T 38c4d2907b9d4a1f928b27cf14c49f0c P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.419442 3617 test_util.cc:212] Using random seed: -1235624718 I0403 04:30:24.428514 5847 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49150: name: "kudu.table_4" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.433881 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 638a1fcf6ef1450282709c5af4355608 (table=kudu.table_4 [id=ab70f0d59be2462dadfec8399b9ac236]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.434187 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 638a1fcf6ef1450282709c5af4355608. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.438127 6029 tablet_bootstrap.cc:439] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.439151 6029 tablet_bootstrap.cc:590] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.440635 6029 tablet_bootstrap.cc:439] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.440745 6029 ts_tablet_manager.cc:1053] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s I0403 04:30:24.441267 6029 raft_consensus.cc:340] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.441409 6029 raft_consensus.cc:366] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.441453 6029 raft_consensus.cc:705] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.441625 6029 consensus_queue.cc:229] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.441758 6029 raft_consensus.cc:380] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.441923 6029 raft_consensus.cc:472] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.441983 6029 raft_consensus.cc:2886] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.443493 6029 raft_consensus.cc:494] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.443698 6029 leader_election.cc:310] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.443881 6029 leader_election.cc:296] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.443943 6032 raft_consensus.cc:2640] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.444094 6032 raft_consensus.cc:667] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.444267 6032 consensus_queue.cc:206] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.444418 6029 ts_tablet_manager.cc:1081] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:24.445770 5847 catalog_manager.cc:3977] T 638a1fcf6ef1450282709c5af4355608 P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.453374 3617 test_util.cc:212] Using random seed: -1235590960 I0403 04:30:24.461814 5847 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49152: name: "kudu.table_5" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.466987 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 84ede476321c49838fbfa25edee8f88b (table=kudu.table_5 [id=1a988816521b486d8d834765989a8418]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.467310 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 84ede476321c49838fbfa25edee8f88b. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.471137 6029 tablet_bootstrap.cc:439] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.472152 6029 tablet_bootstrap.cc:590] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.473691 6029 tablet_bootstrap.cc:439] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.473788 6029 ts_tablet_manager.cc:1053] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:24.474341 6029 raft_consensus.cc:340] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.474462 6029 raft_consensus.cc:366] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.474514 6029 raft_consensus.cc:705] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.474655 6029 consensus_queue.cc:229] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.474772 6029 raft_consensus.cc:380] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.474817 6029 raft_consensus.cc:472] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.474880 6029 raft_consensus.cc:2886] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.476310 6029 raft_consensus.cc:494] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.476564 6029 leader_election.cc:310] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.476786 6029 leader_election.cc:296] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.476887 6032 raft_consensus.cc:2640] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.477068 6032 raft_consensus.cc:667] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.477258 6032 consensus_queue.cc:206] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.477394 6029 ts_tablet_manager.cc:1081] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s I0403 04:30:24.478735 5847 catalog_manager.cc:3977] T 84ede476321c49838fbfa25edee8f88b P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.481873 3617 test_util.cc:212] Using random seed: -1235562114 I0403 04:30:24.490355 5846 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49154: name: "kudu.table_6" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.495470 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 3048dfdbf20548b8bbd866066c7563d9 (table=kudu.table_6 [id=cbf25ed6f4b34b9f8774faf12344cd54]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.495790 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3048dfdbf20548b8bbd866066c7563d9. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.499538 6029 tablet_bootstrap.cc:439] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.500670 6029 tablet_bootstrap.cc:590] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.502436 6029 tablet_bootstrap.cc:439] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.502559 6029 ts_tablet_manager.cc:1053] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:24.503166 6029 raft_consensus.cc:340] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.503290 6029 raft_consensus.cc:366] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.503362 6029 raft_consensus.cc:705] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.503533 6029 consensus_queue.cc:229] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.503650 6029 raft_consensus.cc:380] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.503727 6029 raft_consensus.cc:472] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.503800 6029 raft_consensus.cc:2886] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.505373 6029 raft_consensus.cc:494] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.505570 6029 leader_election.cc:310] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.505760 6029 leader_election.cc:296] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.505842 6032 raft_consensus.cc:2640] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.506006 6032 raft_consensus.cc:667] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.506243 6029 ts_tablet_manager.cc:1081] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:24.506207 6032 consensus_queue.cc:206] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.507912 5846 catalog_manager.cc:3977] T 3048dfdbf20548b8bbd866066c7563d9 P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.515787 3617 test_util.cc:212] Using random seed: -1235528019 I0403 04:30:24.524374 5846 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49156: name: "kudu.table_7" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.529444 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 1fb7ce97f33f4d3a998376704b730b56 (table=kudu.table_7 [id=e5a840064854438ebbc87157c7572fba]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.529736 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1fb7ce97f33f4d3a998376704b730b56. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.533031 6029 tablet_bootstrap.cc:439] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.534128 6029 tablet_bootstrap.cc:590] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.535569 6029 tablet_bootstrap.cc:439] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.535689 6029 ts_tablet_manager.cc:1053] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:24.536327 6029 raft_consensus.cc:340] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.536432 6029 raft_consensus.cc:366] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.536500 6029 raft_consensus.cc:705] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.536667 6029 consensus_queue.cc:229] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.536820 6029 raft_consensus.cc:380] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.536892 6029 raft_consensus.cc:472] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.536983 6029 raft_consensus.cc:2886] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.538442 6029 raft_consensus.cc:494] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.538635 6029 leader_election.cc:310] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.538847 6029 leader_election.cc:296] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.538947 6032 raft_consensus.cc:2640] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.539070 6032 raft_consensus.cc:667] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.539239 6032 consensus_queue.cc:206] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.539530 6029 ts_tablet_manager.cc:1081] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:24.546473 5846 catalog_manager.cc:3977] T 1fb7ce97f33f4d3a998376704b730b56 P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.555002 3617 test_util.cc:212] Using random seed: -1235489001 I0403 04:30:24.563328 5846 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49158: name: "kudu.table_8" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.568464 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 7065522f378740e99f4f590c37fcea3d (table=kudu.table_8 [id=e5754b739c7e4ecfa21a8faf9d69affc]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.568751 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 7065522f378740e99f4f590c37fcea3d. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.572165 6029 tablet_bootstrap.cc:439] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.573346 6029 tablet_bootstrap.cc:590] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.574913 6029 tablet_bootstrap.cc:439] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.575057 6029 ts_tablet_manager.cc:1053] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:24.575567 6029 raft_consensus.cc:340] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.575690 6029 raft_consensus.cc:366] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.575736 6029 raft_consensus.cc:705] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.575901 6029 consensus_queue.cc:229] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.576019 6029 raft_consensus.cc:380] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.576076 6029 raft_consensus.cc:472] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.576134 6029 raft_consensus.cc:2886] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.577591 6029 raft_consensus.cc:494] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.577785 6029 leader_election.cc:310] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.578022 6029 leader_election.cc:296] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.578090 6033 raft_consensus.cc:2640] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.578240 6033 raft_consensus.cc:667] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.578531 6033 consensus_queue.cc:206] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.578733 6029 ts_tablet_manager.cc:1081] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:24.580058 5846 catalog_manager.cc:3977] T 7065522f378740e99f4f590c37fcea3d P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:24.588095 3617 test_util.cc:212] Using random seed: -1235455951 I0403 04:30:24.596201 5846 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49160: name: "kudu.table_9" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:30:24.601291 5948 tablet_service.cc:1006] Processing CreateTablet for tablet 8f2e4cf1d80f466aa8264910cbe38a3e (table=kudu.table_9 [id=ef1a3a159ef840df9830fa2adbd8c29c]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:30:24.601634 5948 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 8f2e4cf1d80f466aa8264910cbe38a3e. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:24.605268 6029 tablet_bootstrap.cc:439] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060: Bootstrap starting. I0403 04:30:24.606370 6029 tablet_bootstrap.cc:590] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060: No blocks or log segments found. Creating new log. I0403 04:30:24.607950 6029 tablet_bootstrap.cc:439] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060: No bootstrap required, opened a new log I0403 04:30:24.608100 6029 ts_tablet_manager.cc:1053] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:24.608626 6029 raft_consensus.cc:340] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.608733 6029 raft_consensus.cc:366] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:24.608805 6029 raft_consensus.cc:705] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Initialized, Role: FOLLOWER I0403 04:30:24.608963 6029 consensus_queue.cc:229] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.609099 6029 raft_consensus.cc:380] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:24.609158 6029 raft_consensus.cc:472] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:24.609241 6029 raft_consensus.cc:2886] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:24.610741 6029 raft_consensus.cc:494] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.610956 6029 leader_election.cc:310] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f063f40f9f714d2fb4cf81d9c55f7060; no voters: I0403 04:30:24.611203 6029 leader_election.cc:296] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:24.611287 6033 raft_consensus.cc:2640] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:24.611475 6033 raft_consensus.cc:667] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [term 1 LEADER]: Becoming Leader. State: Replica: f063f40f9f714d2fb4cf81d9c55f7060, State: Running, Role: LEADER I0403 04:30:24.611618 6033 consensus_queue.cc:206] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } } I0403 04:30:24.611716 6029 ts_tablet_manager.cc:1081] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060: Time spent starting tablet: real 0.004s user 0.001s sys 0.003s I0403 04:30:24.613090 5846 catalog_manager.cc:3977] T 8f2e4cf1d80f466aa8264910cbe38a3e P f063f40f9f714d2fb4cf81d9c55f7060 reported cstate change: term changed from 0 to 1, leader changed from to f063f40f9f714d2fb4cf81d9c55f7060 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f063f40f9f714d2fb4cf81d9c55f7060" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45421 } health_report { overall_health: HEALTHY } } } I0403 04:30:31.074604 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 5881 I0403 04:30:31.086002 6008 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:31.144120 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 5881 I0403 04:30:31.154114 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 5821 I0403 04:30:31.155086 5877 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:31.224663 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 5821 [ OK ] ToolTest.TestListTables (7729 ms) [ RUN ] ToolTest.TestHmsPrecheck 2019-04-03 04:30:31: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/derby.log log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-tasks9LKQH/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-tasks9LKQH/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Starting hive metastore on port 0 2795 T1 odu.Log4JLogger.info Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2805 T1 odu.Log4JLogger.info Property datanucleus.cache.level2 unknown - will be ignored I0403 04:30:41.895433 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:38219 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:42.079344 6442 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:42.079540 6442 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:42.082093 6442 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:30:42.082139 6442 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:42.082181 6442 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:30:42.082221 6442 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:30:42.086632 6442 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:38219 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:42.092510 6442 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 223135us I0403 04:30:42.093580 6442 fs_manager.cc:263] Metadata directory not provided I0403 04:30:42.093657 6442 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:42.093930 6442 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:42.094005 6442 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:42.096240 6442 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "10dd2b69327842a9b8112139d0a57418" format_stamp: "Formatted at 2019-04-03 04:30:42 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:42.096807 6442 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "10dd2b69327842a9b8112139d0a57418" format_stamp: "Formatted at 2019-04-03 04:30:42 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:42.103155 6442 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s I0403 04:30:42.104506 6442 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:42.105077 6442 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:42.108093 6442 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:42.108155 6442 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal uuid: "10dd2b69327842a9b8112139d0a57418" format_stamp: "Formatted at 2019-04-03 04:30:42 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:42.108402 6442 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:42.159726 6442 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:42.174754 6442 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:38219 I0403 04:30:42.175751 6442 webserver.cc:308] Webserver started at http://127.3.136.126:45919/ using document root and password file I0403 04:30:42.176297 6442 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:30:42.179249 6501 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.179425 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 6442 I0403 04:30:42.180089 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.3.136.65:0 --local_ip_for_outbound_sockets=127.3.136.65 --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:38219 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:42.191547 6501 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: Bootstrap starting. I0403 04:30:42.193994 6501 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: No blocks or log segments found. Creating new log. I0403 04:30:42.194900 6501 log.cc:525] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: Log is configured to *not* fsync() on all Append() calls I0403 04:30:42.198997 6501 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: No bootstrap required, opened a new log I0403 04:30:42.205978 6501 raft_consensus.cc:340] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } I0403 04:30:42.206195 6501 raft_consensus.cc:366] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.206265 6501 raft_consensus.cc:705] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dd2b69327842a9b8112139d0a57418, State: Initialized, Role: FOLLOWER I0403 04:30:42.206845 6501 consensus_queue.cc:229] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } I0403 04:30:42.207049 6501 raft_consensus.cc:380] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.207159 6501 raft_consensus.cc:472] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.207283 6501 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.208894 6501 raft_consensus.cc:494] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } I0403 04:30:42.209251 6501 leader_election.cc:310] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10dd2b69327842a9b8112139d0a57418; no voters: I0403 04:30:42.210278 6501 leader_election.cc:296] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.210440 6504 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.211501 6504 raft_consensus.cc:667] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 1 LEADER]: Becoming Leader. State: Replica: 10dd2b69327842a9b8112139d0a57418, State: Running, Role: LEADER I0403 04:30:42.211869 6504 consensus_queue.cc:206] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } I0403 04:30:42.214619 6501 sys_catalog.cc:337] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "10dd2b69327842a9b8112139d0a57418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } } I0403 04:30:42.214990 6501 sys_catalog.cc:340] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: This master's current role is: LEADER I0403 04:30:42.214967 6505 sys_catalog.cc:337] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "10dd2b69327842a9b8112139d0a57418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } } I0403 04:30:42.214968 6506 sys_catalog.cc:337] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10dd2b69327842a9b8112139d0a57418. Latest consensus state: current_term: 1 leader_uuid: "10dd2b69327842a9b8112139d0a57418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } } I0403 04:30:42.215590 6506 sys_catalog.cc:340] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: This master's current role is: LEADER I0403 04:30:42.215692 6505 sys_catalog.cc:340] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: This master's current role is: LEADER I0403 04:30:42.217541 6501 sys_catalog.cc:424] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:42.217783 6508 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:42.223172 6508 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:42.324478 6508 catalog_manager.cc:950] Generated new certificate authority record I0403 04:30:42.326483 6508 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:42.334094 6508 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:42.365326 6502 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:42.365564 6502 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:42.367978 6502 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:42.368165 6502 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.65 I0403 04:30:42.382006 6502 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.65:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:38219 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.65 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:42.389211 6502 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 223135us I0403 04:30:42.389950 6502 fs_manager.cc:263] Metadata directory not provided I0403 04:30:42.390045 6502 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:42.390329 6502 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:42.390421 6502 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:42.392841 6502 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "998b9e7c25de4a63b277c4a3606de0ef" format_stamp: "Formatted at 2019-04-03 04:30:42 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:42.393414 6502 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "998b9e7c25de4a63b277c4a3606de0ef" format_stamp: "Formatted at 2019-04-03 04:30:42 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:42.411473 6502 fs_manager.cc:503] Time spent creating directory manager: real 0.018s user 0.006s sys 0.014s I0403 04:30:42.412884 6502 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:42.413568 6502 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:42.416548 6502 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:42.416630 6502 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "998b9e7c25de4a63b277c4a3606de0ef" format_stamp: "Formatted at 2019-04-03 04:30:42 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:42.416797 6502 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:42.478260 6502 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:42.482775 6502 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:42.482832 6502 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:42.523761 6502 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:38885 I0403 04:30:42.524921 6502 webserver.cc:308] Webserver started at http://127.3.136.65:36077/ using document root and password file I0403 04:30:42.525557 6502 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:30:42.526034 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 6502 I0403 04:30:42.551795 6631 heartbeater.cc:345] Connected to a master server at 127.3.136.126:38219 I0403 04:30:42.551960 6631 heartbeater.cc:426] Registering TS with master... I0403 04:30:42.552522 6631 heartbeater.cc:475] Master 127.3.136.126:38219 requested a full tablet report, sending... I0403 04:30:42.554002 6468 ts_manager.cc:159] Registered new tserver with Master: 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65:38885) I0403 04:30:42.555658 3617 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0403 04:30:42.555943 6468 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.65:48877 I0403 04:30:42.570220 6468 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49762: name: "a.b" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:42.590571 6568 tablet_service.cc:1006] Processing CreateTablet for tablet 3936e68084424ee28622d192a7574764 (table=a.b [id=6e8c7f3b880d4a4da61309b4203d9f1e]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:42.591493 6568 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3936e68084424ee28622d192a7574764. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.601150 6644 tablet_bootstrap.cc:439] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef: Bootstrap starting. I0403 04:30:42.603195 6644 tablet_bootstrap.cc:590] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef: No blocks or log segments found. Creating new log. I0403 04:30:42.603992 6644 log.cc:525] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef: Log is configured to *not* fsync() on all Append() calls I0403 04:30:42.605950 6644 tablet_bootstrap.cc:439] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef: No bootstrap required, opened a new log I0403 04:30:42.606196 6644 ts_tablet_manager.cc:1053] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s I0403 04:30:42.612006 6644 raft_consensus.cc:340] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.612310 6644 raft_consensus.cc:366] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.612401 6644 raft_consensus.cc:705] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Initialized, Role: FOLLOWER I0403 04:30:42.612820 6644 consensus_queue.cc:229] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.613076 6644 raft_consensus.cc:380] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.613167 6644 raft_consensus.cc:472] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.613274 6644 raft_consensus.cc:2886] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.614804 6644 raft_consensus.cc:494] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.615119 6644 leader_election.cc:310] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998b9e7c25de4a63b277c4a3606de0ef; no voters: I0403 04:30:42.615671 6646 raft_consensus.cc:2640] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.616022 6644 leader_election.cc:296] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.616634 6631 heartbeater.cc:467] Master 127.3.136.126:38219 was elected leader, sending a full tablet report... I0403 04:30:42.617094 6644 ts_tablet_manager.cc:1081] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent starting tablet: real 0.011s user 0.006s sys 0.004s I0403 04:30:42.617283 6646 raft_consensus.cc:667] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 LEADER]: Becoming Leader. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Running, Role: LEADER I0403 04:30:42.617620 6646 consensus_queue.cc:206] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.621537 6468 catalog_manager.cc:3977] T 3936e68084424ee28622d192a7574764 P 998b9e7c25de4a63b277c4a3606de0ef reported cstate change: term changed from 0 to 1, leader changed from to 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65). New cstate: current_term: 1 leader_uuid: "998b9e7c25de4a63b277c4a3606de0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } health_report { overall_health: HEALTHY } } } I0403 04:30:42.633443 6468 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49762: name: "foo.bar" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:42.638700 6568 tablet_service.cc:1006] Processing CreateTablet for tablet 1fb52711cb4843edaf117ecf9e2d5614 (table=foo.bar [id=96705529c3e94be6b29e4620b13ad220]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:42.639075 6568 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1fb52711cb4843edaf117ecf9e2d5614. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.642663 6644 tablet_bootstrap.cc:439] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef: Bootstrap starting. I0403 04:30:42.643784 6644 tablet_bootstrap.cc:590] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef: No blocks or log segments found. Creating new log. I0403 04:30:42.645341 6644 tablet_bootstrap.cc:439] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef: No bootstrap required, opened a new log I0403 04:30:42.645453 6644 ts_tablet_manager.cc:1053] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent bootstrapping tablet: real 0.003s user 0.001s sys 0.000s I0403 04:30:42.646064 6644 raft_consensus.cc:340] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.646173 6644 raft_consensus.cc:366] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.646245 6644 raft_consensus.cc:705] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Initialized, Role: FOLLOWER I0403 04:30:42.646425 6644 consensus_queue.cc:229] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.646558 6644 raft_consensus.cc:380] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.646615 6644 raft_consensus.cc:472] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.646697 6644 raft_consensus.cc:2886] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.648104 6644 raft_consensus.cc:494] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.648289 6644 leader_election.cc:310] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998b9e7c25de4a63b277c4a3606de0ef; no voters: I0403 04:30:42.648494 6644 leader_election.cc:296] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.648591 6647 raft_consensus.cc:2640] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.648761 6647 raft_consensus.cc:667] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 LEADER]: Becoming Leader. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Running, Role: LEADER I0403 04:30:42.649091 6647 consensus_queue.cc:206] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.649294 6644 ts_tablet_manager.cc:1081] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:42.650763 6468 catalog_manager.cc:3977] T 1fb52711cb4843edaf117ecf9e2d5614 P 998b9e7c25de4a63b277c4a3606de0ef reported cstate change: term changed from 0 to 1, leader changed from to 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65). New cstate: current_term: 1 leader_uuid: "998b9e7c25de4a63b277c4a3606de0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } health_report { overall_health: HEALTHY } } } I0403 04:30:42.658875 6468 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49762: name: "FOO.bar" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:42.663818 6568 tablet_service.cc:1006] Processing CreateTablet for tablet 1d5d25f0457e448280292f2db2c86904 (table=FOO.bar [id=d2772c02d29a4ad3ad0504a69bc6f79f]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:42.664124 6568 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 1d5d25f0457e448280292f2db2c86904. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.667412 6644 tablet_bootstrap.cc:439] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef: Bootstrap starting. I0403 04:30:42.668417 6644 tablet_bootstrap.cc:590] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef: No blocks or log segments found. Creating new log. I0403 04:30:42.669744 6644 tablet_bootstrap.cc:439] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef: No bootstrap required, opened a new log I0403 04:30:42.669909 6644 ts_tablet_manager.cc:1053] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:42.670536 6644 raft_consensus.cc:340] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.670670 6644 raft_consensus.cc:366] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.670723 6644 raft_consensus.cc:705] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Initialized, Role: FOLLOWER I0403 04:30:42.670893 6644 consensus_queue.cc:229] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.671006 6644 raft_consensus.cc:380] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.671113 6644 raft_consensus.cc:472] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.671227 6644 raft_consensus.cc:2886] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.672660 6644 raft_consensus.cc:494] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.672819 6644 leader_election.cc:310] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998b9e7c25de4a63b277c4a3606de0ef; no voters: I0403 04:30:42.673028 6644 leader_election.cc:296] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.673094 6647 raft_consensus.cc:2640] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.673243 6647 raft_consensus.cc:667] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 LEADER]: Becoming Leader. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Running, Role: LEADER I0403 04:30:42.673533 6644 ts_tablet_manager.cc:1081] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s I0403 04:30:42.673465 6647 consensus_queue.cc:206] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.674945 6468 catalog_manager.cc:3977] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef reported cstate change: term changed from 0 to 1, leader changed from to 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65). New cstate: current_term: 1 leader_uuid: "998b9e7c25de4a63b277c4a3606de0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } health_report { overall_health: HEALTHY } } } I0403 04:30:42.678864 6467 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49762: name: "foo.BAR" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:42.683650 6568 tablet_service.cc:1006] Processing CreateTablet for tablet e1f1b5025d85481b9473eb6f9ed06f4a (table=foo.BAR [id=4421c65000b042ca8df6f4bd056a7612]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:42.683938 6568 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet e1f1b5025d85481b9473eb6f9ed06f4a. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.687630 6644 tablet_bootstrap.cc:439] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef: Bootstrap starting. I0403 04:30:42.688577 6644 tablet_bootstrap.cc:590] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef: No blocks or log segments found. Creating new log. I0403 04:30:42.690052 6644 tablet_bootstrap.cc:439] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef: No bootstrap required, opened a new log I0403 04:30:42.690178 6644 ts_tablet_manager.cc:1053] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:42.690770 6644 raft_consensus.cc:340] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.690907 6644 raft_consensus.cc:366] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.690996 6644 raft_consensus.cc:705] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Initialized, Role: FOLLOWER I0403 04:30:42.691167 6644 consensus_queue.cc:229] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.691350 6644 raft_consensus.cc:380] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.691404 6644 raft_consensus.cc:472] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.691488 6644 raft_consensus.cc:2886] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.693084 6644 raft_consensus.cc:494] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.693334 6644 leader_election.cc:310] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998b9e7c25de4a63b277c4a3606de0ef; no voters: I0403 04:30:42.693552 6644 leader_election.cc:296] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.693658 6647 raft_consensus.cc:2640] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.693797 6647 raft_consensus.cc:667] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [term 1 LEADER]: Becoming Leader. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Running, Role: LEADER I0403 04:30:42.694034 6647 consensus_queue.cc:206] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.694173 6644 ts_tablet_manager.cc:1081] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef: Time spent starting tablet: real 0.004s user 0.000s sys 0.004s I0403 04:30:42.695524 6467 catalog_manager.cc:3977] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef reported cstate change: term changed from 0 to 1, leader changed from to 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65). New cstate: current_term: 1 leader_uuid: "998b9e7c25de4a63b277c4a3606de0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } health_report { overall_health: HEALTHY } } } I0403 04:30:42.698823 6467 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49762: name: "fuzz" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:42.705868 6568 tablet_service.cc:1006] Processing CreateTablet for tablet 3ca801901e0d45d6beada436f77fba1e (table=fuzz [id=89c55700952c4e0396a01699171aa631]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:42.706140 6568 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 3ca801901e0d45d6beada436f77fba1e. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.709693 6644 tablet_bootstrap.cc:439] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef: Bootstrap starting. I0403 04:30:42.710741 6644 tablet_bootstrap.cc:590] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef: No blocks or log segments found. Creating new log. I0403 04:30:42.712225 6644 tablet_bootstrap.cc:439] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef: No bootstrap required, opened a new log I0403 04:30:42.712388 6644 ts_tablet_manager.cc:1053] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:42.712920 6644 raft_consensus.cc:340] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.713069 6644 raft_consensus.cc:366] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.713129 6644 raft_consensus.cc:705] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Initialized, Role: FOLLOWER I0403 04:30:42.713258 6644 consensus_queue.cc:229] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.713392 6644 raft_consensus.cc:380] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.713445 6644 raft_consensus.cc:472] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.713498 6644 raft_consensus.cc:2886] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.714835 6644 raft_consensus.cc:494] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.715019 6644 leader_election.cc:310] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998b9e7c25de4a63b277c4a3606de0ef; no voters: I0403 04:30:42.715250 6644 leader_election.cc:296] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.715330 6647 raft_consensus.cc:2640] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.715610 6647 raft_consensus.cc:667] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [term 1 LEADER]: Becoming Leader. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Running, Role: LEADER I0403 04:30:42.715641 6644 ts_tablet_manager.cc:1081] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s I0403 04:30:42.715821 6647 consensus_queue.cc:206] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.717463 6467 catalog_manager.cc:3977] T 3ca801901e0d45d6beada436f77fba1e P 998b9e7c25de4a63b277c4a3606de0ef reported cstate change: term changed from 0 to 1, leader changed from to 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65). New cstate: current_term: 1 leader_uuid: "998b9e7c25de4a63b277c4a3606de0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } health_report { overall_health: HEALTHY } } } I0403 04:30:42.721357 6468 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49762: name: "FUZZ" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:42.726140 6568 tablet_service.cc:1006] Processing CreateTablet for tablet 89261dfca2f840b9bdd80558f080297b (table=FUZZ [id=a5a4648b947640c58ec6e83b05a101f4]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:42.726447 6568 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 89261dfca2f840b9bdd80558f080297b. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.730258 6644 tablet_bootstrap.cc:439] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef: Bootstrap starting. I0403 04:30:42.731237 6644 tablet_bootstrap.cc:590] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef: No blocks or log segments found. Creating new log. I0403 04:30:42.732816 6644 tablet_bootstrap.cc:439] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef: No bootstrap required, opened a new log I0403 04:30:42.732992 6644 ts_tablet_manager.cc:1053] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:42.733490 6644 raft_consensus.cc:340] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.733592 6644 raft_consensus.cc:366] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.733664 6644 raft_consensus.cc:705] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Initialized, Role: FOLLOWER I0403 04:30:42.733868 6644 consensus_queue.cc:229] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.734026 6644 raft_consensus.cc:380] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.734114 6644 raft_consensus.cc:472] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.734223 6644 raft_consensus.cc:2886] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.735865 6644 raft_consensus.cc:494] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.736084 6644 leader_election.cc:310] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998b9e7c25de4a63b277c4a3606de0ef; no voters: I0403 04:30:42.736263 6644 leader_election.cc:296] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.736348 6647 raft_consensus.cc:2640] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.736582 6647 raft_consensus.cc:667] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [term 1 LEADER]: Becoming Leader. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Running, Role: LEADER I0403 04:30:42.736680 6644 ts_tablet_manager.cc:1081] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef: Time spent starting tablet: real 0.004s user 0.001s sys 0.000s I0403 04:30:42.736771 6647 consensus_queue.cc:206] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.738270 6468 catalog_manager.cc:3977] T 89261dfca2f840b9bdd80558f080297b P 998b9e7c25de4a63b277c4a3606de0ef reported cstate change: term changed from 0 to 1, leader changed from to 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65). New cstate: current_term: 1 leader_uuid: "998b9e7c25de4a63b277c4a3606de0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } health_report { overall_health: HEALTHY } } } I0403 04:30:42.745790 6468 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49762: name: "a.b!" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:42.750607 6568 tablet_service.cc:1006] Processing CreateTablet for tablet f98ef8a08fb74852a4a49a7616d8cc85 (table=a.b! [id=a6600e2795f445fc83177497e0c0277b]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:42.750914 6568 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet f98ef8a08fb74852a4a49a7616d8cc85. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.754492 6644 tablet_bootstrap.cc:439] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef: Bootstrap starting. I0403 04:30:42.755553 6644 tablet_bootstrap.cc:590] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef: No blocks or log segments found. Creating new log. I0403 04:30:42.757084 6644 tablet_bootstrap.cc:439] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef: No bootstrap required, opened a new log I0403 04:30:42.757270 6644 ts_tablet_manager.cc:1053] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:42.757956 6644 raft_consensus.cc:340] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.758087 6644 raft_consensus.cc:366] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.758162 6644 raft_consensus.cc:705] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Initialized, Role: FOLLOWER I0403 04:30:42.758442 6644 consensus_queue.cc:229] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.758587 6644 raft_consensus.cc:380] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.758659 6644 raft_consensus.cc:472] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.758752 6644 raft_consensus.cc:2886] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.760504 6644 raft_consensus.cc:494] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.760715 6644 leader_election.cc:310] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998b9e7c25de4a63b277c4a3606de0ef; no voters: I0403 04:30:42.760917 6644 leader_election.cc:296] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.760985 6647 raft_consensus.cc:2640] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.761188 6647 raft_consensus.cc:667] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 LEADER]: Becoming Leader. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Running, Role: LEADER I0403 04:30:42.761406 6644 ts_tablet_manager.cc:1081] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:30:42.761370 6647 consensus_queue.cc:206] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.762948 6468 catalog_manager.cc:3977] T f98ef8a08fb74852a4a49a7616d8cc85 P 998b9e7c25de4a63b277c4a3606de0ef reported cstate change: term changed from 0 to 1, leader changed from to 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65). New cstate: current_term: 1 leader_uuid: "998b9e7c25de4a63b277c4a3606de0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } health_report { overall_health: HEALTHY } } } I0403 04:30:42.770529 6468 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49762: name: "A.B!" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:42.775339 6568 tablet_service.cc:1006] Processing CreateTablet for tablet 34964e7ea2cf435abec787d3aa1cded2 (table=A.B! [id=d7bcf7c5c14e4a1da9dc626671f55e1f]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:42.775627 6568 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 34964e7ea2cf435abec787d3aa1cded2. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:42.779309 6644 tablet_bootstrap.cc:439] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef: Bootstrap starting. I0403 04:30:42.780354 6644 tablet_bootstrap.cc:590] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef: No blocks or log segments found. Creating new log. I0403 04:30:42.781783 6644 tablet_bootstrap.cc:439] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef: No bootstrap required, opened a new log I0403 04:30:42.781920 6644 ts_tablet_manager.cc:1053] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:30:42.782462 6644 raft_consensus.cc:340] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.782569 6644 raft_consensus.cc:366] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:42.782624 6644 raft_consensus.cc:705] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Initialized, Role: FOLLOWER I0403 04:30:42.782786 6644 consensus_queue.cc:229] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.782933 6644 raft_consensus.cc:380] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:42.782995 6644 raft_consensus.cc:472] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:42.783057 6644 raft_consensus.cc:2886] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:42.784564 6644 raft_consensus.cc:494] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.784731 6644 leader_election.cc:310] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 998b9e7c25de4a63b277c4a3606de0ef; no voters: I0403 04:30:42.784904 6644 leader_election.cc:296] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:42.784996 6647 raft_consensus.cc:2640] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:42.785202 6647 raft_consensus.cc:667] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [term 1 LEADER]: Becoming Leader. State: Replica: 998b9e7c25de4a63b277c4a3606de0ef, State: Running, Role: LEADER I0403 04:30:42.785429 6647 consensus_queue.cc:206] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } } I0403 04:30:42.785606 6644 ts_tablet_manager.cc:1081] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s I0403 04:30:42.787793 6468 catalog_manager.cc:3977] T 34964e7ea2cf435abec787d3aa1cded2 P 998b9e7c25de4a63b277c4a3606de0ef reported cstate change: term changed from 0 to 1, leader changed from to 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65). New cstate: current_term: 1 leader_uuid: "998b9e7c25de4a63b277c4a3606de0ef" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 38885 } health_report { overall_health: HEALTHY } } } I0403 04:30:43.370198 6468 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49768: table { table_name: "FOO.bar" } new_table_name: "foo.bar2" modify_external_catalogs: true I0403 04:30:43.377923 6691 tablet.cc:1269] T 1d5d25f0457e448280292f2db2c86904 P 998b9e7c25de4a63b277c4a3606de0ef: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0403 04:30:43.383611 6468 catalog_manager.cc:4423] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: foo.bar2 [id=d2772c02d29a4ad3ad0504a69bc6f79f] alter complete (version 1) I0403 04:30:43.680246 6467 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:49770: table { table_name: "foo.BAR" } new_table_name: "foo.bar3" modify_external_catalogs: true I0403 04:30:43.684994 6691 tablet.cc:1269] T e1f1b5025d85481b9473eb6f9ed06f4a P 998b9e7c25de4a63b277c4a3606de0ef: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0403 04:30:43.690279 6467 catalog_manager.cc:4423] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: foo.bar3 [id=4421c65000b042ca8df6f4bd056a7612] alter complete (version 1) I0403 04:30:44.034262 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 6442 I0403 04:30:44.035388 6498 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:44.100147 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 6442 I0403 04:30:44.111608 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:38219 --webserver_interface=127.3.136.126 --webserver_port=45919 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:37745 --hive_metastore_sasl_enabled=false with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:44.285959 6716 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:44.286201 6716 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:44.289662 6716 flags.cc:406] Enabled experimental flag: --hive_metastore_sasl_enabled=false W0403 04:30:44.289759 6716 flags.cc:406] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:37745 W0403 04:30:44.289868 6716 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:30:44.289930 6716 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:44.289994 6716 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:30:44.290058 6716 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:30:44.294682 6716 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal --hive_metastore_uris=thrift://127.0.0.1:37745 --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:38219 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=45919 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:44.300833 6716 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 224135us I0403 04:30:44.302039 6716 fs_manager.cc:263] Metadata directory not provided I0403 04:30:44.302130 6716 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:44.307467 6716 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s I0403 04:30:44.308145 6716 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:44.308733 6716 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:44.311596 6716 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:44.311669 6716 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal uuid: "10dd2b69327842a9b8112139d0a57418" format_stamp: "Formatted at 2019-04-03 04:30:42 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:44.312752 6716 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:44.338182 6716 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:44.352955 6716 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:38219 I0403 04:30:44.353971 6716 webserver.cc:308] Webserver started at http://127.3.136.126:45919/ using document root and password file I0403 04:30:44.354679 6716 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestHmsPrecheck.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:30:44.361980 6775 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: Bootstrap starting. I0403 04:30:44.364825 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 6716 I0403 04:30:44.383203 6775 log.cc:525] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: Log is configured to *not* fsync() on all Append() calls I0403 04:30:44.414714 6775 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: Bootstrap replayed 1/1 log segments. Stats: ops{read=32 overwritten=0 applied=32 ignored=0} inserts{seen=18 ignored=0} mutations{seen=21 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:30:44.415176 6775 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: Bootstrap complete. I0403 04:30:44.422813 6775 raft_consensus.cc:340] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } I0403 04:30:44.423712 6775 raft_consensus.cc:705] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10dd2b69327842a9b8112139d0a57418, State: Initialized, Role: FOLLOWER I0403 04:30:44.424192 6775 consensus_queue.cc:229] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 32, Last appended: 1.32, Last appended by leader: 32, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } I0403 04:30:44.424387 6775 raft_consensus.cc:380] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:44.424484 6775 raft_consensus.cc:472] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:44.424614 6775 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 1 FOLLOWER]: Advancing to term 2 I0403 04:30:44.430421 6775 raft_consensus.cc:494] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } I0403 04:30:44.431006 6775 leader_election.cc:310] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 10dd2b69327842a9b8112139d0a57418; no voters: I0403 04:30:44.431969 6779 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 2 FOLLOWER]: Leader election won for term 2 I0403 04:30:44.432353 6775 leader_election.cc:296] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [CANDIDATE]: Term 2 election: Requested vote from peers I0403 04:30:44.433145 6779 raft_consensus.cc:667] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [term 2 LEADER]: Becoming Leader. State: Replica: 10dd2b69327842a9b8112139d0a57418, State: Running, Role: LEADER I0403 04:30:44.433656 6779 consensus_queue.cc:206] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 32, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } I0403 04:30:44.436362 6780 sys_catalog.cc:337] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "10dd2b69327842a9b8112139d0a57418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } } I0403 04:30:44.436941 6780 sys_catalog.cc:340] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: This master's current role is: LEADER I0403 04:30:44.437743 6775 sys_catalog.cc:337] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "10dd2b69327842a9b8112139d0a57418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } } I0403 04:30:44.438030 6775 sys_catalog.cc:340] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: This master's current role is: LEADER I0403 04:30:44.437762 6781 sys_catalog.cc:337] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 10dd2b69327842a9b8112139d0a57418. Latest consensus state: current_term: 2 leader_uuid: "10dd2b69327842a9b8112139d0a57418" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "10dd2b69327842a9b8112139d0a57418" member_type: VOTER } } I0403 04:30:44.438119 6781 sys_catalog.cc:340] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: This master's current role is: LEADER I0403 04:30:44.439275 6775 sys_catalog.cc:424] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:44.439466 6785 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:44.445333 6785 catalog_manager.cc:354] Loaded metadata for table foo.bar3 [id=4421c65000b042ca8df6f4bd056a7612] I0403 04:30:44.445624 6785 catalog_manager.cc:354] Loaded metadata for table a.b [id=6e8c7f3b880d4a4da61309b4203d9f1e] I0403 04:30:44.445865 6785 catalog_manager.cc:354] Loaded metadata for table fuzz [id=89c55700952c4e0396a01699171aa631] I0403 04:30:44.446149 6785 catalog_manager.cc:354] Loaded metadata for table foo.bar [id=96705529c3e94be6b29e4620b13ad220] I0403 04:30:44.446452 6785 catalog_manager.cc:354] Loaded metadata for table FUZZ [id=a5a4648b947640c58ec6e83b05a101f4] I0403 04:30:44.446795 6785 catalog_manager.cc:354] Loaded metadata for table a.b! [id=a6600e2795f445fc83177497e0c0277b] I0403 04:30:44.447064 6785 catalog_manager.cc:354] Loaded metadata for table foo.bar2 [id=d2772c02d29a4ad3ad0504a69bc6f79f] I0403 04:30:44.447351 6785 catalog_manager.cc:354] Loaded metadata for table A.B! [id=d7bcf7c5c14e4a1da9dc626671f55e1f] I0403 04:30:44.449273 6785 catalog_manager.cc:408] Loaded metadata for tablet 1d5d25f0457e448280292f2db2c86904 (table foo.bar2 [id=d2772c02d29a4ad3ad0504a69bc6f79f]) I0403 04:30:44.449551 6785 catalog_manager.cc:408] Loaded metadata for tablet 1fb52711cb4843edaf117ecf9e2d5614 (table foo.bar [id=96705529c3e94be6b29e4620b13ad220]) I0403 04:30:44.449774 6785 catalog_manager.cc:408] Loaded metadata for tablet 34964e7ea2cf435abec787d3aa1cded2 (table A.B! [id=d7bcf7c5c14e4a1da9dc626671f55e1f]) I0403 04:30:44.450027 6785 catalog_manager.cc:408] Loaded metadata for tablet 3936e68084424ee28622d192a7574764 (table a.b [id=6e8c7f3b880d4a4da61309b4203d9f1e]) I0403 04:30:44.450309 6785 catalog_manager.cc:408] Loaded metadata for tablet 3ca801901e0d45d6beada436f77fba1e (table fuzz [id=89c55700952c4e0396a01699171aa631]) I0403 04:30:44.450579 6785 catalog_manager.cc:408] Loaded metadata for tablet 89261dfca2f840b9bdd80558f080297b (table FUZZ [id=a5a4648b947640c58ec6e83b05a101f4]) I0403 04:30:44.450886 6785 catalog_manager.cc:408] Loaded metadata for tablet e1f1b5025d85481b9473eb6f9ed06f4a (table foo.bar3 [id=4421c65000b042ca8df6f4bd056a7612]) I0403 04:30:44.451192 6785 catalog_manager.cc:408] Loaded metadata for tablet f98ef8a08fb74852a4a49a7616d8cc85 (table a.b! [id=a6600e2795f445fc83177497e0c0277b]) I0403 04:30:44.451375 6785 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:44.454913 6785 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:44.456331 6785 catalog_manager.cc:4292] T 00000000000000000000000000000000 P 10dd2b69327842a9b8112139d0a57418: Loaded TSK: 0 I0403 04:30:44.459014 6788 hms_notification_log_listener.cc:228] Skipping Hive Metastore notification log poll: Service unavailable: Catalog manager is not initialized. State: Starting I0403 04:30:44.699345 6742 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "998b9e7c25de4a63b277c4a3606de0ef" instance_seqno: 1554265842517957) as {username='slave'} at 127.3.136.65:55027; Asking this server to re-register. I0403 04:30:44.700031 6631 heartbeater.cc:426] Registering TS with master... I0403 04:30:44.700237 6631 heartbeater.cc:475] Master 127.3.136.126:38219 requested a full tablet report, sending... I0403 04:30:44.702150 6742 ts_manager.cc:159] Registered new tserver with Master: 998b9e7c25de4a63b277c4a3606de0ef (127.3.136.65:38885) I0403 04:30:44.703160 3617 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0403 04:30:44.718060 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 6502 I0403 04:30:44.730378 6628 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:44.811028 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 6502 I0403 04:30:44.820617 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 6716 I0403 04:30:44.821455 6772 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:30:44.885902 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 6716 Shutting down hive metastore. [ OK ] ToolTest.TestHmsPrecheck (14154 ms) [ RUN ] ToolTest.TestDumpFSWithNonDefaultMetadataDir I0403 04:30:45.399899 3617 fs_manager.cc:248] Data directories (fs_data_dirs) not provided I0403 04:30:45.399955 3617 fs_manager.cc:249] Using write-ahead log directory (fs_wal_dir) as data directory I0403 04:30:45.400599 3617 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554265799459872-3617/test/wal/instance: uuid: "f704494a9ec44440b0aebd642c9bc64d" format_stamp: "Formatted at 2019-04-03 04:30:45 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:45.401041 3617 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554265799459872-3617/test/meta/instance: uuid: "f704494a9ec44440b0aebd642c9bc64d" format_stamp: "Formatted at 2019-04-03 04:30:45 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:45.404036 3617 fs_manager.cc:503] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s I0403 04:30:45.405169 3617 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:45.406664 3617 fs_report.cc:352] FS layout report -------------------- wal directory: metadata directory: 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554265799459872-3617/test/wal/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:45.406790 3617 fs_manager.cc:419] Time spent opening block manager: real 0.001s user 0.000s sys 0.000s I0403 04:30:45.406853 3617 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554265799459872-3617/test/wal,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTest.TestDumpFSWithNonDefaultMetadataDir.1554265799459872-3617/test/meta uuid: "f704494a9ec44440b0aebd642c9bc64d" format_stamp: "Formatted at 2019-04-03 04:30:45 on dist-test-slave-dist-test-slave-1l7r" [ OK ] ToolTest.TestDumpFSWithNonDefaultMetadataDir (579 ms) [----------] 13 tests from ToolTest (46504 ms total) [----------] 2 tests from ToolTestKerberosParameterized/ToolTestKerberosParameterized [ RUN ] ToolTestKerberosParameterized/ToolTestKerberosParameterized.TestHmsDowngrade/0 2019-04-03 04:30:46: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/derby.log log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-tasks9LKQH/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-tasks9LKQH/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Starting hive metastore on port 0 2910 T1 odu.Log4JLogger.info Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2921 T1 odu.Log4JLogger.info Property datanucleus.cache.level2 unknown - will be ignored I0403 04:30:56.883553 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:32887 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:39649 with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:57.068629 6932 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:57.068857 6932 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:57.071595 6932 flags.cc:406] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:39649 W0403 04:30:57.071652 6932 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:30:57.071735 6932 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:57.071786 6932 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:30:57.071864 6932 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:30:57.077975 6932 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/wal --hive_metastore_uris=thrift://127.0.0.1:39649 --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:32887 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:57.084272 6932 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 230635us I0403 04:30:57.085521 6932 fs_manager.cc:263] Metadata directory not provided I0403 04:30:57.085588 6932 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:57.085912 6932 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:57.085985 6932 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:57.088515 6932 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "142e9e7ea3af4e109e270ca8a3d489b1" format_stamp: "Formatted at 2019-04-03 04:30:57 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:57.089084 6932 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "142e9e7ea3af4e109e270ca8a3d489b1" format_stamp: "Formatted at 2019-04-03 04:30:57 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:57.096004 6932 fs_manager.cc:503] Time spent creating directory manager: real 0.007s user 0.008s sys 0.001s I0403 04:30:57.097223 6932 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:57.097781 6932 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:57.100693 6932 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:57.100764 6932 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/wal uuid: "142e9e7ea3af4e109e270ca8a3d489b1" format_stamp: "Formatted at 2019-04-03 04:30:57 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:57.100881 6932 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:57.132405 6932 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:57.146462 6932 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:32887 I0403 04:30:57.147436 6932 webserver.cc:308] Webserver started at http://127.3.136.126:46461/ using document root and password file I0403 04:30:57.148012 6932 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:30:57.151062 6991 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:57.157225 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 6932 I0403 04:30:57.157922 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.3.136.65:0 --local_ip_for_outbound_sockets=127.3.136.65 --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:32887 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:30:57.162462 6991 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1: Bootstrap starting. I0403 04:30:57.165001 6991 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1: No blocks or log segments found. Creating new log. I0403 04:30:57.170078 6991 log.cc:525] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1: Log is configured to *not* fsync() on all Append() calls I0403 04:30:57.175169 6991 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1: No bootstrap required, opened a new log I0403 04:30:57.185648 6991 raft_consensus.cc:340] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" member_type: VOTER } I0403 04:30:57.185963 6991 raft_consensus.cc:366] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:57.186043 6991 raft_consensus.cc:705] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 142e9e7ea3af4e109e270ca8a3d489b1, State: Initialized, Role: FOLLOWER I0403 04:30:57.186648 6991 consensus_queue.cc:229] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" member_type: VOTER } I0403 04:30:57.186873 6991 raft_consensus.cc:380] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:57.186980 6991 raft_consensus.cc:472] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:57.187113 6991 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:57.189564 6991 raft_consensus.cc:494] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" member_type: VOTER } I0403 04:30:57.190053 6991 leader_election.cc:310] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 142e9e7ea3af4e109e270ca8a3d489b1; no voters: I0403 04:30:57.194088 6991 leader_election.cc:296] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:57.194259 6994 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:57.195142 6994 raft_consensus.cc:667] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [term 1 LEADER]: Becoming Leader. State: Replica: 142e9e7ea3af4e109e270ca8a3d489b1, State: Running, Role: LEADER I0403 04:30:57.195585 6994 consensus_queue.cc:206] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" member_type: VOTER } I0403 04:30:57.197700 6995 sys_catalog.cc:337] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" member_type: VOTER } } I0403 04:30:57.197717 6996 sys_catalog.cc:337] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 142e9e7ea3af4e109e270ca8a3d489b1. Latest consensus state: current_term: 1 leader_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" member_type: VOTER } } I0403 04:30:57.198448 6995 sys_catalog.cc:340] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [sys.catalog]: This master's current role is: LEADER I0403 04:30:57.198515 6991 sys_catalog.cc:337] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "142e9e7ea3af4e109e270ca8a3d489b1" member_type: VOTER } } I0403 04:30:57.198860 6991 sys_catalog.cc:340] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [sys.catalog]: This master's current role is: LEADER I0403 04:30:57.198699 6996 sys_catalog.cc:340] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [sys.catalog]: This master's current role is: LEADER I0403 04:30:57.201306 6991 sys_catalog.cc:424] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:30:57.201567 6998 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:30:57.205384 6998 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:30:57.248005 6998 catalog_manager.cc:950] Generated new certificate authority record I0403 04:30:57.249289 6998 catalog_manager.cc:1075] Loading token signing keys... I0403 04:30:57.258251 6998 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 142e9e7ea3af4e109e270ca8a3d489b1: Generated new TSK 0 I0403 04:30:57.262686 7003 hms_notification_log_listener.cc:228] Skipping Hive Metastore notification log poll: Service unavailable: Catalog manager is not initialized. State: Starting WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:30:57.365695 6992 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:30:57.366029 6992 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:30:57.369441 6992 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:30:57.369599 6992 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.65 I0403 04:30:57.390017 6992 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.65:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:32887 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.65 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:30:57.399897 6992 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 230635us I0403 04:30:57.400763 6992 fs_manager.cc:263] Metadata directory not provided I0403 04:30:57.400873 6992 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:30:57.401202 6992 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:30:57.401314 6992 server_base.cc:434] Attempting to create new FS layout instead I0403 04:30:57.404664 6992 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" format_stamp: "Formatted at 2019-04-03 04:30:57 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:57.405436 6992 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" format_stamp: "Formatted at 2019-04-03 04:30:57 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:57.416015 6992 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.008s sys 0.004s I0403 04:30:57.417567 6992 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:30:57.418283 6992 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:30:57.421677 6992 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:30:57.421757 6992 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" format_stamp: "Formatted at 2019-04-03 04:30:57 on dist-test-slave-dist-test-slave-1l7r" I0403 04:30:57.421974 6992 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:30:57.525020 6992 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:30:57.527266 6992 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:30:57.527349 6992 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:30:57.609969 6992 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:35665 I0403 04:30:57.611148 6992 webserver.cc:308] Webserver started at http://127.3.136.65:33051/ using document root and password file I0403 04:30:57.611809 6992 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestHmsDowngrade_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:30:57.617256 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 6992 I0403 04:30:57.633209 7123 heartbeater.cc:345] Connected to a master server at 127.3.136.126:32887 I0403 04:30:57.633463 7123 heartbeater.cc:426] Registering TS with master... I0403 04:30:57.633982 7123 heartbeater.cc:475] Master 127.3.136.126:32887 requested a full tablet report, sending... I0403 04:30:57.635663 6957 ts_manager.cc:159] Registered new tserver with Master: a8b9bbdbf66c4a8c80561c620f423bf5 (127.3.136.65:35665) I0403 04:30:57.637540 3617 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0403 04:30:57.637804 6957 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.65:48253 I0403 04:30:57.802708 6957 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52662: name: "default.a" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:30:58.297369 7060 tablet_service.cc:1006] Processing CreateTablet for tablet ebc7e0ea841c4ea1ac73e8ef6de0c7ce (table=default.a [id=2f78a63029ab480784574adc759b1fc3]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:30:58.298180 7060 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet ebc7e0ea841c4ea1ac73e8ef6de0c7ce. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:30:58.308398 7152 tablet_bootstrap.cc:439] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5: Bootstrap starting. I0403 04:30:58.310497 7152 tablet_bootstrap.cc:590] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5: No blocks or log segments found. Creating new log. I0403 04:30:58.311347 7152 log.cc:525] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5: Log is configured to *not* fsync() on all Append() calls I0403 04:30:58.313108 7152 tablet_bootstrap.cc:439] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5: No bootstrap required, opened a new log I0403 04:30:58.313330 7152 ts_tablet_manager.cc:1053] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s I0403 04:30:58.318774 7152 raft_consensus.cc:340] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35665 } } I0403 04:30:58.319078 7152 raft_consensus.cc:366] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:30:58.319146 7152 raft_consensus.cc:705] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a8b9bbdbf66c4a8c80561c620f423bf5, State: Initialized, Role: FOLLOWER I0403 04:30:58.319521 7152 consensus_queue.cc:229] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35665 } } I0403 04:30:58.319697 7152 raft_consensus.cc:380] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:30:58.319787 7152 raft_consensus.cc:472] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:30:58.319922 7152 raft_consensus.cc:2886] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:30:58.321409 7152 raft_consensus.cc:494] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35665 } } I0403 04:30:58.321736 7152 leader_election.cc:310] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a8b9bbdbf66c4a8c80561c620f423bf5; no voters: I0403 04:30:58.322338 7154 raft_consensus.cc:2640] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:30:58.322692 7152 leader_election.cc:296] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:30:58.323336 7123 heartbeater.cc:467] Master 127.3.136.126:32887 was elected leader, sending a full tablet report... I0403 04:30:58.323479 7154 raft_consensus.cc:667] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [term 1 LEADER]: Becoming Leader. State: Replica: a8b9bbdbf66c4a8c80561c620f423bf5, State: Running, Role: LEADER I0403 04:30:58.323779 7154 consensus_queue.cc:206] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35665 } } I0403 04:30:58.325083 7152 ts_tablet_manager.cc:1081] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5: Time spent starting tablet: real 0.012s user 0.010s sys 0.000s I0403 04:30:58.328368 6957 catalog_manager.cc:3977] T ebc7e0ea841c4ea1ac73e8ef6de0c7ce P a8b9bbdbf66c4a8c80561c620f423bf5 reported cstate change: term changed from 0 to 1, leader changed from to a8b9bbdbf66c4a8c80561c620f423bf5 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a8b9bbdbf66c4a8c80561c620f423bf5" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35665 } health_report { overall_health: HEALTHY } } } I0403 04:31:00.537062 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 6992 I0403 04:31:00.543015 7120 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:00.589726 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 6992 I0403 04:31:00.598819 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 6932 I0403 04:31:00.599709 6988 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:00.665266 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 6932 Shutting down hive metastore. [ OK ] ToolTestKerberosParameterized/ToolTestKerberosParameterized.TestHmsDowngrade/0 (15237 ms) [ RUN ] ToolTestKerberosParameterized/ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata/0 2019-04-03 04:31:01: Starting Hive Metastore Server Picked up JAVA_TOOL_OPTIONS: -Djava.net.preferIPv4Stack=true -Dderby.locks.deadlockTimeout=1 -Dderby.stream.error.file=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/derby.log log4j:WARN No such property [conversionPattern] in org.apache.solr.util.SolrLogLayout. SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/tmp/dist-test-tasks9LKQH/thirdparty/src/hive-498021fa15186aee8b282d3c032fbd2cede6bec4/lib/log4j-slf4j-impl-2.6.2.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/tmp/dist-test-tasks9LKQH/thirdparty/src/hadoop-2.8.5/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] Starting hive metastore on port 0 2926 T1 odu.Log4JLogger.info Property hive.metastore.integral.jdo.pushdown unknown - will be ignored 2937 T1 odu.Log4JLogger.info Property datanucleus.cache.level2 unknown - will be ignored I0403 04:31:12.227947 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:37289 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:12.415179 7339 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:12.415410 7339 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:12.418190 7339 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:31:12.418249 7339 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:12.418334 7339 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:31:12.418406 7339 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:31:12.423214 7339 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:37289 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:12.429697 7339 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 238135us I0403 04:31:12.431000 7339 fs_manager.cc:263] Metadata directory not provided I0403 04:31:12.431128 7339 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:12.431526 7339 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:12.431604 7339 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:12.434254 7339 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "ee98b1ce6d9246a489069b51110e2d96" format_stamp: "Formatted at 2019-04-03 04:31:12 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:12.434828 7339 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "ee98b1ce6d9246a489069b51110e2d96" format_stamp: "Formatted at 2019-04-03 04:31:12 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:12.441418 7339 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s I0403 04:31:12.442787 7339 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:12.443367 7339 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:12.446265 7339 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0403 04:31:12.446337 7339 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal uuid: "ee98b1ce6d9246a489069b51110e2d96" format_stamp: "Formatted at 2019-04-03 04:31:12 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:12.446503 7339 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:12.499004 7339 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:12.514113 7339 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:37289 I0403 04:31:12.515087 7339 webserver.cc:308] Webserver started at http://127.3.136.126:42615/ using document root and password file I0403 04:31:12.515705 7339 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:31:12.519031 7398 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:12.521889 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 7339 I0403 04:31:12.522732 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.3.136.65:0 --local_ip_for_outbound_sockets=127.3.136.65 --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:37289 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:31:12.535094 7398 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: Bootstrap starting. I0403 04:31:12.538709 7398 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: No blocks or log segments found. Creating new log. I0403 04:31:12.540002 7398 log.cc:525] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: Log is configured to *not* fsync() on all Append() calls I0403 04:31:12.542003 7398 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: No bootstrap required, opened a new log I0403 04:31:12.549263 7398 raft_consensus.cc:340] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } I0403 04:31:12.549499 7398 raft_consensus.cc:366] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:12.549552 7398 raft_consensus.cc:705] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee98b1ce6d9246a489069b51110e2d96, State: Initialized, Role: FOLLOWER I0403 04:31:12.550088 7398 consensus_queue.cc:229] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } I0403 04:31:12.550259 7398 raft_consensus.cc:380] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:12.550371 7398 raft_consensus.cc:472] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:12.550493 7398 raft_consensus.cc:2886] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:12.552100 7398 raft_consensus.cc:494] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } I0403 04:31:12.552477 7398 leader_election.cc:310] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee98b1ce6d9246a489069b51110e2d96; no voters: I0403 04:31:12.553086 7398 leader_election.cc:296] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:12.553298 7401 raft_consensus.cc:2640] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:12.554291 7401 raft_consensus.cc:667] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 1 LEADER]: Becoming Leader. State: Replica: ee98b1ce6d9246a489069b51110e2d96, State: Running, Role: LEADER I0403 04:31:12.554740 7401 consensus_queue.cc:206] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } I0403 04:31:12.559275 7398 sys_catalog.cc:337] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "ee98b1ce6d9246a489069b51110e2d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } } I0403 04:31:12.559604 7398 sys_catalog.cc:340] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: This master's current role is: LEADER I0403 04:31:12.559779 7402 sys_catalog.cc:337] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ee98b1ce6d9246a489069b51110e2d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } } I0403 04:31:12.560171 7402 sys_catalog.cc:340] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: This master's current role is: LEADER I0403 04:31:12.562471 7398 sys_catalog.cc:424] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:31:12.562471 7403 sys_catalog.cc:337] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee98b1ce6d9246a489069b51110e2d96. Latest consensus state: current_term: 1 leader_uuid: "ee98b1ce6d9246a489069b51110e2d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } } I0403 04:31:12.562772 7403 sys_catalog.cc:340] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: This master's current role is: LEADER I0403 04:31:12.563020 7407 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:31:12.566998 7407 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:31:12.626078 7407 catalog_manager.cc:950] Generated new certificate authority record I0403 04:31:12.627384 7407 catalog_manager.cc:1075] Loading token signing keys... I0403 04:31:12.637032 7407 catalog_manager.cc:4281] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:12.734681 7399 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:12.734972 7399 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:12.738658 7399 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:12.738829 7399 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.65 I0403 04:31:12.750030 7399 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.65:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:37289 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.65 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:12.759835 7399 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 238135us I0403 04:31:12.760715 7399 fs_manager.cc:263] Metadata directory not provided I0403 04:31:12.760849 7399 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:12.761216 7399 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:12.761332 7399 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:12.764798 7399 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "a6156d4c53754f0d8fa78d4f22592a61" format_stamp: "Formatted at 2019-04-03 04:31:12 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:12.765651 7399 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "a6156d4c53754f0d8fa78d4f22592a61" format_stamp: "Formatted at 2019-04-03 04:31:12 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:12.776048 7399 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.005s sys 0.004s I0403 04:31:12.777751 7399 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:12.778512 7399 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:12.787554 7399 fs_manager.cc:419] Time spent opening block manager: real 0.007s user 0.003s sys 0.004s I0403 04:31:12.787636 7399 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "a6156d4c53754f0d8fa78d4f22592a61" format_stamp: "Formatted at 2019-04-03 04:31:12 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:12.787859 7399 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:12.926462 7399 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:12.928828 7399 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:31:12.928912 7399 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:31:13.060519 7399 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:37243 I0403 04:31:13.061731 7399 webserver.cc:308] Webserver started at http://127.3.136.65:43529/ using document root and password file I0403 04:31:13.062391 7399 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:31:13.063654 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 7399 I0403 04:31:13.078397 7529 heartbeater.cc:345] Connected to a master server at 127.3.136.126:37289 I0403 04:31:13.078543 7529 heartbeater.cc:426] Registering TS with master... I0403 04:31:13.078995 7529 heartbeater.cc:475] Master 127.3.136.126:37289 requested a full tablet report, sending... I0403 04:31:13.080500 7364 ts_manager.cc:159] Registered new tserver with Master: a6156d4c53754f0d8fa78d4f22592a61 (127.3.136.65:37243) I0403 04:31:13.082259 7364 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.65:42261 I0403 04:31:13.082486 3617 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0403 04:31:13.112906 7364 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53992: name: "default.duplicate_hms_tables" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:31:13.138315 7466 tablet_service.cc:1006] Processing CreateTablet for tablet 665d999897184f60938dc31a1f2880b3 (table=default.duplicate_hms_tables [id=0639fb81fb1e44a5bce82d4d6f1f9dd3]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:13.139086 7466 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 665d999897184f60938dc31a1f2880b3. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:13.148447 7544 tablet_bootstrap.cc:439] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61: Bootstrap starting. I0403 04:31:13.150588 7544 tablet_bootstrap.cc:590] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61: No blocks or log segments found. Creating new log. I0403 04:31:13.151486 7544 log.cc:525] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61: Log is configured to *not* fsync() on all Append() calls I0403 04:31:13.153288 7544 tablet_bootstrap.cc:439] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61: No bootstrap required, opened a new log I0403 04:31:13.153533 7544 ts_tablet_manager.cc:1053] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s I0403 04:31:13.159448 7544 raft_consensus.cc:340] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.159737 7544 raft_consensus.cc:366] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:13.159792 7544 raft_consensus.cc:705] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Initialized, Role: FOLLOWER I0403 04:31:13.160125 7544 consensus_queue.cc:229] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.160310 7544 raft_consensus.cc:380] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:13.160403 7544 raft_consensus.cc:472] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:13.160493 7544 raft_consensus.cc:2886] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:13.162039 7544 raft_consensus.cc:494] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.162398 7544 leader_election.cc:310] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6156d4c53754f0d8fa78d4f22592a61; no voters: I0403 04:31:13.162919 7544 leader_election.cc:296] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:13.163062 7546 raft_consensus.cc:2640] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:13.163852 7529 heartbeater.cc:467] Master 127.3.136.126:37289 was elected leader, sending a full tablet report... I0403 04:31:13.164026 7546 raft_consensus.cc:667] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 LEADER]: Becoming Leader. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Running, Role: LEADER I0403 04:31:13.164511 7546 consensus_queue.cc:206] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.164933 7544 ts_tablet_manager.cc:1081] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61: Time spent starting tablet: real 0.011s user 0.004s sys 0.007s I0403 04:31:13.167750 7364 catalog_manager.cc:3977] T 665d999897184f60938dc31a1f2880b3 P a6156d4c53754f0d8fa78d4f22592a61 reported cstate change: term changed from 0 to 1, leader changed from to a6156d4c53754f0d8fa78d4f22592a61 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "a6156d4c53754f0d8fa78d4f22592a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } health_report { overall_health: HEALTHY } } } I0403 04:31:13.915915 7364 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53992: name: "default.hive-incompatible-name" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:31:13.922817 7466 tablet_service.cc:1006] Processing CreateTablet for tablet a587105a328647debc94c1f8e7f34a9a (table=default.hive-incompatible-name [id=0eeb1a84386147ff8a0c6b30a3bf77a9]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:13.923178 7466 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a587105a328647debc94c1f8e7f34a9a. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:13.927522 7577 tablet_bootstrap.cc:439] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61: Bootstrap starting. I0403 04:31:13.928742 7577 tablet_bootstrap.cc:590] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61: No blocks or log segments found. Creating new log. I0403 04:31:13.930375 7577 tablet_bootstrap.cc:439] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61: No bootstrap required, opened a new log I0403 04:31:13.930476 7577 ts_tablet_manager.cc:1053] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:31:13.931146 7577 raft_consensus.cc:340] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.931286 7577 raft_consensus.cc:366] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:13.931358 7577 raft_consensus.cc:705] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Initialized, Role: FOLLOWER I0403 04:31:13.931499 7577 consensus_queue.cc:229] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.931651 7577 raft_consensus.cc:380] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:13.931696 7577 raft_consensus.cc:472] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:13.931762 7577 raft_consensus.cc:2886] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:13.933534 7577 raft_consensus.cc:494] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.933715 7577 leader_election.cc:310] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6156d4c53754f0d8fa78d4f22592a61; no voters: I0403 04:31:13.934172 7579 raft_consensus.cc:2640] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:13.934417 7577 leader_election.cc:296] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:13.935016 7579 raft_consensus.cc:667] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [term 1 LEADER]: Becoming Leader. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Running, Role: LEADER I0403 04:31:13.935279 7579 consensus_queue.cc:206] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.936069 7577 ts_tablet_manager.cc:1081] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s I0403 04:31:13.937183 7365 catalog_manager.cc:3977] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61 reported cstate change: term changed from 0 to 1, leader changed from to a6156d4c53754f0d8fa78d4f22592a61 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "a6156d4c53754f0d8fa78d4f22592a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } health_report { overall_health: HEALTHY } } } I0403 04:31:13.948714 7365 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53992: name: "no_database" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:31:13.953743 7466 tablet_service.cc:1006] Processing CreateTablet for tablet 63c2b7f7a3e24ec3b57dbbb4c5e76358 (table=no_database [id=38a227aa7fe64e4ebac5316d392feb03]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:13.954043 7466 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 63c2b7f7a3e24ec3b57dbbb4c5e76358. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:13.957945 7577 tablet_bootstrap.cc:439] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61: Bootstrap starting. I0403 04:31:13.959095 7577 tablet_bootstrap.cc:590] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61: No blocks or log segments found. Creating new log. I0403 04:31:13.960538 7577 tablet_bootstrap.cc:439] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61: No bootstrap required, opened a new log I0403 04:31:13.960664 7577 ts_tablet_manager.cc:1053] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:31:13.961230 7577 raft_consensus.cc:340] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.961375 7577 raft_consensus.cc:366] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:13.961446 7577 raft_consensus.cc:705] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Initialized, Role: FOLLOWER I0403 04:31:13.961647 7577 consensus_queue.cc:229] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.961777 7577 raft_consensus.cc:380] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:13.961879 7577 raft_consensus.cc:472] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:13.961954 7577 raft_consensus.cc:2886] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:13.963348 7577 raft_consensus.cc:494] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.963538 7577 leader_election.cc:310] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6156d4c53754f0d8fa78d4f22592a61; no voters: I0403 04:31:13.963734 7577 leader_election.cc:296] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:13.963788 7579 raft_consensus.cc:2640] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:13.963984 7579 raft_consensus.cc:667] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 LEADER]: Becoming Leader. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Running, Role: LEADER I0403 04:31:13.964162 7579 consensus_queue.cc:206] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.964339 7577 ts_tablet_manager.cc:1081] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:31:13.966367 7365 catalog_manager.cc:3977] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61 reported cstate change: term changed from 0 to 1, leader changed from to a6156d4c53754f0d8fa78d4f22592a61 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "a6156d4c53754f0d8fa78d4f22592a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } health_report { overall_health: HEALTHY } } } I0403 04:31:13.974082 7365 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53992: name: "non_existent_database.table" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:31:13.978888 7466 tablet_service.cc:1006] Processing CreateTablet for tablet cb07c565d64e4f2db9742a9d7339d7d9 (table=non_existent_database.table [id=b99535637ed74857ad05f98a38434037]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:13.979185 7466 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet cb07c565d64e4f2db9742a9d7339d7d9. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:13.982750 7577 tablet_bootstrap.cc:439] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61: Bootstrap starting. I0403 04:31:13.983784 7577 tablet_bootstrap.cc:590] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61: No blocks or log segments found. Creating new log. I0403 04:31:13.985232 7577 tablet_bootstrap.cc:439] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61: No bootstrap required, opened a new log I0403 04:31:13.985410 7577 ts_tablet_manager.cc:1053] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:31:13.986091 7577 raft_consensus.cc:340] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.986259 7577 raft_consensus.cc:366] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:13.986379 7577 raft_consensus.cc:705] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Initialized, Role: FOLLOWER I0403 04:31:13.986560 7577 consensus_queue.cc:229] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.986738 7577 raft_consensus.cc:380] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:13.986794 7577 raft_consensus.cc:472] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:13.986896 7577 raft_consensus.cc:2886] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:13.988433 7577 raft_consensus.cc:494] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.988626 7577 leader_election.cc:310] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6156d4c53754f0d8fa78d4f22592a61; no voters: I0403 04:31:13.988824 7577 leader_election.cc:296] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:13.988939 7581 raft_consensus.cc:2640] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:13.989205 7581 raft_consensus.cc:667] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 LEADER]: Becoming Leader. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Running, Role: LEADER I0403 04:31:13.989511 7577 ts_tablet_manager.cc:1081] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:31:13.989557 7581 consensus_queue.cc:206] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:13.991313 7365 catalog_manager.cc:3977] T cb07c565d64e4f2db9742a9d7339d7d9 P a6156d4c53754f0d8fa78d4f22592a61 reported cstate change: term changed from 0 to 1, leader changed from to a6156d4c53754f0d8fa78d4f22592a61 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "a6156d4c53754f0d8fa78d4f22592a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } health_report { overall_health: HEALTHY } } } I0403 04:31:14.046702 7365 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53992: name: "impala::default.conflicting_legacy_table" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:31:14.053212 7466 tablet_service.cc:1006] Processing CreateTablet for tablet fd99dc8271b74c0bad544b0411cdbec1 (table=impala::default.conflicting_legacy_table [id=75604c96724e4647aabca4c591566085]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:14.053633 7466 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet fd99dc8271b74c0bad544b0411cdbec1. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:14.057337 7577 tablet_bootstrap.cc:439] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61: Bootstrap starting. I0403 04:31:14.058728 7577 tablet_bootstrap.cc:590] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61: No blocks or log segments found. Creating new log. I0403 04:31:14.060587 7577 tablet_bootstrap.cc:439] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61: No bootstrap required, opened a new log I0403 04:31:14.060717 7577 ts_tablet_manager.cc:1053] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61: Time spent bootstrapping tablet: real 0.003s user 0.003s sys 0.000s I0403 04:31:14.061298 7577 raft_consensus.cc:340] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:14.061473 7577 raft_consensus.cc:366] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:14.061539 7577 raft_consensus.cc:705] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Initialized, Role: FOLLOWER I0403 04:31:14.061761 7577 consensus_queue.cc:229] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:14.061926 7577 raft_consensus.cc:380] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:14.062031 7577 raft_consensus.cc:472] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:14.062108 7577 raft_consensus.cc:2886] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:14.063905 7577 raft_consensus.cc:494] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:14.064095 7577 leader_election.cc:310] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6156d4c53754f0d8fa78d4f22592a61; no voters: I0403 04:31:14.064298 7577 leader_election.cc:296] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:14.064383 7581 raft_consensus.cc:2640] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:14.064522 7581 raft_consensus.cc:667] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 LEADER]: Becoming Leader. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Running, Role: LEADER I0403 04:31:14.064900 7577 ts_tablet_manager.cc:1081] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:31:14.064788 7581 consensus_queue.cc:206] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } W0403 04:31:14.065966 7530 tablet.cc:1786] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:31:14.066457 7365 catalog_manager.cc:3977] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61 reported cstate change: term changed from 0 to 1, leader changed from to a6156d4c53754f0d8fa78d4f22592a61 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "a6156d4c53754f0d8fa78d4f22592a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } health_report { overall_health: HEALTHY } } } I0403 04:31:14.073235 7365 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53992: name: "default.conflicting_legacy_table" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } I0403 04:31:14.078380 7466 tablet_service.cc:1006] Processing CreateTablet for tablet c22241c2fe31406c98c4d81cfaec0307 (table=default.conflicting_legacy_table [id=d988011e68064d109b2d1be6398c06cd]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:14.078722 7466 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet c22241c2fe31406c98c4d81cfaec0307. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:14.082367 7577 tablet_bootstrap.cc:439] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61: Bootstrap starting. I0403 04:31:14.083338 7577 tablet_bootstrap.cc:590] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61: No blocks or log segments found. Creating new log. I0403 04:31:14.084671 7577 tablet_bootstrap.cc:439] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61: No bootstrap required, opened a new log I0403 04:31:14.084805 7577 ts_tablet_manager.cc:1053] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:31:14.085443 7577 raft_consensus.cc:340] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:14.085561 7577 raft_consensus.cc:366] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:14.085628 7577 raft_consensus.cc:705] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Initialized, Role: FOLLOWER I0403 04:31:14.085801 7577 consensus_queue.cc:229] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:14.085965 7577 raft_consensus.cc:380] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:14.086024 7577 raft_consensus.cc:472] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:14.086117 7577 raft_consensus.cc:2886] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:14.087524 7577 raft_consensus.cc:494] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:14.087725 7577 leader_election.cc:310] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a6156d4c53754f0d8fa78d4f22592a61; no voters: I0403 04:31:14.087918 7577 leader_election.cc:296] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:14.088004 7581 raft_consensus.cc:2640] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:14.088193 7581 raft_consensus.cc:667] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [term 1 LEADER]: Becoming Leader. State: Replica: a6156d4c53754f0d8fa78d4f22592a61, State: Running, Role: LEADER I0403 04:31:14.088413 7581 consensus_queue.cc:206] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } } I0403 04:31:14.088542 7577 ts_tablet_manager.cc:1081] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:31:14.090015 7365 catalog_manager.cc:3977] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61 reported cstate change: term changed from 0 to 1, leader changed from to a6156d4c53754f0d8fa78d4f22592a61 (127.3.136.65). New cstate: current_term: 1 leader_uuid: "a6156d4c53754f0d8fa78d4f22592a61" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 37243 } health_report { overall_health: HEALTHY } } } I0403 04:31:14.097493 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 7339 I0403 04:31:14.098374 7395 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:14.163614 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 7339 I0403 04:31:14.174598 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:37289 --webserver_interface=127.3.136.126 --webserver_port=42615 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true --hive_metastore_uris=thrift://127.0.0.1:42963 --hive_metastore_sasl_enabled=false with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:14.359992 7599 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:14.360289 7599 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:14.362943 7599 flags.cc:406] Enabled experimental flag: --hive_metastore_sasl_enabled=false W0403 04:31:14.362990 7599 flags.cc:406] Enabled experimental flag: --hive_metastore_uris=thrift://127.0.0.1:42963 W0403 04:31:14.363029 7599 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:31:14.363056 7599 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:14.363090 7599 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:31:14.363119 7599 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:31:14.367872 7599 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal --hive_metastore_uris=thrift://127.0.0.1:42963 --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:37289 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=42615 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:14.374375 7599 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 239135us I0403 04:31:14.375591 7599 fs_manager.cc:263] Metadata directory not provided I0403 04:31:14.375694 7599 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:14.381284 7599 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.002s sys 0.005s I0403 04:31:14.382004 7599 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:14.382637 7599 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:14.385440 7599 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:14.385509 7599 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal uuid: "ee98b1ce6d9246a489069b51110e2d96" format_stamp: "Formatted at 2019-04-03 04:31:12 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:14.386601 7599 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:14.403853 7599 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:14.418763 7599 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:37289 I0403 04:31:14.419714 7599 webserver.cc:308] Webserver started at http://127.3.136.126:42615/ using document root and password file I0403 04:31:14.420469 7599 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.ToolTestKerberosParameterized_ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:31:14.427515 7658 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: Bootstrap starting. I0403 04:31:14.428210 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 7599 I0403 04:31:14.447835 7658 log.cc:525] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: Log is configured to *not* fsync() on all Append() calls I0403 04:31:14.470530 7658 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: Bootstrap replayed 1/1 log segments. Stats: ops{read=22 overwritten=0 applied=22 ignored=0} inserts{seen=14 ignored=0} mutations{seen=13 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:31:14.470990 7658 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: Bootstrap complete. I0403 04:31:14.478830 7658 raft_consensus.cc:340] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } I0403 04:31:14.479727 7658 raft_consensus.cc:705] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ee98b1ce6d9246a489069b51110e2d96, State: Initialized, Role: FOLLOWER I0403 04:31:14.480212 7658 consensus_queue.cc:229] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 22, Last appended: 1.22, Last appended by leader: 22, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } I0403 04:31:14.480399 7658 raft_consensus.cc:380] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:14.480502 7658 raft_consensus.cc:472] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:14.480623 7658 raft_consensus.cc:2886] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 1 FOLLOWER]: Advancing to term 2 I0403 04:31:14.485487 7658 raft_consensus.cc:494] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } I0403 04:31:14.485935 7658 leader_election.cc:310] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ee98b1ce6d9246a489069b51110e2d96; no voters: I0403 04:31:14.486639 7658 leader_election.cc:296] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [CANDIDATE]: Term 2 election: Requested vote from peers I0403 04:31:14.486821 7662 raft_consensus.cc:2640] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 2 FOLLOWER]: Leader election won for term 2 I0403 04:31:14.487777 7662 raft_consensus.cc:667] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [term 2 LEADER]: Becoming Leader. State: Replica: ee98b1ce6d9246a489069b51110e2d96, State: Running, Role: LEADER I0403 04:31:14.488127 7662 consensus_queue.cc:206] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 1.22, Last appended by leader: 22, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } I0403 04:31:14.490890 7663 sys_catalog.cc:337] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ee98b1ce6d9246a489069b51110e2d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } } I0403 04:31:14.491617 7663 sys_catalog.cc:340] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: This master's current role is: LEADER I0403 04:31:14.491590 7658 sys_catalog.cc:337] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "ee98b1ce6d9246a489069b51110e2d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } } I0403 04:31:14.491781 7658 sys_catalog.cc:340] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: This master's current role is: LEADER I0403 04:31:14.492208 7664 sys_catalog.cc:337] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ee98b1ce6d9246a489069b51110e2d96. Latest consensus state: current_term: 2 leader_uuid: "ee98b1ce6d9246a489069b51110e2d96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ee98b1ce6d9246a489069b51110e2d96" member_type: VOTER } } I0403 04:31:14.492559 7664 sys_catalog.cc:340] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: This master's current role is: LEADER I0403 04:31:14.493296 7658 sys_catalog.cc:424] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:31:14.493575 7668 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:31:14.498332 7668 catalog_manager.cc:354] Loaded metadata for table default.duplicate_hms_tables [id=0639fb81fb1e44a5bce82d4d6f1f9dd3] I0403 04:31:14.498729 7668 catalog_manager.cc:354] Loaded metadata for table default.hive-incompatible-name [id=0eeb1a84386147ff8a0c6b30a3bf77a9] I0403 04:31:14.498958 7668 catalog_manager.cc:354] Loaded metadata for table no_database [id=38a227aa7fe64e4ebac5316d392feb03] I0403 04:31:14.499348 7668 catalog_manager.cc:354] Loaded metadata for table impala::default.conflicting_legacy_table [id=75604c96724e4647aabca4c591566085] I0403 04:31:14.499588 7668 catalog_manager.cc:354] Loaded metadata for table non_existent_database.table [id=b99535637ed74857ad05f98a38434037] I0403 04:31:14.499843 7668 catalog_manager.cc:354] Loaded metadata for table default.conflicting_legacy_table [id=d988011e68064d109b2d1be6398c06cd] I0403 04:31:14.501750 7668 catalog_manager.cc:408] Loaded metadata for tablet 63c2b7f7a3e24ec3b57dbbb4c5e76358 (table no_database [id=38a227aa7fe64e4ebac5316d392feb03]) I0403 04:31:14.502188 7668 catalog_manager.cc:408] Loaded metadata for tablet 665d999897184f60938dc31a1f2880b3 (table default.duplicate_hms_tables [id=0639fb81fb1e44a5bce82d4d6f1f9dd3]) I0403 04:31:14.502501 7668 catalog_manager.cc:408] Loaded metadata for tablet a587105a328647debc94c1f8e7f34a9a (table default.hive-incompatible-name [id=0eeb1a84386147ff8a0c6b30a3bf77a9]) I0403 04:31:14.502751 7668 catalog_manager.cc:408] Loaded metadata for tablet c22241c2fe31406c98c4d81cfaec0307 (table default.conflicting_legacy_table [id=d988011e68064d109b2d1be6398c06cd]) I0403 04:31:14.503065 7668 catalog_manager.cc:408] Loaded metadata for tablet cb07c565d64e4f2db9742a9d7339d7d9 (table non_existent_database.table [id=b99535637ed74857ad05f98a38434037]) I0403 04:31:14.503485 7668 catalog_manager.cc:408] Loaded metadata for tablet fd99dc8271b74c0bad544b0411cdbec1 (table impala::default.conflicting_legacy_table [id=75604c96724e4647aabca4c591566085]) I0403 04:31:14.503644 7668 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:31:14.507125 7668 catalog_manager.cc:1075] Loading token signing keys... I0403 04:31:14.508502 7668 catalog_manager.cc:4292] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: Loaded TSK: 0 I0403 04:31:14.514134 7671 hms_notification_log_listener.cc:228] Skipping Hive Metastore notification log poll: Service unavailable: Catalog manager is not initialized. State: Starting I0403 04:31:15.100461 7625 master_service.cc:227] Got heartbeat from unknown tserver (permanent_uuid: "a6156d4c53754f0d8fa78d4f22592a61" instance_seqno: 1554265873054668) as {username='slave'} at 127.3.136.65:34681; Asking this server to re-register. I0403 04:31:15.101037 7529 heartbeater.cc:426] Registering TS with master... I0403 04:31:15.101204 7529 heartbeater.cc:475] Master 127.3.136.126:37289 requested a full tablet report, sending... I0403 04:31:15.102735 7625 ts_manager.cc:159] Registered new tserver with Master: a6156d4c53754f0d8fa78d4f22592a61 (127.3.136.65:37243) I0403 04:31:15.103703 3617 external_mini_cluster.cc:623] 1 TS(s) registered with all masters 04:31:16.185 [HMS - ERROR - pool-8-thread-4] (RetryingHMSHandler.java:204) InvalidObjectException(message:non_existent_database) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1543) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:148) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) at com.sun.proxy.$Proxy23.create_table_with_environment_context(Unknown Source) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:11191) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:11175) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:103) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) 04:31:16.212 [HMS - ERROR - pool-8-thread-4] (RetryingHMSHandler.java:204) AlreadyExistsException(message:Table conflicting_legacy_table already exists) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_core(HiveMetaStore.java:1452) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.create_table_with_environment_context(HiveMetaStore.java:1539) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:148) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107) at com.sun.proxy.$Proxy23.create_table_with_environment_context(Unknown Source) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:11191) at org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Processor$create_table_with_environment_context.getResult(ThriftHiveMetastore.java:11175) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.hadoop.hive.metastore.TUGIBasedProcessor.process(TUGIBasedProcessor.java:103) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) I0403 04:31:16.472663 7625 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54006: table { table_name: "impala::default.conflicting_legacy_table" } new_table_name: "default.conflicting_legacy_table" modify_external_catalogs: false 16908 T27 odu.Log4JLogger.warn WARN Metadata has jdbc-type of null yet this is not valid. Ignored W0403 04:31:21.800202 7536 hms_client.cc:265] Time spent drop HMS table: real 4.826s user 0.000s sys 0.000s I0403 04:31:22.185796 7671 catalog_manager.cc:1944] Deleting table default.duplicate_hms_tables_2 [id=0639fb81fb1e44a5bce82d4d6f1f9dd3] in response to Hive Metastore notification log event 6 W0403 04:31:22.186223 7671 hms_notification_log_listener.cc:297] Failed to handle Hive Metastore notification: 6 DROP_TABLE default.duplicate_hms_tables_2: Not found: the table ID refers to a different table 'default.duplicate_hms_tables' than 'default.duplicate_hms_tables_2': table_id: "0639fb81fb1e44a5bce82d4d6f1f9dd3" table_name: "default.duplicate_hms_tables_2" I0403 04:31:22.189878 7625 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54016: table { table_name: "default.hive-incompatible-name" } new_table_name: "default.hive_compatible_name" modify_external_catalogs: false I0403 04:31:22.212966 7741 tablet.cc:1269] T a587105a328647debc94c1f8e7f34a9a P a6156d4c53754f0d8fa78d4f22592a61: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0403 04:31:22.219288 7625 catalog_manager.cc:4423] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: default.hive_compatible_name [id=0eeb1a84386147ff8a0c6b30a3bf77a9] alter complete (version 1) I0403 04:31:22.527021 7625 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54020: table { table_name: "no_database" } new_table_name: "default.with_database" modify_external_catalogs: false I0403 04:31:22.533560 7741 tablet.cc:1269] T 63c2b7f7a3e24ec3b57dbbb4c5e76358 P a6156d4c53754f0d8fa78d4f22592a61: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0403 04:31:22.539160 7624 catalog_manager.cc:4423] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: default.with_database [id=38a227aa7fe64e4ebac5316d392feb03] alter complete (version 1) I0403 04:31:22.900945 7624 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54022: table { table_name: "default.conflicting_legacy_table" } new_table_name: "default.non_conflicting_legacy_table" modify_external_catalogs: false I0403 04:31:22.905552 7741 tablet.cc:1269] T c22241c2fe31406c98c4d81cfaec0307 P a6156d4c53754f0d8fa78d4f22592a61: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0403 04:31:22.910882 7624 catalog_manager.cc:4423] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: default.non_conflicting_legacy_table [id=d988011e68064d109b2d1be6398c06cd] alter complete (version 1) I0403 04:31:23.573307 7624 catalog_manager.cc:2314] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54024: table { table_name: "impala::default.conflicting_legacy_table" } new_table_name: "default.conflicting_legacy_table" modify_external_catalogs: false I0403 04:31:23.578888 7815 tablet.cc:1269] T fd99dc8271b74c0bad544b0411cdbec1 P a6156d4c53754f0d8fa78d4f22592a61: Alter schema from ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 0 to ( 10:foo INT32 NOT NULL, PRIMARY KEY (foo) ) version 1 I0403 04:31:23.585577 7624 catalog_manager.cc:4423] T 00000000000000000000000000000000 P ee98b1ce6d9246a489069b51110e2d96: default.conflicting_legacy_table [id=75604c96724e4647aabca4c591566085] alter complete (version 1) I0403 04:31:24.160290 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 7399 I0403 04:31:24.170785 7526 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:24.228637 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 7399 I0403 04:31:24.238054 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 7599 I0403 04:31:24.238926 7655 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:24.307488 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 7599 Shutting down hive metastore. [ OK ] ToolTestKerberosParameterized/ToolTestKerberosParameterized.TestCheckAndManualFixHmsMetadata/0 (23638 ms) [----------] 2 tests from ToolTestKerberosParameterized/ToolTestKerberosParameterized (38875 ms total) [----------] 1 test from CopyTableParameterized/ToolTestCopyTableParameterized [ RUN ] CopyTableParameterized/ToolTestCopyTableParameterized.TestCopyTable/2 I0403 04:31:24.853752 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:34339 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:25.037667 7840 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:25.037920 7840 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:25.040496 7840 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:31:25.040549 7840 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:25.040629 7840 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:31:25.040688 7840 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:31:25.045181 7840 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:34339 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:25.051306 7840 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 244635us I0403 04:31:25.052459 7840 fs_manager.cc:263] Metadata directory not provided I0403 04:31:25.052562 7840 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:25.052939 7840 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:25.053021 7840 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:25.055619 7840 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "89233f614f224bc8a325cf25790dc736" format_stamp: "Formatted at 2019-04-03 04:31:25 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:25.056155 7840 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "89233f614f224bc8a325cf25790dc736" format_stamp: "Formatted at 2019-04-03 04:31:25 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:25.062652 7840 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s I0403 04:31:25.063853 7840 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:25.064472 7840 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:25.067360 7840 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:25.067422 7840 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/wal uuid: "89233f614f224bc8a325cf25790dc736" format_stamp: "Formatted at 2019-04-03 04:31:25 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:25.067587 7840 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:25.101593 7840 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:25.116461 7840 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:34339 I0403 04:31:25.117512 7840 webserver.cc:308] Webserver started at http://127.3.136.126:44275/ using document root and password file I0403 04:31:25.118130 7840 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:31:25.120963 7899 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:25.127030 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 7840 I0403 04:31:25.127741 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.3.136.65:0 --local_ip_for_outbound_sockets=127.3.136.65 --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:34339 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:31:25.132614 7899 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736: Bootstrap starting. I0403 04:31:25.139190 7899 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736: No blocks or log segments found. Creating new log. I0403 04:31:25.140121 7899 log.cc:525] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736: Log is configured to *not* fsync() on all Append() calls I0403 04:31:25.147013 7899 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736: No bootstrap required, opened a new log I0403 04:31:25.154134 7899 raft_consensus.cc:340] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89233f614f224bc8a325cf25790dc736" member_type: VOTER } I0403 04:31:25.154412 7899 raft_consensus.cc:366] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:25.154491 7899 raft_consensus.cc:705] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 89233f614f224bc8a325cf25790dc736, State: Initialized, Role: FOLLOWER I0403 04:31:25.155062 7899 consensus_queue.cc:229] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89233f614f224bc8a325cf25790dc736" member_type: VOTER } I0403 04:31:25.155244 7899 raft_consensus.cc:380] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:25.155373 7899 raft_consensus.cc:472] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:25.155494 7899 raft_consensus.cc:2886] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:25.157166 7899 raft_consensus.cc:494] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89233f614f224bc8a325cf25790dc736" member_type: VOTER } I0403 04:31:25.157560 7899 leader_election.cc:310] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 89233f614f224bc8a325cf25790dc736; no voters: I0403 04:31:25.158293 7899 leader_election.cc:296] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:25.158481 7902 raft_consensus.cc:2640] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:25.159256 7902 raft_consensus.cc:667] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [term 1 LEADER]: Becoming Leader. State: Replica: 89233f614f224bc8a325cf25790dc736, State: Running, Role: LEADER I0403 04:31:25.159759 7902 consensus_queue.cc:206] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89233f614f224bc8a325cf25790dc736" member_type: VOTER } I0403 04:31:25.162288 7899 sys_catalog.cc:337] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "89233f614f224bc8a325cf25790dc736" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89233f614f224bc8a325cf25790dc736" member_type: VOTER } } I0403 04:31:25.162742 7899 sys_catalog.cc:340] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [sys.catalog]: This master's current role is: LEADER I0403 04:31:25.162742 7904 sys_catalog.cc:337] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 89233f614f224bc8a325cf25790dc736. Latest consensus state: current_term: 1 leader_uuid: "89233f614f224bc8a325cf25790dc736" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89233f614f224bc8a325cf25790dc736" member_type: VOTER } } I0403 04:31:25.163280 7904 sys_catalog.cc:340] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [sys.catalog]: This master's current role is: LEADER I0403 04:31:25.162516 7903 sys_catalog.cc:337] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "89233f614f224bc8a325cf25790dc736" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "89233f614f224bc8a325cf25790dc736" member_type: VOTER } } I0403 04:31:25.163556 7903 sys_catalog.cc:340] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [sys.catalog]: This master's current role is: LEADER I0403 04:31:25.165292 7899 sys_catalog.cc:424] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:31:25.165453 7906 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:31:25.166067 7908 catalog_manager.cc:536] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting I0403 04:31:25.170523 7906 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:31:25.211416 7906 catalog_manager.cc:950] Generated new certificate authority record I0403 04:31:25.213436 7906 catalog_manager.cc:1075] Loading token signing keys... I0403 04:31:25.224480 7906 catalog_manager.cc:4281] T 00000000000000000000000000000000 P 89233f614f224bc8a325cf25790dc736: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:25.285559 7900 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:25.285799 7900 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:25.288074 7900 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:25.288197 7900 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.65 I0403 04:31:25.306018 7900 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.65:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:34339 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.65 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:25.312762 7900 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 244635us I0403 04:31:25.313410 7900 fs_manager.cc:263] Metadata directory not provided I0403 04:31:25.313513 7900 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:25.313768 7900 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:25.313923 7900 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:25.317279 7900 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "c80b8c54e90346559bbb413ebdb7d08f" format_stamp: "Formatted at 2019-04-03 04:31:25 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:25.318045 7900 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "c80b8c54e90346559bbb413ebdb7d08f" format_stamp: "Formatted at 2019-04-03 04:31:25 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:25.327960 7900 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.009s sys 0.000s I0403 04:31:25.329103 7900 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:25.329618 7900 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:25.339715 7900 fs_manager.cc:419] Time spent opening block manager: real 0.009s user 0.008s sys 0.000s I0403 04:31:25.339781 7900 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "c80b8c54e90346559bbb413ebdb7d08f" format_stamp: "Formatted at 2019-04-03 04:31:25 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:25.339956 7900 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:25.390269 7900 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:25.392007 7900 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:31:25.392062 7900 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:31:25.530427 7900 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:35451 I0403 04:31:25.531497 7900 webserver.cc:308] Webserver started at http://127.3.136.65:43681/ using document root and password file I0403 04:31:25.532124 7900 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:31:25.536226 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 7900 I0403 04:31:25.548023 8029 heartbeater.cc:345] Connected to a master server at 127.3.136.126:34339 I0403 04:31:25.548202 8029 heartbeater.cc:426] Registering TS with master... I0403 04:31:25.548764 8029 heartbeater.cc:475] Master 127.3.136.126:34339 requested a full tablet report, sending... I0403 04:31:25.550360 7866 ts_manager.cc:159] Registered new tserver with Master: c80b8c54e90346559bbb413ebdb7d08f (127.3.136.65:35451) I0403 04:31:25.551587 3617 external_mini_cluster.cc:623] 1 TS(s) registered with all masters I0403 04:31:25.552366 7866 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.65:56501 I0403 04:31:25.552894 3617 test_util.cc:212] Using random seed: -1174490936 I0403 04:31:25.562728 7866 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60750: name: "ToolTestCopyTableParameterized" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:31:25.584419 7966 tablet_service.cc:1006] Processing CreateTablet for tablet 0dd9b5f915a54b9483666e85d24a1803 (table=ToolTestCopyTableParameterized [id=0d0b60cd4f5e4e918d0e0166a6abc9b3]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:31:25.585191 7966 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 0dd9b5f915a54b9483666e85d24a1803. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:25.596395 8042 tablet_bootstrap.cc:439] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f: Bootstrap starting. I0403 04:31:25.598771 8042 tablet_bootstrap.cc:590] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f: No blocks or log segments found. Creating new log. I0403 04:31:25.599653 8042 log.cc:525] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f: Log is configured to *not* fsync() on all Append() calls I0403 04:31:25.601092 8042 tablet_bootstrap.cc:439] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f: No bootstrap required, opened a new log I0403 04:31:25.601368 8042 ts_tablet_manager.cc:1053] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s I0403 04:31:25.607463 8042 raft_consensus.cc:340] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } } I0403 04:31:25.607797 8042 raft_consensus.cc:366] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:25.607887 8042 raft_consensus.cc:705] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80b8c54e90346559bbb413ebdb7d08f, State: Initialized, Role: FOLLOWER I0403 04:31:25.608369 8042 consensus_queue.cc:229] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } } I0403 04:31:25.608543 8042 raft_consensus.cc:380] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:25.608639 8042 raft_consensus.cc:472] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:25.608763 8042 raft_consensus.cc:2886] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:25.610409 8042 raft_consensus.cc:494] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } } I0403 04:31:25.610759 8042 leader_election.cc:310] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c80b8c54e90346559bbb413ebdb7d08f; no voters: I0403 04:31:25.611297 8042 leader_election.cc:296] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:25.611490 8044 raft_consensus.cc:2640] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:25.612212 8029 heartbeater.cc:467] Master 127.3.136.126:34339 was elected leader, sending a full tablet report... I0403 04:31:25.612543 8044 raft_consensus.cc:667] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [term 1 LEADER]: Becoming Leader. State: Replica: c80b8c54e90346559bbb413ebdb7d08f, State: Running, Role: LEADER I0403 04:31:25.612924 8042 ts_tablet_manager.cc:1081] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f: Time spent starting tablet: real 0.011s user 0.012s sys 0.000s I0403 04:31:25.613008 8044 consensus_queue.cc:206] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } } I0403 04:31:25.617238 7865 catalog_manager.cc:3977] T 0dd9b5f915a54b9483666e85d24a1803 P c80b8c54e90346559bbb413ebdb7d08f reported cstate change: term changed from 0 to 1, leader changed from to c80b8c54e90346559bbb413ebdb7d08f (127.3.136.65). New cstate: current_term: 1 leader_uuid: "c80b8c54e90346559bbb413ebdb7d08f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } health_report { overall_health: HEALTHY } } } I0403 04:31:25.668398 3617 test_util.cc:212] Using random seed: -1174375404 I0403 04:31:25.681454 7865 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60756: name: "kudu.table.copy.to" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 1 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:31:25.687464 7966 tablet_service.cc:1006] Processing CreateTablet for tablet 216c0526bd944c7da8c2a62cabe430ba (table=kudu.table.copy.to [id=f889b2c3c89047e7bb5f99b070968384]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:31:25.687796 7966 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 216c0526bd944c7da8c2a62cabe430ba. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:25.691424 8042 tablet_bootstrap.cc:439] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f: Bootstrap starting. I0403 04:31:25.692561 8042 tablet_bootstrap.cc:590] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f: No blocks or log segments found. Creating new log. I0403 04:31:25.694177 8042 tablet_bootstrap.cc:439] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f: No bootstrap required, opened a new log I0403 04:31:25.694296 8042 ts_tablet_manager.cc:1053] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f: Time spent bootstrapping tablet: real 0.003s user 0.002s sys 0.000s I0403 04:31:25.694948 8042 raft_consensus.cc:340] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } } I0403 04:31:25.695065 8042 raft_consensus.cc:366] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:25.695142 8042 raft_consensus.cc:705] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c80b8c54e90346559bbb413ebdb7d08f, State: Initialized, Role: FOLLOWER I0403 04:31:25.695312 8042 consensus_queue.cc:229] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } } I0403 04:31:25.695457 8042 raft_consensus.cc:380] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:25.695526 8042 raft_consensus.cc:472] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:25.695626 8042 raft_consensus.cc:2886] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:25.697345 8042 raft_consensus.cc:494] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } } I0403 04:31:25.697547 8042 leader_election.cc:310] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c80b8c54e90346559bbb413ebdb7d08f; no voters: I0403 04:31:25.697751 8042 leader_election.cc:296] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:25.697863 8046 raft_consensus.cc:2640] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:25.698026 8046 raft_consensus.cc:667] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [term 1 LEADER]: Becoming Leader. State: Replica: c80b8c54e90346559bbb413ebdb7d08f, State: Running, Role: LEADER I0403 04:31:25.698289 8046 consensus_queue.cc:206] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } } I0403 04:31:25.698447 8042 ts_tablet_manager.cc:1081] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s I0403 04:31:25.699993 7865 catalog_manager.cc:3977] T 216c0526bd944c7da8c2a62cabe430ba P c80b8c54e90346559bbb413ebdb7d08f reported cstate change: term changed from 0 to 1, leader changed from to c80b8c54e90346559bbb413ebdb7d08f (127.3.136.65). New cstate: current_term: 1 leader_uuid: "c80b8c54e90346559bbb413ebdb7d08f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c80b8c54e90346559bbb413ebdb7d08f" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 35451 } health_report { overall_health: HEALTHY } } } /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tools/kudu-tool-test.cc:582: Failure Value of: dst_line Expected: has no substring "key" Actual: "(int32 key=151, int32 int_val=-325474784, string string_val=\"7ca8cde3dcca640a\")" (of type std::string) /data/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tools/kudu-tool-test.cc:3067: Failure Expected: RunCopyTableCheck(arg) doesn't generate new fatal failures in the current thread. Actual: it does. I0403 04:31:27.631312 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 7900 I0403 04:31:27.636993 8026 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:27.710196 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 7900 W0403 04:31:27.724107 7849 connection.cc:647] server connection from 127.3.136.65:56501 recv error: Network error: recv error from 0.0.0.0:0: Transport endpoint is not connected (error 107) I0403 04:31:27.724252 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 7840 I0403 04:31:27.725304 7896 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:27.796219 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 7840 I0403 04:31:27.809978 3617 test_util.cc:135] ----------------------------------------------- I0403 04:31:27.810011 3617 test_util.cc:136] Had fatal failures, leaving test files at /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.CopyTableParameterized_ToolTestCopyTableParameterized.TestCopyTable_2.1554265799459872-3617 [ FAILED ] CopyTableParameterized/ToolTestCopyTableParameterized.TestCopyTable/2, where GetParam() = 2 (2959 ms) [----------] 1 test from CopyTableParameterized/ToolTestCopyTableParameterized (2959 ms total) [----------] 1 test from SerializationModes/ControlShellToolTest [ RUN ] SerializationModes/ControlShellToolTest.TestControlShell/0 I0403 04:31:28.057142 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.7.236.62:38033 --webserver_interface=127.7.236.62 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:28.236395 8118 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:28.236613 8118 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:28.239090 8118 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:31:28.239136 8118 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:28.239183 8118 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:31:28.239233 8118 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:31:28.243649 8118 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.7.236.62:38033 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.7.236.62 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:28.249725 8118 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 246135us I0403 04:31:28.250968 8118 fs_manager.cc:263] Metadata directory not provided I0403 04:31:28.251065 8118 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:28.251377 8118 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:28.251464 8118 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:28.253991 8118 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "fdb4b121834a41f6888717efe01939eb" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:28.254595 8118 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "fdb4b121834a41f6888717efe01939eb" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:28.261091 8118 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s I0403 04:31:28.262311 8118 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:28.262900 8118 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:28.265734 8118 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0403 04:31:28.265797 8118 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal uuid: "fdb4b121834a41f6888717efe01939eb" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:28.265985 8118 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:28.285295 8118 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:28.299794 8118 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.62:38033 I0403 04:31:28.300763 8118 webserver.cc:308] Webserver started at http://127.7.236.62:40173/ using document root and password file I0403 04:31:28.301410 8118 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:31:28.304384 8177 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:28.306802 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 8118 I0403 04:31:28.307605 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.7.236.1:0 --local_ip_for_outbound_sockets=127.7.236.1 --webserver_interface=127.7.236.1 --webserver_port=0 --tserver_master_addrs=127.7.236.62:38033 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:31:28.320268 8177 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Bootstrap starting. I0403 04:31:28.326838 8177 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: No blocks or log segments found. Creating new log. I0403 04:31:28.327785 8177 log.cc:525] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Log is configured to *not* fsync() on all Append() calls I0403 04:31:28.335276 8177 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: No bootstrap required, opened a new log I0403 04:31:28.345778 8177 raft_consensus.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:28.346084 8177 raft_consensus.cc:366] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:28.346159 8177 raft_consensus.cc:705] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb4b121834a41f6888717efe01939eb, State: Initialized, Role: FOLLOWER I0403 04:31:28.346750 8177 consensus_queue.cc:229] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:28.346979 8177 raft_consensus.cc:380] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:28.347096 8177 raft_consensus.cc:472] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:28.347229 8177 raft_consensus.cc:2886] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:28.349736 8177 raft_consensus.cc:494] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:28.350263 8177 leader_election.cc:310] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdb4b121834a41f6888717efe01939eb; no voters: I0403 04:31:28.354044 8177 leader_election.cc:296] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:28.354230 8180 raft_consensus.cc:2640] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:28.357894 8180 raft_consensus.cc:667] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 1 LEADER]: Becoming Leader. State: Replica: fdb4b121834a41f6888717efe01939eb, State: Running, Role: LEADER I0403 04:31:28.358209 8180 consensus_queue.cc:206] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:28.361688 8182 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdb4b121834a41f6888717efe01939eb. Latest consensus state: current_term: 1 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:28.362149 8182 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:28.361887 8177 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:28.362428 8177 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:28.362365 8181 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:28.362778 8181 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:28.363822 8177 sys_catalog.cc:424] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: configured and running, proceeding with master startup. I0403 04:31:28.364009 8186 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:31:28.372283 8186 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:31:28.507807 8186 catalog_manager.cc:950] Generated new certificate authority record I0403 04:31:28.509192 8186 catalog_manager.cc:1075] Loading token signing keys... WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:28.513397 8178 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:28.513669 8178 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:28.517158 8178 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:28.517375 8178 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.236.1 I0403 04:31:28.517496 8186 catalog_manager.cc:4281] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Generated new TSK 0 I0403 04:31:28.534052 8178 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.7.236.1:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.7.236.1 --webserver_port=0 --tserver_master_addrs=127.7.236.62:38033 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.7.236.1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:28.543928 8178 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 246135us I0403 04:31:28.544750 8178 fs_manager.cc:263] Metadata directory not provided I0403 04:31:28.544867 8178 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:28.545269 8178 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:28.545408 8178 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:28.548576 8178 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:28.549401 8178 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:28.560034 8178 fs_manager.cc:503] Time spent creating directory manager: real 0.010s user 0.005s sys 0.008s I0403 04:31:28.561615 8178 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:28.562458 8178 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:28.566069 8178 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:28.566159 8178 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:28.566377 8178 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:28.641619 8178 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:28.647047 8178 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:31:28.647115 8178 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:31:28.826086 8178 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.1:44021 I0403 04:31:28.830065 8178 webserver.cc:308] Webserver started at http://127.7.236.1:38805/ using document root and password file I0403 04:31:28.830833 8178 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:31:28.833812 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 8178 I0403 04:31:28.834540 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.7.236.2:0 --local_ip_for_outbound_sockets=127.7.236.2 --webserver_interface=127.7.236.2 --webserver_port=0 --tserver_master_addrs=127.7.236.62:38033 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:31:28.860273 8308 heartbeater.cc:345] Connected to a master server at 127.7.236.62:38033 I0403 04:31:28.860463 8308 heartbeater.cc:426] Registering TS with master... I0403 04:31:28.861097 8308 heartbeater.cc:475] Master 127.7.236.62:38033 requested a full tablet report, sending... I0403 04:31:28.862712 8144 ts_manager.cc:159] Registered new tserver with Master: eaa406f6d69b41dfb3b47d0c30cb7339 (127.7.236.1:44021) I0403 04:31:28.864351 8144 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.7.236.1:48915 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:28.995937 8312 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:28.996217 8312 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:28.998497 8312 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:28.998620 8312 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.236.2 I0403 04:31:29.002673 8312 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.7.236.2:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --webserver_interface=127.7.236.2 --webserver_port=0 --tserver_master_addrs=127.7.236.62:38033 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.7.236.2 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:29.010224 8312 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 246635us I0403 04:31:29.010943 8312 fs_manager.cc:263] Metadata directory not provided I0403 04:31:29.011032 8312 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:29.011340 8312 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:29.011435 8312 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:29.014094 8312 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/instance: uuid: "39ea7c600cb547aa9556d9324d9137f3" format_stamp: "Formatted at 2019-04-03 04:31:29 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:29.014765 8312 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal/instance: uuid: "39ea7c600cb547aa9556d9324d9137f3" format_stamp: "Formatted at 2019-04-03 04:31:29 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:29.021739 8312 fs_manager.cc:503] Time spent creating directory manager: real 0.007s user 0.006s sys 0.000s I0403 04:31:29.022912 8312 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:29.023511 8312 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:29.026552 8312 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:29.026638 8312 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal uuid: "39ea7c600cb547aa9556d9324d9137f3" format_stamp: "Formatted at 2019-04-03 04:31:29 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:29.026818 8312 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:29.071386 8312 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:29.073259 8312 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:31:29.073359 8312 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:31:29.101791 8312 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.2:44783 I0403 04:31:29.102911 8312 webserver.cc:308] Webserver started at http://127.7.236.2:44933/ using document root and password file I0403 04:31:29.103538 8312 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb I0403 04:31:29.109174 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 8312 I0403 04:31:29.109905 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.7.236.3:0 --local_ip_for_outbound_sockets=127.7.236.3 --webserver_interface=127.7.236.3 --webserver_port=0 --tserver_master_addrs=127.7.236.62:38033 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:31:29.116216 8431 heartbeater.cc:345] Connected to a master server at 127.7.236.62:38033 I0403 04:31:29.116416 8431 heartbeater.cc:426] Registering TS with master... I0403 04:31:29.116993 8431 heartbeater.cc:475] Master 127.7.236.62:38033 requested a full tablet report, sending... I0403 04:31:29.118127 8144 ts_manager.cc:159] Registered new tserver with Master: 39ea7c600cb547aa9556d9324d9137f3 (127.7.236.2:44783) I0403 04:31:29.119058 8144 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.7.236.2:52663 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:29.249189 8434 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:29.249388 8434 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:29.251523 8434 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:29.251623 8434 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.236.3 I0403 04:31:29.255380 8434 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.7.236.3:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --webserver_interface=127.7.236.3 --webserver_port=0 --tserver_master_addrs=127.7.236.62:38033 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.7.236.3 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:29.262166 8434 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 246635us I0403 04:31:29.262765 8434 fs_manager.cc:263] Metadata directory not provided I0403 04:31:29.262847 8434 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:29.263087 8434 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:29.263265 8434 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:29.265535 8434 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/instance: uuid: "0523d5a5a2e14f3e97357051f7a39237" format_stamp: "Formatted at 2019-04-03 04:31:29 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:29.266158 8434 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal/instance: uuid: "0523d5a5a2e14f3e97357051f7a39237" format_stamp: "Formatted at 2019-04-03 04:31:29 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:29.272917 8434 fs_manager.cc:503] Time spent creating directory manager: real 0.007s user 0.005s sys 0.001s I0403 04:31:29.274013 8434 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:29.274549 8434 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:29.277482 8434 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:29.277570 8434 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal uuid: "0523d5a5a2e14f3e97357051f7a39237" format_stamp: "Formatted at 2019-04-03 04:31:29 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:29.277716 8434 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:29.312871 8434 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:29.314473 8434 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:31:29.314530 8434 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:31:29.342941 8434 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.3:46077 I0403 04:31:29.344003 8434 webserver.cc:308] Webserver started at http://127.7.236.3:35333/ using document root and password file I0403 04:31:29.344648 8434 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb I0403 04:31:29.350448 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 8434 I0403 04:31:29.357885 8553 heartbeater.cc:345] Connected to a master server at 127.7.236.62:38033 I0403 04:31:29.358065 8553 heartbeater.cc:426] Registering TS with master... I0403 04:31:29.358562 8553 heartbeater.cc:475] Master 127.7.236.62:38033 requested a full tablet report, sending... I0403 04:31:29.359699 8144 ts_manager.cc:159] Registered new tserver with Master: 0523d5a5a2e14f3e97357051f7a39237 (127.7.236.3:46077) I0403 04:31:29.360780 8144 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.7.236.3:35827 I0403 04:31:29.372197 8112 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0403 04:31:29.387295 8144 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34628: name: "test" schema { columns { name: "foo" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } split_rows_range_bounds { } partition_schema { range_schema { columns { name: "foo" } } } W0403 04:31:29.392267 8144 catalog_manager.cc:1575] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers. I0403 04:31:29.425859 8368 tablet_service.cc:1006] Processing CreateTablet for tablet a00dc3f0c8194ff78f259ead98948da3 (table=test [id=f25bb63dc8684813aba5e0612dbd38d2]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:29.426091 8245 tablet_service.cc:1006] Processing CreateTablet for tablet a00dc3f0c8194ff78f259ead98948da3 (table=test [id=f25bb63dc8684813aba5e0612dbd38d2]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:29.426784 8368 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a00dc3f0c8194ff78f259ead98948da3. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:29.426972 8245 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a00dc3f0c8194ff78f259ead98948da3. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:29.426693 8490 tablet_service.cc:1006] Processing CreateTablet for tablet a00dc3f0c8194ff78f259ead98948da3 (table=test [id=f25bb63dc8684813aba5e0612dbd38d2]), partition=RANGE (foo) PARTITION UNBOUNDED I0403 04:31:29.427580 8490 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet a00dc3f0c8194ff78f259ead98948da3. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:29.438617 8572 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Bootstrap starting. I0403 04:31:29.440018 8573 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Bootstrap starting. I0403 04:31:29.442868 8573 tablet_bootstrap.cc:590] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: No blocks or log segments found. Creating new log. I0403 04:31:29.443965 8572 tablet_bootstrap.cc:590] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: No blocks or log segments found. Creating new log. I0403 04:31:29.445055 8574 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Bootstrap starting. I0403 04:31:29.445143 8572 log.cc:525] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Log is configured to *not* fsync() on all Append() calls I0403 04:31:29.447644 8574 tablet_bootstrap.cc:590] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: No blocks or log segments found. Creating new log. I0403 04:31:29.448606 8574 log.cc:525] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Log is configured to *not* fsync() on all Append() calls I0403 04:31:29.449955 8573 log.cc:525] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Log is configured to *not* fsync() on all Append() calls I0403 04:31:29.450158 8572 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: No bootstrap required, opened a new log I0403 04:31:29.450474 8572 ts_tablet_manager.cc:1053] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s I0403 04:31:29.451283 8574 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: No bootstrap required, opened a new log I0403 04:31:29.451541 8574 ts_tablet_manager.cc:1053] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.000s I0403 04:31:29.451747 8573 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: No bootstrap required, opened a new log I0403 04:31:29.451999 8573 ts_tablet_manager.cc:1053] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.000s I0403 04:31:29.456765 8572 raft_consensus.cc:340] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.457131 8572 raft_consensus.cc:366] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:29.457217 8572 raft_consensus.cc:705] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ea7c600cb547aa9556d9324d9137f3, State: Initialized, Role: FOLLOWER I0403 04:31:29.457655 8572 consensus_queue.cc:229] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.458454 8431 heartbeater.cc:467] Master 127.7.236.62:38033 was elected leader, sending a full tablet report... I0403 04:31:29.459041 8572 ts_tablet_manager.cc:1081] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s I0403 04:31:29.460316 8574 raft_consensus.cc:340] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.460783 8574 raft_consensus.cc:366] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:29.460862 8574 raft_consensus.cc:705] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0523d5a5a2e14f3e97357051f7a39237, State: Initialized, Role: FOLLOWER I0403 04:31:29.461048 8573 raft_consensus.cc:340] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.461385 8574 consensus_queue.cc:229] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.461638 8573 raft_consensus.cc:366] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:29.461715 8573 raft_consensus.cc:705] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa406f6d69b41dfb3b47d0c30cb7339, State: Initialized, Role: FOLLOWER I0403 04:31:29.462370 8553 heartbeater.cc:467] Master 127.7.236.62:38033 was elected leader, sending a full tablet report... I0403 04:31:29.462226 8573 consensus_queue.cc:229] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.462913 8574 ts_tablet_manager.cc:1081] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Time spent starting tablet: real 0.011s user 0.010s sys 0.001s I0403 04:31:29.463217 8308 heartbeater.cc:467] Master 127.7.236.62:38033 was elected leader, sending a full tablet report... I0403 04:31:29.464284 8573 ts_tablet_manager.cc:1081] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s W0403 04:31:29.588528 8309 tablet.cc:1786] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:31:29.596422 8554 tablet.cc:1786] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:31:29.605305 8432 tablet.cc:1786] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:31:29.840633 8579 raft_consensus.cc:472] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0403 04:31:29.840838 8579 raft_consensus.cc:494] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.842175 8579 leader_election.cc:296] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eaa406f6d69b41dfb3b47d0c30cb7339 (127.7.236.1:44021), 39ea7c600cb547aa9556d9324d9137f3 (127.7.236.2:44783) I0403 04:31:29.848714 8388 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a00dc3f0c8194ff78f259ead98948da3" candidate_uuid: "0523d5a5a2e14f3e97357051f7a39237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ea7c600cb547aa9556d9324d9137f3" is_pre_election: true I0403 04:31:29.849069 8388 raft_consensus.cc:2346] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0523d5a5a2e14f3e97357051f7a39237 in term 0. I0403 04:31:29.849694 8442 leader_election.cc:310] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0523d5a5a2e14f3e97357051f7a39237, 39ea7c600cb547aa9556d9324d9137f3; no voters: I0403 04:31:29.850147 8579 raft_consensus.cc:2640] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0403 04:31:29.850231 8579 raft_consensus.cc:472] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0403 04:31:29.850112 8265 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a00dc3f0c8194ff78f259ead98948da3" candidate_uuid: "0523d5a5a2e14f3e97357051f7a39237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" is_pre_election: true I0403 04:31:29.850308 8579 raft_consensus.cc:2886] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:29.850474 8265 raft_consensus.cc:2346] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0523d5a5a2e14f3e97357051f7a39237 in term 0. I0403 04:31:29.852314 8579 raft_consensus.cc:494] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.852890 8579 leader_election.cc:296] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [CANDIDATE]: Term 1 election: Requested vote from peers eaa406f6d69b41dfb3b47d0c30cb7339 (127.7.236.1:44021), 39ea7c600cb547aa9556d9324d9137f3 (127.7.236.2:44783) I0403 04:31:29.853220 8265 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a00dc3f0c8194ff78f259ead98948da3" candidate_uuid: "0523d5a5a2e14f3e97357051f7a39237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" I0403 04:31:29.853371 8265 raft_consensus.cc:2886] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:29.853361 8388 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "a00dc3f0c8194ff78f259ead98948da3" candidate_uuid: "0523d5a5a2e14f3e97357051f7a39237" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39ea7c600cb547aa9556d9324d9137f3" I0403 04:31:29.853518 8388 raft_consensus.cc:2886] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:29.855425 8265 raft_consensus.cc:2346] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0523d5a5a2e14f3e97357051f7a39237 in term 1. I0403 04:31:29.855427 8388 raft_consensus.cc:2346] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0523d5a5a2e14f3e97357051f7a39237 in term 1. I0403 04:31:29.855772 8442 leader_election.cc:310] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0523d5a5a2e14f3e97357051f7a39237, 39ea7c600cb547aa9556d9324d9137f3; no voters: I0403 04:31:29.856067 8579 raft_consensus.cc:2640] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:29.856423 8579 raft_consensus.cc:667] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 1 LEADER]: Becoming Leader. State: Replica: 0523d5a5a2e14f3e97357051f7a39237, State: Running, Role: LEADER I0403 04:31:29.856875 8579 consensus_queue.cc:206] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:29.860383 8142 catalog_manager.cc:3977] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 reported cstate change: term changed from 0 to 1, leader changed from to 0523d5a5a2e14f3e97357051f7a39237 (127.7.236.3). New cstate: current_term: 1 leader_uuid: "0523d5a5a2e14f3e97357051f7a39237" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } health_report { overall_health: UNKNOWN } } } I0403 04:31:29.974789 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 8178 I0403 04:31:29.980572 8305 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:30.027379 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 8178 I0403 04:31:30.037178 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.7.236.1:44021 --local_ip_for_outbound_sockets=127.7.236.1 --webserver_port=38805 --webserver_interface=127.7.236.1 --tserver_master_addrs=127.7.236.62:38033 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:30.186703 8586 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:30.186918 8586 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:30.189239 8586 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:30.189373 8586 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.236.1 I0403 04:31:30.193418 8586 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.7.236.1:44021 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.7.236.1 --webserver_port=38805 --tserver_master_addrs=127.7.236.62:38033 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.7.236.1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:30.200662 8586 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 247135us I0403 04:31:30.201248 8586 fs_manager.cc:263] Metadata directory not provided I0403 04:31:30.201359 8586 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:30.206776 8586 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.003s sys 0.001s I0403 04:31:30.207448 8586 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:30.207971 8586 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:30.210816 8586 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0403 04:31:30.210892 8586 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:30.211913 8586 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:30.271306 8586 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:30.273188 8586 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0403 04:31:30.277019 8586 ts_tablet_manager.cc:356] Loaded tablet metadata (1 total tablets, 1 live tablets) I0403 04:31:30.277115 8586 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0403 04:31:30.279558 8586 ts_tablet_manager.cc:376] Registered 1 tablets I0403 04:31:30.280050 8601 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Bootstrap starting. I0403 04:31:30.294534 8601 log.cc:525] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Log is configured to *not* fsync() on all Append() calls I0403 04:31:30.297793 8601 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:31:30.298590 8601 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Bootstrap complete. I0403 04:31:30.299748 8601 ts_tablet_manager.cc:1053] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.011s I0403 04:31:30.303485 8388 raft_consensus.cc:1181] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 1 FOLLOWER]: Refusing update from remote peer 0523d5a5a2e14f3e97357051f7a39237: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 1. (index mismatch) I0403 04:31:30.304497 8579 consensus_queue.cc:984] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s W0403 04:31:30.315140 8444 consensus_peers.cc:457] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 -> Peer eaa406f6d69b41dfb3b47d0c30cb7339 (127.7.236.1:44021): Couldn't send request to peer eaa406f6d69b41dfb3b47d0c30cb7339. Status: Network error: Client connection negotiation failed: client connection to 127.7.236.1:44021: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry. I0403 04:31:30.320796 8601 raft_consensus.cc:340] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:30.327397 8601 raft_consensus.cc:705] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa406f6d69b41dfb3b47d0c30cb7339, State: Initialized, Role: FOLLOWER I0403 04:31:30.327807 8601 consensus_queue.cc:229] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:30.330525 8601 ts_tablet_manager.cc:1081] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Time spent starting tablet: real 0.031s user 0.020s sys 0.001s I0403 04:31:30.343901 8586 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.1:44021 I0403 04:31:30.344869 8586 webserver.cc:308] Webserver started at http://127.7.236.1:38805/ using document root and password file I0403 04:31:30.345463 8586 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:31:30.347437 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 8586 I0403 04:31:30.347914 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 8118 I0403 04:31:30.348778 8174 generic_service.cc:171] Checking for leaks (request via RPC) W0403 04:31:30.353013 8714 tablet.cc:1786] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:31:30.421887 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 8118 I0403 04:31:30.435936 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.7.236.62:38033 --webserver_interface=127.7.236.62 --webserver_port=40173 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} W0403 04:31:30.436064 8717 negotiation.cc:313] Failed RPC negotiation. Trace: 0403 04:31:30.353080 (+ 0us) reactor.cc:583] Submitting negotiation task for client connection to 127.7.236.62:38033 0403 04:31:30.354416 (+ 1336us) negotiation.cc:98] Waiting for socket to connect 0403 04:31:30.354459 (+ 43us) client_negotiation.cc:167] Beginning negotiation 0403 04:31:30.354786 (+ 327us) client_negotiation.cc:244] Sending NEGOTIATE NegotiatePB request 0403 04:31:30.422438 (+ 67652us) client_negotiation.cc:261] Received NEGOTIATE NegotiatePB response 0403 04:31:30.422454 (+ 16us) client_negotiation.cc:355] Received NEGOTIATE response from server 0403 04:31:30.422598 (+ 144us) client_negotiation.cc:182] Negotiated authn=SASL 0403 04:31:30.422921 (+ 323us) client_negotiation.cc:483] Received TLS_HANDSHAKE response from server 0403 04:31:30.423111 (+ 190us) client_negotiation.cc:471] Sending TLS_HANDSHAKE message to server 0403 04:31:30.423129 (+ 18us) client_negotiation.cc:244] Sending TLS_HANDSHAKE NegotiatePB request 0403 04:31:30.434930 (+ 11801us) negotiation.cc:304] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.7.236.62:38033: BlockingRecv error: recv error from 0.0.0.0:0: Transport endpoint is not connected (error 107) Metrics: {"client-negotiator.queue_time_us":778,"thread_start_us":520,"threads_started":1} W0403 04:31:30.436758 8713 heartbeater.cc:587] Failed to heartbeat to 127.7.236.62:38033 (0 consecutive failures): Network error: Failed to ping master at 127.7.236.62:38033: Client connection negotiation failed: client connection to 127.7.236.62:38033: BlockingRecv error: recv error from 0.0.0.0:0: Transport endpoint is not connected (error 107) W0403 04:31:30.438647 8713 heartbeater.cc:380] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts. WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:30.610874 8718 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:30.611119 8718 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:30.614137 8718 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:31:30.614187 8718 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:30.614264 8718 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:31:30.614318 8718 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:31:30.619469 8718 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.7.236.62:38033 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.7.236.62 --webserver_port=40173 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:30.625473 8718 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 247135us I0403 04:31:30.626607 8718 fs_manager.cc:263] Metadata directory not provided I0403 04:31:30.626700 8718 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:30.632704 8718 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s I0403 04:31:30.633560 8718 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:30.634207 8718 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:30.637416 8718 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:30.637501 8718 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal uuid: "fdb4b121834a41f6888717efe01939eb" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:30.638659 8718 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:30.664482 8718 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:30.679708 8718 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.62:38033 I0403 04:31:30.680706 8718 webserver.cc:308] Webserver started at http://127.7.236.62:40173/ using document root and password file I0403 04:31:30.681362 8718 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:31:30.685714 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 8718 I0403 04:31:30.686810 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 8586 I0403 04:31:30.689255 8777 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Bootstrap starting. I0403 04:31:30.700377 8710 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:30.704699 8777 log.cc:525] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Log is configured to *not* fsync() on all Append() calls I0403 04:31:30.712803 8777 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=4 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:31:30.713268 8777 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Bootstrap complete. I0403 04:31:30.723474 8777 raft_consensus.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:30.724249 8777 raft_consensus.cc:705] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb4b121834a41f6888717efe01939eb, State: Initialized, Role: FOLLOWER I0403 04:31:30.724797 8777 consensus_queue.cc:229] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:30.724987 8777 raft_consensus.cc:380] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:30.725085 8777 raft_consensus.cc:472] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:30.725198 8777 raft_consensus.cc:2886] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 1 FOLLOWER]: Advancing to term 2 I0403 04:31:30.729317 8777 raft_consensus.cc:494] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:30.729738 8777 leader_election.cc:310] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdb4b121834a41f6888717efe01939eb; no voters: I0403 04:31:30.730509 8782 raft_consensus.cc:2640] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 2 FOLLOWER]: Leader election won for term 2 I0403 04:31:30.730862 8777 leader_election.cc:296] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [CANDIDATE]: Term 2 election: Requested vote from peers I0403 04:31:30.731637 8782 raft_consensus.cc:667] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 2 LEADER]: Becoming Leader. State: Replica: fdb4b121834a41f6888717efe01939eb, State: Running, Role: LEADER I0403 04:31:30.731979 8782 consensus_queue.cc:206] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 6, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:30.734892 8784 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdb4b121834a41f6888717efe01939eb. Latest consensus state: current_term: 2 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:30.735157 8784 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:30.738312 8777 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 2 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:30.738445 8777 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:30.739512 8777 sys_catalog.cc:424] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: configured and running, proceeding with master startup. I0403 04:31:30.739562 8783 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:30.739817 8783 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:30.740053 8788 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:31:30.746569 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 8586 I0403 04:31:30.748137 8788 catalog_manager.cc:354] Loaded metadata for table test [id=f25bb63dc8684813aba5e0612dbd38d2] I0403 04:31:30.749609 8788 catalog_manager.cc:408] Loaded metadata for tablet a00dc3f0c8194ff78f259ead98948da3 (table test [id=f25bb63dc8684813aba5e0612dbd38d2]) I0403 04:31:30.754037 8788 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:31:30.755455 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 8312 I0403 04:31:30.757495 8788 catalog_manager.cc:1075] Loading token signing keys... I0403 04:31:30.761400 8428 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:30.762810 8788 catalog_manager.cc:4292] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Loaded TSK: 0 I0403 04:31:30.833643 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 8312 I0403 04:31:30.845901 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 8434 I0403 04:31:30.854770 8550 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:30.908665 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 8434 I0403 04:31:30.917098 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 8718 I0403 04:31:30.926172 8774 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:30.987710 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 8718 I0403 04:31:30.998375 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.7.236.62:38033 --webserver_interface=127.7.236.62 --webserver_port=40173 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:31.174362 8797 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:31.174598 8797 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:31.177098 8797 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:31:31.177150 8797 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:31.177224 8797 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:31:31.177280 8797 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:31:31.182013 8797 master_main.cc:73] Master server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.7.236.62:38033 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.7.236.62 --webserver_port=40173 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:31.188556 8797 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 247635us I0403 04:31:31.189659 8797 fs_manager.cc:263] Metadata directory not provided I0403 04:31:31.189744 8797 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:31.195560 8797 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.002s sys 0.002s I0403 04:31:31.196362 8797 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:31.197068 8797 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:31.200260 8797 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:31.200346 8797 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal uuid: "fdb4b121834a41f6888717efe01939eb" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:31.201409 8797 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:31.235795 8797 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:31.250702 8797 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.62:38033 I0403 04:31:31.251808 8797 webserver.cc:308] Webserver started at http://127.7.236.62:40173/ using document root and password file I0403 04:31:31.252522 8797 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:31:31.257876 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 8797 I0403 04:31:31.258309 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.7.236.1:44021 --local_ip_for_outbound_sockets=127.7.236.1 --webserver_port=38805 --webserver_interface=127.7.236.1 --tserver_master_addrs=127.7.236.62:38033 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:31:31.260386 8856 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Bootstrap starting. I0403 04:31:31.278585 8856 log.cc:525] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Log is configured to *not* fsync() on all Append() calls I0403 04:31:31.293143 8856 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=4 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:31:31.293748 8856 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Bootstrap complete. I0403 04:31:31.309499 8856 raft_consensus.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 2 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:31.310667 8856 raft_consensus.cc:705] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: fdb4b121834a41f6888717efe01939eb, State: Initialized, Role: FOLLOWER I0403 04:31:31.311311 8856 consensus_queue.cc:229] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 2.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:31.311612 8856 raft_consensus.cc:380] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:31.311733 8856 raft_consensus.cc:472] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:31.311872 8856 raft_consensus.cc:2886] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 2 FOLLOWER]: Advancing to term 3 I0403 04:31:31.318143 8856 raft_consensus.cc:494] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:31.318702 8856 leader_election.cc:310] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fdb4b121834a41f6888717efe01939eb; no voters: I0403 04:31:31.319648 8859 raft_consensus.cc:2640] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 3 FOLLOWER]: Leader election won for term 3 I0403 04:31:31.320122 8856 leader_election.cc:296] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [CANDIDATE]: Term 3 election: Requested vote from peers I0403 04:31:31.321089 8859 raft_consensus.cc:667] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [term 3 LEADER]: Becoming Leader. State: Replica: fdb4b121834a41f6888717efe01939eb, State: Running, Role: LEADER I0403 04:31:31.321513 8859 consensus_queue.cc:206] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 2.7, Last appended by leader: 7, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } I0403 04:31:31.324751 8860 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:31.325687 8860 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:31.325544 8856 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 3 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:31.326551 8856 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:31.329342 8856 sys_catalog.cc:424] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: configured and running, proceeding with master startup. I0403 04:31:31.326508 8861 sys_catalog.cc:337] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: SysCatalogTable state changed. Reason: New leader fdb4b121834a41f6888717efe01939eb. Latest consensus state: current_term: 3 leader_uuid: "fdb4b121834a41f6888717efe01939eb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fdb4b121834a41f6888717efe01939eb" member_type: VOTER } } I0403 04:31:31.330668 8861 sys_catalog.cc:340] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb [sys.catalog]: This master's current role is: LEADER I0403 04:31:31.331091 8865 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:31:31.340555 8865 catalog_manager.cc:354] Loaded metadata for table test [id=f25bb63dc8684813aba5e0612dbd38d2] I0403 04:31:31.342483 8865 catalog_manager.cc:408] Loaded metadata for tablet a00dc3f0c8194ff78f259ead98948da3 (table test [id=f25bb63dc8684813aba5e0612dbd38d2]) I0403 04:31:31.342692 8865 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:31:31.350818 8865 catalog_manager.cc:1075] Loading token signing keys... I0403 04:31:31.352214 8865 catalog_manager.cc:4292] T 00000000000000000000000000000000 P fdb4b121834a41f6888717efe01939eb: Loaded TSK: 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:31.465111 8857 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:31.465414 8857 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:31.469059 8857 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:31.469231 8857 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.236.1 I0403 04:31:31.478592 8857 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.7.236.1:44021 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.7.236.1 --webserver_port=38805 --tserver_master_addrs=127.7.236.62:38033 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.7.236.1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:31.488427 8857 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 247635us I0403 04:31:31.489202 8857 fs_manager.cc:263] Metadata directory not provided I0403 04:31:31.489315 8857 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:31.496104 8857 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.001s sys 0.004s I0403 04:31:31.497009 8857 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:31.497747 8857 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:31.507480 8857 fs_manager.cc:419] Time spent opening block manager: real 0.008s user 0.000s sys 0.007s I0403 04:31:31.507575 8857 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" format_stamp: "Formatted at 2019-04-03 04:31:28 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:31.508913 8857 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:31.568533 8857 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:31.571130 8857 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0403 04:31:31.576077 8857 ts_tablet_manager.cc:356] Loaded tablet metadata (1 total tablets, 1 live tablets) I0403 04:31:31.576164 8857 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0403 04:31:31.582043 8857 ts_tablet_manager.cc:376] Registered 1 tablets I0403 04:31:31.582509 8882 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Bootstrap starting. I0403 04:31:31.612728 8882 log.cc:525] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Log is configured to *not* fsync() on all Append() calls I0403 04:31:31.615764 8882 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:31:31.616302 8882 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Bootstrap complete. I0403 04:31:31.617218 8882 ts_tablet_manager.cc:1053] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Time spent bootstrapping tablet: real 0.035s user 0.005s sys 0.010s I0403 04:31:31.628244 8882 raft_consensus.cc:340] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:31.631337 8882 raft_consensus.cc:705] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaa406f6d69b41dfb3b47d0c30cb7339, State: Initialized, Role: FOLLOWER I0403 04:31:31.631958 8882 consensus_queue.cc:229] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:31.633023 8882 ts_tablet_manager.cc:1081] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Time spent starting tablet: real 0.016s user 0.017s sys 0.000s I0403 04:31:31.711024 8857 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.1:44021 I0403 04:31:31.712164 8857 webserver.cc:308] Webserver started at http://127.7.236.1:38805/ using document root and password file I0403 04:31:31.712851 8857 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb W0403 04:31:31.714293 8990 tablet.cc:1786] T a00dc3f0c8194ff78f259ead98948da3 P eaa406f6d69b41dfb3b47d0c30cb7339: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:31:31.722561 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 8857 I0403 04:31:31.723101 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.7.236.2:44783 --local_ip_for_outbound_sockets=127.7.236.2 --webserver_port=44933 --webserver_interface=127.7.236.2 --tserver_master_addrs=127.7.236.62:38033 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:31:31.727012 8989 heartbeater.cc:345] Connected to a master server at 127.7.236.62:38033 I0403 04:31:31.727212 8989 heartbeater.cc:426] Registering TS with master... I0403 04:31:31.727872 8989 heartbeater.cc:475] Master 127.7.236.62:38033 requested a full tablet report, sending... I0403 04:31:31.730172 8823 ts_manager.cc:159] Registered new tserver with Master: eaa406f6d69b41dfb3b47d0c30cb7339 (127.7.236.1:44021) I0403 04:31:31.733491 8823 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.7.236.1:36029 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:31.873426 8993 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:31.873697 8993 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:31.875954 8993 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:31.876137 8993 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.236.2 I0403 04:31:31.880478 8993 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.7.236.2:44783 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --webserver_interface=127.7.236.2 --webserver_port=44933 --tserver_master_addrs=127.7.236.62:38033 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.7.236.2 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:31.888618 8993 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 247635us I0403 04:31:31.889348 8993 fs_manager.cc:263] Metadata directory not provided I0403 04:31:31.889466 8993 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:31.895622 8993 fs_manager.cc:399] Time spent opening directory manager: real 0.004s user 0.003s sys 0.002s I0403 04:31:31.896416 8993 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:31.897023 8993 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:31.899946 8993 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:31.900043 8993 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal uuid: "39ea7c600cb547aa9556d9324d9137f3" format_stamp: "Formatted at 2019-04-03 04:31:29 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:31.901146 8993 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:31.936393 8993 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:31.938411 8993 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0403 04:31:31.942262 8993 ts_tablet_manager.cc:356] Loaded tablet metadata (1 total tablets, 1 live tablets) I0403 04:31:31.942353 8993 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0403 04:31:31.945113 8993 ts_tablet_manager.cc:376] Registered 1 tablets I0403 04:31:31.945935 9008 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Bootstrap starting. I0403 04:31:31.965662 9008 log.cc:525] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Log is configured to *not* fsync() on all Append() calls I0403 04:31:31.970536 9008 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:31:31.971225 9008 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Bootstrap complete. I0403 04:31:31.972112 9008 ts_tablet_manager.cc:1053] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Time spent bootstrapping tablet: real 0.027s user 0.015s sys 0.007s I0403 04:31:31.985934 9008 raft_consensus.cc:340] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:31.991432 9008 raft_consensus.cc:705] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39ea7c600cb547aa9556d9324d9137f3, State: Initialized, Role: FOLLOWER I0403 04:31:31.992244 9008 consensus_queue.cc:229] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:31.994230 9008 ts_tablet_manager.cc:1081] T a00dc3f0c8194ff78f259ead98948da3 P 39ea7c600cb547aa9556d9324d9137f3: Time spent starting tablet: real 0.022s user 0.018s sys 0.004s I0403 04:31:32.001094 8993 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.2:44783 I0403 04:31:32.002290 8993 webserver.cc:308] Webserver started at http://127.7.236.2:44933/ using document root and password file I0403 04:31:32.002959 8993 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb I0403 04:31:32.005158 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 8993 I0403 04:31:32.005688 8112 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.7.236.3:46077 --local_ip_for_outbound_sockets=127.7.236.3 --webserver_port=35333 --webserver_interface=127.7.236.3 --tserver_master_addrs=127.7.236.62:38033 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags with env {} I0403 04:31:32.017786 9115 heartbeater.cc:345] Connected to a master server at 127.7.236.62:38033 I0403 04:31:32.018026 9115 heartbeater.cc:426] Registering TS with master... I0403 04:31:32.018594 9115 heartbeater.cc:475] Master 127.7.236.62:38033 requested a full tablet report, sending... I0403 04:31:32.020177 8823 ts_manager.cc:159] Registered new tserver with Master: 39ea7c600cb547aa9556d9324d9137f3 (127.7.236.2:44783) I0403 04:31:32.022016 8823 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.7.236.2:42459 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:32.167022 9118 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:32.167259 9118 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:32.169558 9118 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:32.169662 9118 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.7.236.3 I0403 04:31:32.174013 9118 tablet_server_main.cc:78] Tablet server non-default flags: --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.7.236.3:46077 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --webserver_interface=127.7.236.3 --webserver_port=35333 --tserver_master_addrs=127.7.236.62:38033 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.7.236.3 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:32.181597 9118 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 248135us I0403 04:31:32.182380 9118 fs_manager.cc:263] Metadata directory not provided I0403 04:31:32.182485 9118 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:32.188735 9118 fs_manager.cc:399] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s I0403 04:31:32.189528 9118 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:32.190203 9118 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:32.193400 9118 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:32.193477 9118 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal uuid: "0523d5a5a2e14f3e97357051f7a39237" format_stamp: "Formatted at 2019-04-03 04:31:29 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:32.194640 9118 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:32.244707 9118 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:32.246707 9118 ts_tablet_manager.cc:344] Loading tablet metadata (0/1 complete) I0403 04:31:32.250811 9118 ts_tablet_manager.cc:356] Loaded tablet metadata (1 total tablets, 1 live tablets) I0403 04:31:32.250890 9118 ts_tablet_manager.cc:362] Registering tablets (0/1 complete) I0403 04:31:32.253978 9133 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Bootstrap starting. I0403 04:31:32.265929 9118 ts_tablet_manager.cc:376] Registered 1 tablets I0403 04:31:32.268710 9133 log.cc:525] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Log is configured to *not* fsync() on all Append() calls I0403 04:31:32.273713 9133 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates I0403 04:31:32.274588 9133 tablet_bootstrap.cc:439] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Bootstrap complete. I0403 04:31:32.275832 9133 ts_tablet_manager.cc:1053] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Time spent bootstrapping tablet: real 0.022s user 0.008s sys 0.009s I0403 04:31:32.290875 9133 raft_consensus.cc:340] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:32.295516 9133 raft_consensus.cc:705] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0523d5a5a2e14f3e97357051f7a39237, State: Initialized, Role: FOLLOWER I0403 04:31:32.296408 9133 consensus_queue.cc:229] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0523d5a5a2e14f3e97357051f7a39237" member_type: VOTER last_known_addr { host: "127.7.236.3" port: 46077 } } peers { permanent_uuid: "eaa406f6d69b41dfb3b47d0c30cb7339" member_type: VOTER last_known_addr { host: "127.7.236.1" port: 44021 } } peers { permanent_uuid: "39ea7c600cb547aa9556d9324d9137f3" member_type: VOTER last_known_addr { host: "127.7.236.2" port: 44783 } } I0403 04:31:32.298585 9133 ts_tablet_manager.cc:1081] T a00dc3f0c8194ff78f259ead98948da3 P 0523d5a5a2e14f3e97357051f7a39237: Time spent starting tablet: real 0.023s user 0.020s sys 0.002s I0403 04:31:32.307294 9118 rpc_server.cc:205] RPC server started. Bound to: 127.7.236.3:46077 I0403 04:31:32.308501 9118 webserver.cc:308] Webserver started at http://127.7.236.3:35333/ using document root and password file I0403 04:31:32.309247 9118 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.SerializationModes_ControlShellToolTest.TestControlShell_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb I0403 04:31:32.318888 9240 heartbeater.cc:345] Connected to a master server at 127.7.236.62:38033 I0403 04:31:32.319095 9240 heartbeater.cc:426] Registering TS with master... I0403 04:31:32.319654 8112 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 9118 I0403 04:31:32.319846 9240 heartbeater.cc:475] Master 127.7.236.62:38033 requested a full tablet report, sending... I0403 04:31:32.321559 8823 ts_manager.cc:159] Registered new tserver with Master: 0523d5a5a2e14f3e97357051f7a39237 (127.7.236.3:46077) I0403 04:31:32.323423 8823 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.7.236.3:46437 I0403 04:31:32.331037 8112 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0403 04:31:32.331427 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 8857 I0403 04:31:32.337584 8986 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:32.389274 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 8857 I0403 04:31:32.398561 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 8993 I0403 04:31:32.406036 9112 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:32.453945 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 8993 I0403 04:31:32.462591 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 9118 I0403 04:31:32.470355 9237 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:32.525502 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 9118 I0403 04:31:32.534023 8112 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 8797 I0403 04:31:32.535089 8853 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:32.601105 8112 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 8797 [ OK ] SerializationModes/ControlShellToolTest.TestControlShell/0 (4865 ms) [----------] 1 test from SerializationModes/ControlShellToolTest (4866 ms total) [----------] 1 test from Is343ReplicaUtilTest [ RUN ] Is343ReplicaUtilTest.Is343Cluster/0 I0403 04:31:32.678896 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/data --block_manager=log --webserver_interface=localhost --ipki_ca_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:35133 --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --raft_prepare_replacement_before_eviction=false --rpc_reuseport=true with env {} WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:32.863615 9253 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:32.863867 9253 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:32.866515 9253 flags.cc:406] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false W0403 04:31:32.866581 9253 flags.cc:406] Enabled experimental flag: --ipki_ca_key_size=1024 W0403 04:31:32.866621 9253 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:32.866665 9253 flags.cc:406] Enabled experimental flag: --tsk_num_rsa_bits=512 W0403 04:31:32.866721 9253 flags.cc:406] Enabled experimental flag: --rpc_reuseport=true I0403 04:31:32.871178 9253 master_main.cc:73] Master server non-default flags: --raft_prepare_replacement_before_eviction=false --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/wal --ipki_ca_key_size=1024 --ipki_server_key_size=1024 --tsk_num_rsa_bits=512 --rpc_bind_addresses=127.3.136.126:35133 --rpc_reuseport=true --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb --webserver_interface=127.3.136.126 --webserver_port=0 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/logs --logbuflevel=-1 --logtostderr=true Master server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:32.877315 9253 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 248135us I0403 04:31:32.878473 9253 fs_manager.cc:263] Metadata directory not provided I0403 04:31:32.878551 9253 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:32.878814 9253 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:32.878909 9253 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:32.881494 9253 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/data/instance: uuid: "a3d46501e6da4b6b8ae3d52843266384" format_stamp: "Formatted at 2019-04-03 04:31:32 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:32.882099 9253 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/wal/instance: uuid: "a3d46501e6da4b6b8ae3d52843266384" format_stamp: "Formatted at 2019-04-03 04:31:32 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:32.888690 9253 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.004s sys 0.001s I0403 04:31:32.889873 9253 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:32.890440 9253 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:32.893349 9253 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s I0403 04:31:32.893424 9253 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/wal uuid: "a3d46501e6da4b6b8ae3d52843266384" format_stamp: "Formatted at 2019-04-03 04:31:32 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:32.893574 9253 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:32.944022 9253 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:32.960659 9253 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.126:35133 I0403 04:31:32.961877 9253 webserver.cc:308] Webserver started at http://127.3.136.126:46639/ using document root and password file I0403 04:31:32.962579 9253 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/master-0/data/info.pb I0403 04:31:32.963270 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master as pid 9253 I0403 04:31:32.963994 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/data --block_manager=log --rpc_bind_addresses=127.3.136.65:0 --local_ip_for_outbound_sockets=127.3.136.65 --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:35133 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --raft_prepare_replacement_before_eviction=false with env {} I0403 04:31:32.965971 9312 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:32.979049 9312 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384: Bootstrap starting. I0403 04:31:32.981444 9312 tablet_bootstrap.cc:590] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384: No blocks or log segments found. Creating new log. I0403 04:31:32.982398 9312 log.cc:525] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384: Log is configured to *not* fsync() on all Append() calls I0403 04:31:32.983829 9312 tablet_bootstrap.cc:439] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384: No bootstrap required, opened a new log I0403 04:31:32.990738 9312 raft_consensus.cc:340] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d46501e6da4b6b8ae3d52843266384" member_type: VOTER } I0403 04:31:32.991031 9312 raft_consensus.cc:366] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:32.991106 9312 raft_consensus.cc:705] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3d46501e6da4b6b8ae3d52843266384, State: Initialized, Role: FOLLOWER I0403 04:31:32.991590 9312 consensus_queue.cc:229] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d46501e6da4b6b8ae3d52843266384" member_type: VOTER } I0403 04:31:32.991775 9312 raft_consensus.cc:380] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately I0403 04:31:32.991873 9312 raft_consensus.cc:472] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration) I0403 04:31:32.992029 9312 raft_consensus.cc:2886] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:32.993672 9312 raft_consensus.cc:494] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d46501e6da4b6b8ae3d52843266384" member_type: VOTER } I0403 04:31:32.994066 9312 leader_election.cc:310] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a3d46501e6da4b6b8ae3d52843266384; no voters: I0403 04:31:32.994755 9315 raft_consensus.cc:2640] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:32.995116 9312 leader_election.cc:296] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [CANDIDATE]: Term 1 election: Requested vote from peers I0403 04:31:32.995904 9315 raft_consensus.cc:667] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [term 1 LEADER]: Becoming Leader. State: Replica: a3d46501e6da4b6b8ae3d52843266384, State: Running, Role: LEADER I0403 04:31:32.996392 9315 consensus_queue.cc:206] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d46501e6da4b6b8ae3d52843266384" member_type: VOTER } I0403 04:31:32.998112 9317 sys_catalog.cc:337] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a3d46501e6da4b6b8ae3d52843266384" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d46501e6da4b6b8ae3d52843266384" member_type: VOTER } } I0403 04:31:32.998872 9317 sys_catalog.cc:340] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [sys.catalog]: This master's current role is: LEADER I0403 04:31:32.998723 9316 sys_catalog.cc:337] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a3d46501e6da4b6b8ae3d52843266384. Latest consensus state: current_term: 1 leader_uuid: "a3d46501e6da4b6b8ae3d52843266384" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d46501e6da4b6b8ae3d52843266384" member_type: VOTER } } I0403 04:31:32.999157 9316 sys_catalog.cc:340] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [sys.catalog]: This master's current role is: LEADER I0403 04:31:32.999541 9312 sys_catalog.cc:337] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [sys.catalog]: SysCatalogTable state changed. Reason: Started TabletReplica. Latest consensus state: current_term: 1 leader_uuid: "a3d46501e6da4b6b8ae3d52843266384" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a3d46501e6da4b6b8ae3d52843266384" member_type: VOTER } } I0403 04:31:32.999755 9312 sys_catalog.cc:340] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [sys.catalog]: This master's current role is: LEADER I0403 04:31:33.001991 9319 catalog_manager.cc:1055] Loading table and tablet metadata into memory... I0403 04:31:33.001811 9312 sys_catalog.cc:424] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384 [sys.catalog]: configured and running, proceeding with master startup. I0403 04:31:33.007217 9319 catalog_manager.cc:1066] Initializing Kudu internal certificate authority... I0403 04:31:33.055207 9319 catalog_manager.cc:950] Generated new certificate authority record I0403 04:31:33.056540 9319 catalog_manager.cc:1075] Loading token signing keys... I0403 04:31:33.063030 9319 catalog_manager.cc:4281] T 00000000000000000000000000000000 P a3d46501e6da4b6b8ae3d52843266384: Generated new TSK 0 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:33.131960 9313 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:33.132246 9313 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:33.134505 9313 flags.cc:406] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false W0403 04:31:33.134575 9313 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:33.134681 9313 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.65 I0403 04:31:33.142552 9313 tablet_server_main.cc:78] Tablet server non-default flags: --raft_prepare_replacement_before_eviction=false --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.65:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb --webserver_interface=127.3.136.65 --webserver_port=0 --tserver_master_addrs=127.3.136.126:35133 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.65 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:33.150590 9313 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 248635us I0403 04:31:33.151300 9313 fs_manager.cc:263] Metadata directory not provided I0403 04:31:33.151435 9313 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:33.151784 9313 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:33.151862 9313 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:33.154386 9313 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/data/instance: uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.155019 9313 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/wal/instance: uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.164363 9313 fs_manager.cc:503] Time spent creating directory manager: real 0.009s user 0.005s sys 0.004s I0403 04:31:33.165591 9313 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:33.166257 9313 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:33.169445 9313 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0403 04:31:33.169529 9313 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/wal uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.169673 9313 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:33.210281 9313 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:33.214848 9313 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:31:33.214924 9313 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:31:33.359158 9313 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.65:45289 I0403 04:31:33.360396 9313 webserver.cc:308] Webserver started at http://127.3.136.65:45693/ using document root and password file I0403 04:31:33.360993 9313 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-0/data/info.pb I0403 04:31:33.365901 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 9313 I0403 04:31:33.366477 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/data --block_manager=log --rpc_bind_addresses=127.3.136.66:0 --local_ip_for_outbound_sockets=127.3.136.66 --webserver_interface=127.3.136.66 --webserver_port=0 --tserver_master_addrs=127.3.136.126:35133 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --raft_prepare_replacement_before_eviction=false with env {} I0403 04:31:33.387686 9442 heartbeater.cc:345] Connected to a master server at 127.3.136.126:35133 I0403 04:31:33.387913 9442 heartbeater.cc:426] Registering TS with master... I0403 04:31:33.388392 9442 heartbeater.cc:475] Master 127.3.136.126:35133 requested a full tablet report, sending... I0403 04:31:33.389952 9279 ts_manager.cc:159] Registered new tserver with Master: c1e7fba42ed342dc89761a5c9ebd53d2 (127.3.136.65:45289) I0403 04:31:33.391633 9279 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.65:46141 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:33.526412 9446 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:33.526690 9446 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:33.528981 9446 flags.cc:406] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false W0403 04:31:33.529047 9446 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:33.529166 9446 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.66 I0403 04:31:33.533270 9446 tablet_server_main.cc:78] Tablet server non-default flags: --raft_prepare_replacement_before_eviction=false --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.66:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb --webserver_interface=127.3.136.66 --webserver_port=0 --tserver_master_addrs=127.3.136.126:35133 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.66 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:33.540442 9446 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 248635us I0403 04:31:33.541061 9446 fs_manager.cc:263] Metadata directory not provided I0403 04:31:33.541162 9446 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:33.541503 9446 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:33.541569 9446 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:33.544107 9446 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/data/instance: uuid: "2cb9eafa2b1c4006a806fce82e0b3501" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.544729 9446 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/wal/instance: uuid: "2cb9eafa2b1c4006a806fce82e0b3501" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.551457 9446 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s I0403 04:31:33.552667 9446 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:33.553243 9446 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:33.556332 9446 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0403 04:31:33.556411 9446 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/wal uuid: "2cb9eafa2b1c4006a806fce82e0b3501" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.556541 9446 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:33.580422 9446 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:33.582124 9446 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:31:33.582213 9446 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:31:33.608970 9446 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.66:45755 I0403 04:31:33.610083 9446 webserver.cc:308] Webserver started at http://127.3.136.66:42071/ using document root and password file I0403 04:31:33.610626 9446 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-1/data/info.pb I0403 04:31:33.614297 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 9446 I0403 04:31:33.614874 3617 external_mini_cluster.cc:933] Running /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/wal --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/data --block_manager=log --rpc_bind_addresses=127.3.136.67:0 --local_ip_for_outbound_sockets=127.3.136.67 --webserver_interface=127.3.136.67 --webserver_port=0 --tserver_master_addrs=127.3.136.126:35133 --never_fsync --ipki_server_key_size=1024 --enable_minidumps=false --redact=none --metrics_log_interval_ms=1000 --logtostderr --logbuflevel=-1 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/logs --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --server_dump_info_format=pb --rpc_server_allow_ephemeral_ports --unlock_experimental_flags --unlock_unsafe_flags --raft_prepare_replacement_before_eviction=false with env {} I0403 04:31:33.624680 9565 heartbeater.cc:345] Connected to a master server at 127.3.136.126:35133 I0403 04:31:33.624850 9565 heartbeater.cc:426] Registering TS with master... I0403 04:31:33.625274 9565 heartbeater.cc:475] Master 127.3.136.126:35133 requested a full tablet report, sending... I0403 04:31:33.626394 9279 ts_manager.cc:159] Registered new tserver with Master: 2cb9eafa2b1c4006a806fce82e0b3501 (127.3.136.66:45755) I0403 04:31:33.627276 9279 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.66:34721 WARNING: Logging before InitGoogleLogging() is written to STDERR W0403 04:31:33.765563 9568 flags.cc:406] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true W0403 04:31:33.765784 9568 flags.cc:406] Enabled unsafe flag: --never_fsync=true W0403 04:31:33.767918 9568 flags.cc:406] Enabled experimental flag: --raft_prepare_replacement_before_eviction=false W0403 04:31:33.768014 9568 flags.cc:406] Enabled experimental flag: --ipki_server_key_size=1024 W0403 04:31:33.768105 9568 flags.cc:406] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.136.67 I0403 04:31:33.771978 9568 tablet_server_main.cc:78] Tablet server non-default flags: --raft_prepare_replacement_before_eviction=false --fs_data_dirs=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/data --fs_wal_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/wal --ipki_server_key_size=1024 --rpc_bind_addresses=127.3.136.67:0 --rpc_server_allow_ephemeral_ports=true --metrics_log_interval_ms=1000 --server_dump_info_format=pb --server_dump_info_path=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb --webserver_interface=127.3.136.67 --webserver_port=0 --tserver_master_addrs=127.3.136.126:35133 --never_fsync=true --redact=none --unlock_experimental_flags=true --unlock_unsafe_flags=true --enable_minidumps=false --local_ip_for_outbound_sockets=127.3.136.67 --log_dir=/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/logs --logbuflevel=-1 --logtostderr=true Tablet server version: kudu 1.10.0-cdh6.x-SNAPSHOT revision 0352bd622196e5ae299faf22e5564590d013ed73 build type FASTDEBUG built by jenkins at 02 Apr 2019 20:47:09 PST on quasar-daxdrg-1.vpc.cloudera.com build id 302510 ASAN enabled I0403 04:31:33.779423 9568 system_ntp.cc:199] NTP initialized. Skew: 500ppm Current error: 248635us I0403 04:31:33.780094 9568 fs_manager.cc:263] Metadata directory not provided I0403 04:31:33.780179 9568 fs_manager.cc:269] Using write-ahead log directory (fs_wal_dir) as metadata directory I0403 04:31:33.780467 9568 server_base.cc:433] Could not load existing FS layout: Not found: could not find a healthy instance file I0403 04:31:33.780539 9568 server_base.cc:434] Attempting to create new FS layout instead I0403 04:31:33.782989 9568 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/data/instance: uuid: "ad2d151b5c8f4c46887a84556f011b90" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.783558 9568 fs_manager.cc:602] Generated new instance metadata in path /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/wal/instance: uuid: "ad2d151b5c8f4c46887a84556f011b90" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.789906 9568 fs_manager.cc:503] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s I0403 04:31:33.791045 9568 env_posix.cc:1676] Not raising this process' open files per process limit of 1048576; it is already as high as it can go I0403 04:31:33.791594 9568 file_cache.cc:466] Constructed file cache lbm with capacity 419430 I0403 04:31:33.794505 9568 fs_manager.cc:419] Time spent opening block manager: real 0.002s user 0.000s sys 0.000s I0403 04:31:33.794626 9568 fs_manager.cc:436] Opened local filesystem: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/data,/tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/wal uuid: "ad2d151b5c8f4c46887a84556f011b90" format_stamp: "Formatted at 2019-04-03 04:31:33 on dist-test-slave-dist-test-slave-1l7r" I0403 04:31:33.794780 9568 fs_report.cc:352] FS layout report -------------------- wal directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/wal metadata directory: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/wal 1 data directories: /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/data/data Total live blocks: 0 Total live bytes: 0 Total live bytes (after alignment): 0 Total number of LBM containers: 0 (0 full) Did not check for missing blocks Did not check for orphaned blocks Total full LBM containers with extra space: 0 (0 repaired) Total full LBM container extra space in bytes: 0 (0 repaired) Total incomplete LBM containers: 0 (0 repaired) Total LBM partial records: 0 (0 repaired) I0403 04:31:33.824529 9568 env_posix.cc:1676] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go I0403 04:31:33.826263 9568 ts_tablet_manager.cc:356] Loaded tablet metadata (0 total tablets, 0 live tablets) I0403 04:31:33.826354 9568 ts_tablet_manager.cc:376] Registered 0 tablets I0403 04:31:33.854924 9568 rpc_server.cc:205] RPC server started. Bound to: 127.3.136.67:45775 I0403 04:31:33.856106 9568 webserver.cc:308] Webserver started at http://127.3.136.67:42059/ using document root and password file I0403 04:31:33.856724 9568 server_base.cc:608] Dumped server information to /tmp/dist-test-tasks9LKQH/test-tmp/kudu-tool-test.0.Is343ReplicaUtilTest.Is343Cluster_0.1554265799459872-3617/minicluster-data/ts-2/data/info.pb I0403 04:31:33.860050 3617 external_mini_cluster.cc:995] Started /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver as pid 9568 I0403 04:31:33.873880 9687 heartbeater.cc:345] Connected to a master server at 127.3.136.126:35133 I0403 04:31:33.874091 9687 heartbeater.cc:426] Registering TS with master... I0403 04:31:33.874541 9687 heartbeater.cc:475] Master 127.3.136.126:35133 requested a full tablet report, sending... I0403 04:31:33.875614 9279 ts_manager.cc:159] Registered new tserver with Master: ad2d151b5c8f4c46887a84556f011b90 (127.3.136.67:45775) I0403 04:31:33.876695 9279 master_service.cc:271] Signed X509 certificate for tserver {username='slave'} at 127.3.136.67:34301 I0403 04:31:33.877893 3617 external_mini_cluster.cc:623] 3 TS(s) registered with all masters I0403 04:31:33.900868 3617 test_util.cc:212] Using random seed: -1166142942 I0403 04:31:33.910166 9279 catalog_manager.cc:1416] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54524: name: "is_343_test_table" schema { columns { name: "key" type: INT32 is_key: true is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "int_val" type: INT32 is_key: false is_nullable: false encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } columns { name: "string_val" type: STRING is_key: false is_nullable: true encoding: AUTO_ENCODING compression: DEFAULT_COMPRESSION cfile_block_size: 0 } } num_replicas: 3 split_rows_range_bounds { } partition_schema { range_schema { columns { name: "key" } } } I0403 04:31:33.940557 9502 tablet_service.cc:1006] Processing CreateTablet for tablet 73a21f5298194fecb7b2da2417f3a15d (table=is_343_test_table [id=b88b3f9daea841afb85c7160c85dce8a]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:31:33.941503 9502 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 73a21f5298194fecb7b2da2417f3a15d. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:33.948609 9379 tablet_service.cc:1006] Processing CreateTablet for tablet 73a21f5298194fecb7b2da2417f3a15d (table=is_343_test_table [id=b88b3f9daea841afb85c7160c85dce8a]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:31:33.948881 9624 tablet_service.cc:1006] Processing CreateTablet for tablet 73a21f5298194fecb7b2da2417f3a15d (table=is_343_test_table [id=b88b3f9daea841afb85c7160c85dce8a]), partition=RANGE (key) PARTITION UNBOUNDED I0403 04:31:33.949492 9379 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 73a21f5298194fecb7b2da2417f3a15d. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:33.949858 9624 data_dirs.cc:938] Could only allocate 1 dirs of requested 3 for tablet 73a21f5298194fecb7b2da2417f3a15d. 1 dirs total, 0 dirs full, 0 dirs failed I0403 04:31:33.955021 9716 tablet_bootstrap.cc:439] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501: Bootstrap starting. I0403 04:31:33.958734 9716 tablet_bootstrap.cc:590] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501: No blocks or log segments found. Creating new log. I0403 04:31:33.960014 9716 log.cc:525] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501: Log is configured to *not* fsync() on all Append() calls I0403 04:31:33.960779 9717 tablet_bootstrap.cc:439] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2: Bootstrap starting. I0403 04:31:33.964112 9717 tablet_bootstrap.cc:590] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2: No blocks or log segments found. Creating new log. I0403 04:31:33.965152 9717 log.cc:525] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2: Log is configured to *not* fsync() on all Append() calls I0403 04:31:33.966109 9719 tablet_bootstrap.cc:439] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90: Bootstrap starting. I0403 04:31:33.966646 9716 tablet_bootstrap.cc:439] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501: No bootstrap required, opened a new log I0403 04:31:33.966924 9716 ts_tablet_manager.cc:1053] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501: Time spent bootstrapping tablet: real 0.012s user 0.001s sys 0.004s I0403 04:31:33.968210 9719 tablet_bootstrap.cc:590] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90: No blocks or log segments found. Creating new log. I0403 04:31:33.969264 9719 log.cc:525] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90: Log is configured to *not* fsync() on all Append() calls I0403 04:31:33.970783 9717 tablet_bootstrap.cc:439] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2: No bootstrap required, opened a new log I0403 04:31:33.970801 9719 tablet_bootstrap.cc:439] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90: No bootstrap required, opened a new log I0403 04:31:33.971001 9719 ts_tablet_manager.cc:1053] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90: Time spent bootstrapping tablet: real 0.005s user 0.004s sys 0.000s I0403 04:31:33.971014 9717 ts_tablet_manager.cc:1053] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.000s I0403 04:31:33.973017 9716 raft_consensus.cc:340] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:33.973431 9716 raft_consensus.cc:366] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:33.973523 9716 raft_consensus.cc:705] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2cb9eafa2b1c4006a806fce82e0b3501, State: Initialized, Role: FOLLOWER I0403 04:31:33.974117 9716 consensus_queue.cc:229] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:33.974906 9565 heartbeater.cc:467] Master 127.3.136.126:35133 was elected leader, sending a full tablet report... I0403 04:31:33.975854 9716 ts_tablet_manager.cc:1081] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501: Time spent starting tablet: real 0.009s user 0.006s sys 0.003s I0403 04:31:33.977023 9719 raft_consensus.cc:340] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:33.977526 9719 raft_consensus.cc:366] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:33.977615 9719 raft_consensus.cc:705] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ad2d151b5c8f4c46887a84556f011b90, State: Initialized, Role: FOLLOWER I0403 04:31:33.978013 9719 consensus_queue.cc:229] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:33.978806 9717 raft_consensus.cc:340] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending transactions. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:33.979434 9717 raft_consensus.cc:366] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely I0403 04:31:33.979544 9717 raft_consensus.cc:705] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1e7fba42ed342dc89761a5c9ebd53d2, State: Initialized, Role: FOLLOWER I0403 04:31:33.979610 9687 heartbeater.cc:467] Master 127.3.136.126:35133 was elected leader, sending a full tablet report... I0403 04:31:33.980036 9717 consensus_queue.cc:229] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:33.980460 9719 ts_tablet_manager.cc:1081] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90: Time spent starting tablet: real 0.009s user 0.005s sys 0.004s I0403 04:31:33.980868 9442 heartbeater.cc:467] Master 127.3.136.126:35133 was elected leader, sending a full tablet report... I0403 04:31:33.981462 9717 ts_tablet_manager.cc:1081] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2: Time spent starting tablet: real 0.010s user 0.010s sys 0.000s I0403 04:31:34.007704 9723 raft_consensus.cc:472] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout) I0403 04:31:34.007915 9723 raft_consensus.cc:494] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:34.009408 9723 leader_election.cc:296] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2cb9eafa2b1c4006a806fce82e0b3501 (127.3.136.66:45755), c1e7fba42ed342dc89761a5c9ebd53d2 (127.3.136.65:45289) I0403 04:31:34.015401 9522 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "73a21f5298194fecb7b2da2417f3a15d" candidate_uuid: "ad2d151b5c8f4c46887a84556f011b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" is_pre_election: true I0403 04:31:34.015830 9522 raft_consensus.cc:2346] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2d151b5c8f4c46887a84556f011b90 in term 0. I0403 04:31:34.016245 9399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "73a21f5298194fecb7b2da2417f3a15d" candidate_uuid: "ad2d151b5c8f4c46887a84556f011b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" is_pre_election: true I0403 04:31:34.016427 9578 leader_election.cc:310] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cb9eafa2b1c4006a806fce82e0b3501, ad2d151b5c8f4c46887a84556f011b90; no voters: I0403 04:31:34.016630 9399 raft_consensus.cc:2346] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ad2d151b5c8f4c46887a84556f011b90 in term 0. I0403 04:31:34.016867 9723 raft_consensus.cc:2640] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 0 FOLLOWER]: Leader pre-election won for term 1 I0403 04:31:34.016955 9723 raft_consensus.cc:472] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout) I0403 04:31:34.017043 9723 raft_consensus.cc:2886] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:34.019053 9723 raft_consensus.cc:494] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:34.019595 9723 leader_election.cc:296] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [CANDIDATE]: Term 1 election: Requested vote from peers 2cb9eafa2b1c4006a806fce82e0b3501 (127.3.136.66:45755), c1e7fba42ed342dc89761a5c9ebd53d2 (127.3.136.65:45289) I0403 04:31:34.020093 9522 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "73a21f5298194fecb7b2da2417f3a15d" candidate_uuid: "ad2d151b5c8f4c46887a84556f011b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" I0403 04:31:34.020138 9399 tablet_service.cc:1276] Received RequestConsensusVote() RPC: tablet_id: "73a21f5298194fecb7b2da2417f3a15d" candidate_uuid: "ad2d151b5c8f4c46887a84556f011b90" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" I0403 04:31:34.020226 9522 raft_consensus.cc:2886] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:34.020311 9399 raft_consensus.cc:2886] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2 [term 0 FOLLOWER]: Advancing to term 1 I0403 04:31:34.022022 9522 raft_consensus.cc:2346] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2d151b5c8f4c46887a84556f011b90 in term 1. I0403 04:31:34.022202 9399 raft_consensus.cc:2346] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ad2d151b5c8f4c46887a84556f011b90 in term 1. I0403 04:31:34.022418 9578 leader_election.cc:310] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2cb9eafa2b1c4006a806fce82e0b3501, ad2d151b5c8f4c46887a84556f011b90; no voters: I0403 04:31:34.022717 9723 raft_consensus.cc:2640] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 1 FOLLOWER]: Leader election won for term 1 I0403 04:31:34.023097 9723 raft_consensus.cc:667] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [term 1 LEADER]: Becoming Leader. State: Replica: ad2d151b5c8f4c46887a84556f011b90, State: Running, Role: LEADER I0403 04:31:34.023494 9723 consensus_queue.cc:206] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } I0403 04:31:34.026808 9278 catalog_manager.cc:3977] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90 reported cstate change: term changed from 0 to 1, leader changed from to ad2d151b5c8f4c46887a84556f011b90 (127.3.136.67). New cstate: current_term: 1 leader_uuid: "ad2d151b5c8f4c46887a84556f011b90" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2cb9eafa2b1c4006a806fce82e0b3501" member_type: VOTER last_known_addr { host: "127.3.136.66" port: 45755 } } peers { permanent_uuid: "ad2d151b5c8f4c46887a84556f011b90" member_type: VOTER last_known_addr { host: "127.3.136.67" port: 45775 } } peers { permanent_uuid: "c1e7fba42ed342dc89761a5c9ebd53d2" member_type: VOTER last_known_addr { host: "127.3.136.65" port: 45289 } } } I0403 04:31:34.081468 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 9313 I0403 04:31:34.086299 9439 generic_service.cc:171] Checking for leaks (request via RPC) W0403 04:31:34.108558 9688 tablet.cc:1786] T 73a21f5298194fecb7b2da2417f3a15d P ad2d151b5c8f4c46887a84556f011b90: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:31:34.112624 9566 tablet.cc:1786] T 73a21f5298194fecb7b2da2417f3a15d P 2cb9eafa2b1c4006a806fce82e0b3501: Can't schedule compaction. Clean time has not been advanced past its initial value. W0403 04:31:34.131287 9443 tablet.cc:1786] T 73a21f5298194fecb7b2da2417f3a15d P c1e7fba42ed342dc89761a5c9ebd53d2: Can't schedule compaction. Clean time has not been advanced past its initial value. I0403 04:31:34.131938 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 9313 I0403 04:31:34.140801 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 9446 I0403 04:31:34.146028 9562 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:34.195127 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 9446 I0403 04:31:34.204748 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver pid 9568 I0403 04:31:34.209661 9684 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:34.259698 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-tserver with pid 9568 I0403 04:31:34.268424 3617 external_mini_cluster.cc:1172] Attempting to check leaks for /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master pid 9253 I0403 04:31:34.269382 9309 generic_service.cc:171] Checking for leaks (request via RPC) I0403 04:31:34.347409 3617 external_mini_cluster.cc:1131] Killing /tmp/dist-test-tasks9LKQH/build/asan/bin/kudu-master with pid 9253 [ OK ] Is343ReplicaUtilTest.Is343Cluster/0 (1689 ms) [----------] 1 test from Is343ReplicaUtilTest (1690 ms total) [----------] Global test environment tear-down [==========] 18 tests from 5 test cases ran. (94895 ms total) [ PASSED ] 17 tests. [ FAILED ] 1 test, listed below: [ FAILED ] CopyTableParameterized/ToolTestCopyTableParameterized.TestCopyTable/2, where GetParam() = 2 1 FAILED TEST